Skip to main content

ORIGINAL RESEARCH article

Front. Public Health, 25 October 2022
Sec. Public Mental Health
This article is part of the Research Topic Psychological Distress in Healthy, Vulnerable, and Diseased Groups: Neurobiological and Psychosocial Bases, Detection Methods, and Creative Management Strategies View all 12 articles

Psychometric evaluation of the depression anxiety stress scale 8-items (DASS-8)/DASS-12/DASS-21 among family caregivers of patients with dementia

  • 1Department of Psychiatric Nursing and Mental Health, Faculty of Nursing, Alexandria University, Alexandria, Egypt
  • 2Fundamentals of Nursing Department, College of Nursing, Imam Abdulrahman Bin Faisal University, Dammam, Saudi Arabia
  • 3Department of Animal and Poultry Production, Faculty of Agriculture, Damanhour University, Damanhour, Egypt
  • 4Faculty of Nursing, Isra University, Amman, Jordan
  • 5School of Nursing and Midwifery, Western Sydney University, Penrith, NSW, Australia
  • 6Jordan University of Science and Technology, Faculty of Nursing, Irbid, Jordan
  • 7Department of Basic and Educational Sciences, Faculty of Education for Early Childhood, Alexandria University, Alexandria, Egypt
  • 8Department of Medicine, Unayzah College of Medicine and Medical Sciences, Qassim University, Unayzah, Saudi Arabia
  • 9Psychiatric and Mental Health Nursing Department, Faculty of Nursing, Mansoura University, Mansoura, Egypt
  • 10Department of Nursing, College of Applied Medical Sciences, King Faisal University, Al-Ahsa, Saudi Arabia
  • 11Department of Gerontological Nursing, Faculty of Nursing, Alexandria University, Alexandria, Egypt

Patients with dementia express a set of problematic and deteriorating symptoms, along with self-care dependency. Over time, the mental health of family caregivers of persons with dementia may be affected, putting them at a high risk for psychopathology, which may be associated with endangered wellbeing of people with dementia. This cross-sectional instrumental design study examined the psychometric properties of the Depression Anxiety Stress Scale 8-items (DASS-8), DASS-12, and DASS-21 in a convenient sample of 571 caregivers from northern Italy and southern Switzerland (mean age = 53 years, SD = 12, range = 24–89 years). A bifactor structure of the three measures had the best fit; some items of the DASS-12/DASS-21 failed to load on their domain-specific factors. The three-factor structure was invariant across various groups (e.g., gender and education), expressed adequate reliability and convergent validity, and had strong positive correlation with the three-item UCLA Loneliness Scale (UCLALS3). Distress scores did not differ among carers of different types of dementia (Alzheimer's disease vs. other types, e.g., vascular dementia). However, distress scores were significantly high among female individuals, adult children caregivers, those caring for dependent patients, and those who received help with care. For 54.9 and 38.8% of the latter, care was provided by relatives and health professionals, respectively. Since the DASS-8 expresses adequate psychometrics comparable with the DASS-21, it may be used as a brief measure of distress in this population.

Introduction

Dementia is a devastating clinical syndrome, which represents the second prevalent neurological condition after headache and the third most burdensome disease—striking more than 50 million people worldwide and contributing to an annual cost of care of more than $232 billion in the United States (14). The most common form of dementia is Alzheimer's disease (60–80% of dementia cases) (1, 5). However, it may develop in Parkinson's disease, cerebral vascular injury, metabolic disorders, etc. (1, 3, 6, 7). Dementia runs a progressive course. Drastic deteriorations in cognitive and functional performance develop during late stages of the disease (2, 3). Thus, dementia represents a major source of disability, with most patients expressing significant impairments in all aspects of life and high dependency in all activities of daily living (ADL). Dementia care is largely provided by family members, friends, or informal caregivers (2, 3, 8).

More than two-thirds of family caregivers of patients with dementia in the United States perform numerous medical/nursing tasks, which are usually performed by health professionals such as managing multiple medications, injections, tube feedings, and wound care (9). Family caregivers are stressed with dementia symptoms (e.g., cognitive alterations, anxiety, agitation, disinhibition, aggressive behavior, and sleep disturbances), comorbidities, and complex medication regimen (8, 9). Moreover, family caregivers are primarily elderly spouses (mean age = 62.5 ± 23.3 years, 74.1% women), who may endure physical and mental adversities associated with their own old age (e.g., age-related diseases and disability) (9, 10). As a result, caregivers frequently experience burnout, emotional distress, anxiety, sleep disturbance, poor general health, low quality of life, and social isolation (8, 9, 1113), with higher vulnerability among women, spouses, and elders, especially those with deficient coping, social isolation, lack of training/information about the disease, poor premorbid relationship with care recipients, and high levels of negative expressed emotions (8, 9). Caregiving distress among adult-child caregivers of parents with dementia predominately originates from the impact of caregiving on children's health, schedule, and finance (14).

Orchestrated with the overall rise in distress among the general population during the COVID-19 pandemic (15), caregivers of patients with dementia have exhibited a range of mental symptoms such as mood dysfunction (e.g., anxiety and depression), sleep disturbance, loneliness, and dysfunctional eating (16, 17). Increased caregiver distress is reported to be a direct effect of COVID-19 confinement, independent of dementia stage. It is also associated with family caregivers' concerns about unavailability of paid caregivers and fear of transmitting COVID-19 infection while caring for their relatives (18). In addition, the COVID-19 era has witnessed an increase in the severity of dementia symptoms: behavioral dysfunctions, anxiety, apathy/depression, and an excessive decline in cognitive functions (18, 19). Deteriorations in dementia symptoms during COVID-19 are associated with increased caregiver distress, as well as increased intensity of caregiving and severity of caregiver burden (16, 18, 20). Distress among family and informal caregivers can adversely affect the dementia course, leading to further deteriorations in the cognitive, behavioral, and emotional symptoms of dementia, in addition to the institutionalization of dementia care recipients and increased elder abuse (8, 10). Therefore, proper assessment of distress symptomatology among dementia caregivers is necessary to mobilize actions, which are necessary to facilitate resilience in such a vulnerable group.

According to the tripartite model, general affective distress is a common component of both depression and anxiety. However, both conditions are suggested to have distinct features, which can be reliably measured (21). The Depression Anxiety Stress Scale-21 (DASS-21) has been designed and is commonly used to measure the distinct features of depression, anxiety, and stress (22). Nonetheless, subsequent investigations revealed failure of the DASS-21 to express a consistent dimensional structure (2327), along with concerns about its psychometric equivalence across different groups both in English-speaking countries and other parts of the world (23, 2830), as well as a ceiling effect (31). Accordingly, the scale has undergone extensive revisions, resulting in several brief forms with better psychometric properties [DASS-18 (32, 33), DASS-14 (34), DASS-13, DASS-9 (23), DASS-12 (35), and DASS-8 (36)]. Given that short scales encourage higher response rates, the last two shortened versions of the DASS-21 have been recently tested among psychiatric patients from Korea and Saudi Arabia; healthy individuals from the USA, Australia, Saudi Arabia, and Ghana; and Australian women with chronic pelvic pain (3538). In all studies, the DASS-8 expressed the best fit and invariance across different groups. Its internal consistency and convergent validity were close to or greater than those of the parent scale and the DASS-12. Discriminant validity analysis revealed that the subscales of the DASS-8 are more distinct than those of the parent scale and the DASS-12 (37, 38). Because of its brevity and simplicity, the DASS-8 seems to be a more attractive measure of general distress and mental symptoms of depression, anxiety, and stress. However, individuals from different cultures have their own unique ways of responding to stressful events and reporting their mental distress. Such variations may affect the manner through which they respond to the items of a symptom scale, resulting in a reporting bias, which may reduce the credibility of measurement (39). Therefore, further investigations of the psychometric characteristics of the DASS-8 in various cultural contexts and among different groups are needed, should the scale be used as a global measure of common mental symptomatology. This study aimed to evaluate the psychometric properties of the DASS-8 relative to the DAS-12 and the DASS-21 among dementia family caregivers from Italy and Switzerland. Based on previous studies, we hypothesized that the DASS measures will express a consistent three-dimensional structure and measurement invariance among caregivers from both countries. The DASS measures would congruently have positive correlations with caregiver loneliness. Based on the literature (810, 14), distress levels are expected to be higher among respondents who are females, spouses of care recipients, those not receiving help with care, and those caring for patients with Alzheimer's disease or who are ADL-dependent patients than in those who are males, adult children, receiving help, caring for other types of dementia, or autonomous patients.

Materials and methods

Study design, participants, and procedure

This cross-sectional study is a secondary analysis of a public dataset (40) comprising a convenient sample of Italian-speaking adult family caregivers of people with dementia. Participants were recruited through advertisements disseminated through social media and 53 dementia day-care centers in Italy and southern Switzerland. Data were collected through an online survey implemented in Research Electronic Data Capture (RedCap) during the period between 25 May and 25 June 2020. All the participants signed a digital informed consent. The data collection procedure was approved by Italian and Swiss Cantonal ethics committees (16), and the dataset is shared under the terms of creative common license (CC BY 4.0) (40). Therefore, no ethical approval was obtained for the current study.

Measures

The participants completed a self-administered questionnaire, which was in Italian and consisted of three sections. The first section inquired about participants' sociodemographic characteristics (age, gender, education, and employment), the type of dementia, level of ADL dependency, duration of dementia care provision, their relationship with the care recipient, and if they received help with dementia care (16).

Section two comprised the Italian version of the Depression Anxiety Stress Scale (DASS-21) (41) as a measure of psychological distress, depression, anxiety, and stress symptoms. The DASS-21 is composed of three subscales, and each subscale comprised seven items. The respondents would rate the intensity of their symptoms during the last week on a four-point scale, which ranged from 0 (did not apply to me at all) to 3 (applied to me very much or most of the time). The minimum and maximum total scores of the DASS-21 ranged between 0 and 63 (27, 33). In this instrumental design study, the short versions of the DASS-21 were nested within the parent scale, i.e., the data on the items of the short scales were obtained from the DASS-21 and analyzed as shown below. The DASS-8 is the shortest version of the DASS-21. It is composed of three subscales: depression (three items, e.g., felt that I had nothing to look forward), anxiety (three items, e.g., felt close to panic), and stress (two items, e.g., was using a lot of my mental energy) (36, 38). The minimum score of the DASS-8 and its subscales is 0, while the maximum scores are 24, 9, 9, and 6, respectively. The DASS-12 consists of three subscales; each subscale consists of four items. The minimum and maximum scores of the DASS-12 ranges from 0 to 36, while and the minimum and maximum scores of each of its three subscales range from 0 to 12 (35). For all the DASS measures, higher scores denote higher endorsement of mental distress symptoms. The reliability of the DASS-21, DASS-8, and DASS-12 in this sample is excellent (please see the Results section for the details).

Section three comprised the Italian version of the University of California, Los Angeles, Loneliness Scale-version 3 (UCLALS3) (42); three items of the UCLALS3 were used [lack of companionship, feel left out (exclusion), and feel isolated (isolation)], which represent three interrelated dimensions of isolation, relational connectedness, and trait loneliness. The frequency of endorsing items since the start of the COVID-19 outbreak is rated on a three-point Likert scale, which ranges from 1 (hardly never) to 3 (often). Thus, the minimum and maximum total scores of the current version of the UCLALS3 range between 3 and 9. Higher scores reflect higher loneliness (16, 42, 43). The reliability of the UCLALS3 in this study is very good (coefficient alpha = 0.87).

Statistical analysis

Shapiro–Wilk W test was used to examine the distribution of different versions of the DASS and the UCLALS3. Variables with a non-normal distribution were described by median (MD) and interquartile range (IQR; Q1–Q3). Variables with a normal distribution were described by mean and standard deviation. Categorical variables were described by frequencies and percentages.

Based on the findings of previous studies (3638), the factor structures of the DASS-8 and DASS-12 were examined using confirmatory factor analysis (CFA). In this study, four models were tested: a unidimensional structure, a three-factor structure, a second-order factor structure, and a bifactor structure. The criteria used to evaluate model fit were chi-square (χ2) index, comparative fit index (CFI), Tucker–Lewis Index (TLI), standardized root-mean-square residual (SRMR), and root-mean-square error of approximation (RMSEA). Ideally, χ2 should be non-significant. However, χ2 values can be greatly affected by sample size. Therefore, model fit can be parsimoniously considered good or acceptable based on the values of absolute fit measures: CFI and TLI equal to or above 0.95 and 0.90, along with SRMR and RMSEA < 0.06 and 0.08, respectively (44, 45). Based on suggestions pointed out by modification indices, few error terms were correlated to improve the model fit.

Measurement invariance of the DASS-8/DASS-12/DASS-21 was examined at the configural, metric, scalar, and strict levels (46, 47) across groups of gender, education (compulsory, high school, and university), employment (employed and non-employed), country of residence, type of dementia (Alzheimer's disease vs. all other types), level of dependency (autonomous vs. dependent), receiving help with caregiving (yes vs. no), and relationship with care recipients (spouses vs. adult children). Models with a significant χ2-value were considered non-invariant if ΔCFI and ΔRMSEA exceeded 0.02 and 0.015, respectively (15, 46).

To examine the known-group validity of the DASS-8/DASS-12/DASS-21, Mann–Whitney U-test was used to determine whether these measures and their subscales can differentiate respondents with higher distress across groups of gender, dementia type, level of dependency, and help with caregiving. To examine the discriminant validity of the DASS measures, we computed heterotrait-to-monotrait (HTMT) ratio of correlations of items comprising the DASS-8/DASS-12/DASS-21 (38, 48).

The internal consistency of the three scales and their subscales was evaluated by coefficient alpha, alpha if item deleted, and item–total correlations. The latter was also used as an indicator of convergent validity. Spearman's correlations of the DASS-8, DASS-12, and their subscales with the DASS-21 scale and its subscales were used to examine their convergent validity. The criterion validity of the DASS measures was tested by correlating their scores with the UCLALS3. Respondents with higher loneliness scores were expected to display higher levels of distress. The analyses were conducted in Amos version 24 and SPSS version 28. Significance was considered at a probability less than 0.05 in two-tailed tests.

Results

Characteristics of the participants

The sociodemographic characteristics of the participants (N = 571, mean age = 53 ± 12 years, range = 24–89 years, 74.4% Italian, and 25.6% Swiss) are described in detail elsewhere (16). In brief, most of the participants were females (81.6%) and adult children of patients with dementia (71.8%). They mostly had high school education (56.4%), were employed (49.6%), provided dementia care for an average of 6.1 (SD = 4.0) years, and received help with care from other family members, friends, or health professionals (58.7%). Alzheimer's disease was the most prevalent type of dementia (55.3%), and 79.7% of patients with dementia were dependent in activities of ADL.

Results of confirmatory factor analysis and invariance analysis

Table 1 shows poor fit of the one-factor structure of the three DASS measures. The three-factor structure of the DASS-8 and the DASS-21 had good and acceptable fit, respectively. Meanwhile, RMSEA indicated misfit of the three-factor structure of the DASS-12, even when the error terms of three items were correlated. Notably, the bifactor structures of the three scales expressed the best fit among all models. In that model, all the items of the DASS-8 loaded significantly on their domain-specific factors, albeit the loadings of items 12 and 13 on the corresponding factors were below 0.3. Simultaneously, item 13 had loadings below 0.1, while items 11 and 12 failed to load on their corresponding factors in models representing the DASS-12 and the DASS-21, respectively (Supplementary materials). Given the good fit of the three-factor structure, with considerably satisfactory item loadings (Figure 1), this model was used for testing measurement invariance of the DASS scales.

TABLE 1
www.frontiersin.org

Table 1. Goodness of fit of the confirmatory factor analysis models representing the Depression Anxiety Stress Scale-8 (DASS-8), DASS-12, and DASS-21 among dementia family caregivers.

FIGURE 1
www.frontiersin.org

Figure 1. Factor structure of the Depression Anxiety Stress Scale (DASS)-21 (C) and its short versions: the DASS-8 (A) and the DASS-12 (B) among dementia family caregivers.

As indicated in Table 2, the three-factor structures of the DASS-8, DASS-12, and DASS-21 were invariant at the configural, metric, scalar, and strict levels across all groups. Nevertheless, the DASS-8 was non-invariant at the scalar level across country groups (ΔCFI > 0.02 and ΔRMSEA >0.15). The DASS-12 also tended to be non-invariant at the scalar level (ΔCFI > 0.02).

TABLE 2
www.frontiersin.org

Table 2. Invariance of the three-factor structures of the Depression Anxiety Stress Scale 8 (DASS-8), DASS-12, and DASS-21 across different characteristics of dementia family caregivers.

Results of known-group validity and discriminant validity tests

Table 3 indicates significantly higher scores of all the DASS scales and their subscales among female respondents and those caring for dependent patients as hypothesized. Contrary to expectations, distress levels did not significantly vary according to the type of dementia. Also, respondents receiving help demonstrated higher scores of the DASS-8/DASS-12/DASS-21 than those who did not receive help (all p-values < 0.001). Adult children caregivers expressed significantly higher levels of distress than spouse caregivers.

TABLE 3
www.frontiersin.org

Table 3. Known-group validity of the Depression Anxiety Stress Scales (DASS-8, DASS-12, and DASS-21) among dementia family caregivers.

Based on the lenient limit of the HTMT ratio of correlations (< 0.90), the depression and anxiety subscales of the DASS-8 and the DASS-21 were distinct from each other (HTMT ratio = 0.89 and 0.90, respectively). Meanwhile, the depression and anxiety subscales of both measures expressed an overlap with the stress subscale. As for the DASS-12, all its subscales had perfect correlations with one another (Supplementary materials), except for the anxiety and stress subscales, which were marginally distinct from each other (HTMT ratio = 0.88).

Results of tests of reliability, convergent validity, and criterion validity

Table 4 shows adequate reliability of the DASS-8/DASS-12/DASS-21 (coefficient alpha = 0.93, 0.95, and 0.97, respectively) and their subscales (coefficient alpha ranging from 0.77 to 0.95). For the three scales, item–total correlations were considerably high, with no increase in reliability up on item deletion from any measure. The shortened versions and their subscales strongly correlated with the parent scale/subscales, suggesting adequate convergent validity. As expected, all the DASS measures had strong positive correlations with the UCLALS3, which supports their criterion validity.

TABLE 4
www.frontiersin.org

Table 4. Internal consistency, convergent validity, and criterion validity of the Depression Anxiety Stress Scale (DASS) 21, DASS-12, DASS-8, and their subscales among dementia family caregivers.

Discussion

This study examined the psychometric properties of three DASS measures among dementia family caregivers, with the aim of providing a credible short version that may be promptly used for detecting mental distress in this vulnerable population. Compared with the DASS-12 and the DASS-21, the three-factor structure of the DASS-8 had the best fit. It also expressed adequate measurement equivalence, reliability, convergent validity, discriminant validity, and criterion validity relative to the longer versions.

As shown in Table 2, all the DASS measures were invariant at all levels across a wide range of participant characteristics (gender, education, employment, relationship with care recipient, type of dementia, level of dependency, and receiving help with care giving). The shortened versions of the DASS were or tended to be non-invariant at the scalar level across the country of residence. Non-invariance of these measures has been previously reported across English-speaking and Ghanian individuals. Nonetheless, they were invariant across English-speaking respondents from Australia and the United States (38). Likewise, the DASS-21 was non-invariant across countries with different languages, locations, economy, and cultural backgrounds (e.g., Poland and Russia vs. the United States and the United Kingdom as well as Germany vs. Pakistan) (28, 29). In the current study however, the respondents were recruited from a limited border area where people from both countries could fluently speak Italian. Thus, it is not expected that participants in this sample present major cultural variations. Therefore, non-invariance of the shortened version across country in the present study may be partially attributed to the considerably small number of participants in the Swiss group relative to the Italian group. Variations in group and sample sizes are reported to wrongly affect scale score equivalence. Many typical fit criteria may not be suitable in such contexts (49, 50). Moreover, the number of items, degree of factor over determination, and the level of indicator communalities can considerably affect measure fit and scale invariance (49). In this respect, models with small degrees of freedom (df) tend to express inflated RMSEA (51, 52). This was notable in the model examining the DASS-8 compared with that of the DASS-12, which also exhibited inflation in ΔCFI—a more reliable measure of misfit in small scales than RMSEA (51, 52). Accordingly, future studies investigating the invariance of these shortened versions need to take the influence of sample size on scale equivalence into consideration.

As for the tests of known-group validity, the DASS measures significantly identified distressed groups (Table 3). As expected, female carers and those caring for ADL-dependent patients had higher distress levels than male carers and those caring for autonomous patients, with no difference between Alzheimer's disease and other types of dementia. More than half the respondents (58.7%) stated that they received help with caring for patients with dementia. In contradiction to our hypothesis, those receiving help expressed greater levels of distress than those who did not receive help. Dementia caregiving is primarily provided by families (in up to 65% of cases) (18), and the worst levels of caregiver distress are largely reported among those caring for severe cases than those caring for mild cases (18, 19). For those who reported receiving help, 55.3% of their patients had Alzheimer's disease, and 79.7% of patients were not able to perform ADL. Therefore, ADL dependency, which may be associated with dementia severity, is the possible cause of distress in this group. In addition, caregiving is also reported to negatively influence the health of caregivers (14). Accordingly, those who perceive their health as deteriorating as a result of extensive caregiving are more likely to ask for help. For 54.9, 38.8, and 6.3% of the respondents who indicated that their patients received supplementary care, care was provided by another relative, nurse, or friend, respectively. Caregiver distress during the COVID-19 pandemic is associated with fear of the absence of paid caregivers as well as fear that contact with people who assist with instrumental activities may transmit this virulent infection to their patients (18). In addition, caregiving interferes with adult children's work schedule, while hiring health professionals to care for this chronic condition may represent a persistent financial burden (14).

Based on an existing review, we hypothesized that spouse caregivers would express higher levels of distress than adult children caregivers (8). Paradoxically, the latter demonstrated more distress than spouse caregivers. This finding can be related to the fact that the pandemic has created a lot of challenges for younger groups such as increased time spent caring for their children due to school closure, loss of jobs/income, and social isolation imposed by the lockdown. Meanwhile, spouses are older and more likely to be retired, with a greater possibility of being more home-bound than the youth. Moreover, age is reported as a protective factor against distress and trauma during the pandemic (15).

Discriminant validity tests show that the depression and anxiety subscales of the DASS-8 and the DASS-21 were distinct from each other. Thus, the DASS-8/DASS-21 may be used to distinguish the symptoms of depression from those of anxiety, albeit the stress subscale was overlapping with both subscales in both measures. A total of two previous studies revealed that most subscales of the DASS-8 were distinct from each other—the stress and anxiety subscales were overlapping with one another (37, 38). However, that was not true for the DASS-12, which could only discriminate anxiety symptoms from stress symptoms in the current study. All the DASS measures positively correlated with the UCLALS3 at the same level of significance, indicating usefulness of the DASS-8, DASS-12, and DASS-21 as criterion variables. All these measures also demonstrated comparably adequate internal consistency and convergent validity, as noted by high values of item–total correlations and correlations of the shortened versions with the parent scale/subscales.

This study expands the literature by using various techniques to examine three DASS measures in a particularly distressed group (dementia family caregivers) from two European countries during the COVID-19 outbreak. Given that the psychometrics of the DASS-8 were adequately similar to those of longer DASS scales, it may be easier to frequently screen for possible psychopathology among dementia caregivers using this brief version. Scale brevity is a key advantage, especially for a scale that inherits the validity of the parent scale since response rates decrease with the administration of long scales (51, 52). The study also enjoys the merit of repurposing already available public data to generate new knowledge without consuming extensive economic and intellectual resources. Despite these advantages, a number of limitations should be noted. The recruitment and data collection methods entail a risk for selection bias where only those using social media and a smart phone could participate in the present study. Another possibility of selection bias stems from the fact that most of the participants of the study are women. Women may vary in the extent of their emotional experience and expression of distress from men (53)—in fact, greater levels of distress among women were detected in our analysis. Nonetheless, the DASS measures were invariant across genders, indicating that they are less likely to be biased by women's tendency to express more negative emotions than men. Additionally, the UCLALS3 expressed adequate internal consistency, denoting that it enjoys the basic psychometric properties of a scale. Nevertheless, statistics on the different types of validity of this three-item scale as an adequate measure of loneliness are lacking, putting our test of criterion validity at jeopardy. The results may not be generalized because of the cross-sectional design, the convenience sample, and the limited time and location of data collection (during an early stage of a prolonged pandemic and from a border region between Italy and Switzerland). Examining the invariance of the DASS measures across those two border regions may not be sufficient to reflect invariance across countries. Although the sample size meets the requirements for CFA analysis based on 21 items of the DASS-21 (20 responses per one item), multigroup comparisons across countries may not be that robust because of the vivid variation in the number of respondents in the country groups. Using an adequate number of groups and participants in groups is necessary for future investigations to properly examine the measurement invariance of the DASS-8/DASS-12 across more European and non-European countries. Multiple participation may represent a threat to data integrity since the survey was conducted online, and there is no information available on the control of the number of participations per person. Moreover, the respondents were included based on self-reporting their state as family caregivers of people with dementia. Not using credible references (e.g., the medical record for the care-recipients) to confirm that the respondents were really caregivers may entail a risk for selection bias.

Conclusion

The DASS-8 displayed a better factor structure than longer versions, and all its other psychometrics (measurement invariance, reliability, convergent validity, criterion validity, and known-group and discriminant validity) were adequate, compared with longer versions. Because the course of dementia is chronic and progressive, considerable attention should be paid to the identification of high levels of distress among caregivers, especially female carers, adult children of patients with dementia, those with highly dependent patients, and those who ask for supplementary care. The DASS-8 can be a useful brief measure for achieving this aim.

Data availability statement

Publicly available datasets were analyzed in this study. The dataset supporting the conclusions of this article is available in Zenodo repository at https://zenodo.org/record/4748652#.YdbwiWhBw2w.

Ethics statement

Ethical review and approval was not required for the study on human participants in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.

Author contributions

All authors listed have made a substantial, direct, and intellectual contribution to the work and approved it for publication.

Acknowledgments

The researchers would like to thank the Deanship of Scientific Research, Qassim University, for funding the publication of this project.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpubh.2022.1012311/full#supplementary-material

References

1. Dumurgier J, Sabia S. Life expectancy in dementia subtypes: exploring a leading cause of mortality. Lancet Healthy Longev. (2021) 2:e449–50. doi: 10.1016/S2666-7568(21)00166-5

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Alzheimer's Association. 2018 Alzheimer's disease facts and figures. Alzheimer's Dement. (2018) 14:367–429. doi: 10.1016/j.jalz.2018.02.001

CrossRef Full Text | Google Scholar

3. Tobore TO. On the etiopathogenesis and pathophysiology of Alzheimer's disease: a comprehensive theoretical review. J Alzheimers Dis. (2019) 68:417–37. doi: 10.3233/JAD-181052

PubMed Abstract | CrossRef Full Text | Google Scholar

4. GBD Neurological Disorders Collaborator Group. Global, regional, and national burden of neurological disorders during 1990-2015: a systematic analysis for the Global Burden of Disease Study 2015. Lancet Neurol. (2017) 16:877–97. doi: 10.1016/S1474-4422(17)30299-5

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Yang P, Sun F. Aducanumab: the first targeted Alzheimer's therapy. Drug Discov Ther. (2021) 15:166–8. doi: 10.5582/ddt.2021.01061

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Hawkes CA, Jayakody N, Johnston DA, Bechmann I, Carare RO. Failure of perivascular drainage of beta-amyloid in cerebral amyloid angiopathy. Brain Pathol. (2014) 24:396–403. doi: 10.1111/bpa.12159

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Anand A, Patience AA, Sharma N, Khurana N. The present and future of pharmacotherapy of Alzheimer's disease: a comprehensive review. Eur J Pharmacol. (2017) 815:364–75. doi: 10.1016/j.ejphar.2017.09.043

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Isik AT, Soysal P, Solmi M, Veronese N. Bidirectional relationship between caregiver burden and neuropsychiatric symptoms in patients with Alzheimer's disease: a narrative review. Int J Geriatr Psychiatry. (2019) 34:1326–34. doi: 10.1002/gps.4965

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Lee M, Ryoo JH, Campbell C, Hollen PJ, Williams IC. Exploring the challenges of medical/nursing tasks in home care experienced by caregivers of older adults with dementia: an integrative review. J Clin Nurs. (2019) 28:4177–89. doi: 10.1111/jocn.15007

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Stall NM, Kim SJ, Hardacre KA, Shah PS, Straus SE, Bronskill SE, et al. Association of informal caregiver distress with health outcomes of community-dwelling dementia care recipients: a systematic review. J Am Geriatr Soc. (2019) 67:609–17. doi: 10.1111/jgs.15690

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Ali AM, Kunugi H. Royal jelly as an intelligent anti-aging—a focus on cognitive aging and Alzheimer's disease: a review. Antioxidants. (2020) 9:E937. doi: 10.3390/antiox9100937

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Ali AM, Kunugi H. Apitherapy for age-related skeletal muscle dysfunction (sarcopenia): a review on the effects of royal jelly, propolis, and bee pollen. Foods. (2020) 9:E1362. doi: 10.3390/foods9101362

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Khatatbeh H, Al-Dwaikat T, Alfatafta H, Ali AM, Pakai A. Burnout, quality of life and perceived patient adverse events among paediatric nurses during the COVID-19 pandemic. J Clin Nurs. (2022) 2022:e16540. doi: 10.1111/jocn.16540

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Wawrziczny E, Duprez C, Antoine P. Predictors of caregiver distress among spouses, adult children living with the person with dementia, and adult children not living with the person with dementia. Psychogeriatrics. (2020) 20:594–601. doi: 10.1111/psyg.12553

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Ali AM, Alkhamees AA, Elhay ESA, Taha SM, Hendawy AO. COVID-19-related psychological trauma and psychological distress among community-dwelling psychiatric patients: people struck by depression and sleep disorders endure the greatest burden. Front Public Health. (2022) 2022:e799812. doi: 10.3389/fpubh.2021.799812

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Messina A, Lattanzi M, Albanese E, Fiordelli M. Caregivers of people with dementia and mental health during COVID-19: findings from a cross-sectional study. BMC Geriatr. (2022) 2022:966605. doi: 10.21203/rs.3.rs-966605/v1

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Carcavilla N, Pozo AS, González B, Moral-Cuesta D, Roldán JJ, Erice V, et al. Needs of dementia family caregivers in Spain during the COVID-19 pandemic. J Alzheimers Dis. (2021) 80:533–7. doi: 10.3233/JAD-201430

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Cohen G, Russo MJ, Campos JA, Allegri RF. Living with dementia: increased level of caregiver stress in times of COVID-19. Int Psychogeriatr. (2020) 32:1377–81. doi: 10.1017/S1041610220001593

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Borelli WV, Augustin MC, de Oliveira PBF, Reggiani LC, Bandeira-de-Mello RG, Schumacher-Schuh AF, et al. Neuropsychiatric symptoms in patients with dementia associated with increased psychological distress in caregivers during the COVID-19 pandemic. J Alzheimers Dis. (2021) 80:1705–12. doi: 10.3233/JAD-201513

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Cohen SA, Kunicki ZJ, Drohan MM, Greaney ML. Exploring changes in caregiver burden and caregiving intensity due to COVID-19. Gerontol Geriatr Med. (2021) 7:2333721421999279. doi: 10.1177/2333721421999279

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Clark LA, Watson D. Tripartite model of anxiety and depression: psychometric evidence and taxonomic implications. J Abnorm Psychol. (1991) 100:316–36. doi: 10.1037/0021-843X.100.3.316

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Lovibond PF, Lovibond SH. Manual for the Depression Anxiety Stress Scales. 2nd ed. Sydney, NSW: Psychology Foundation (1995). doi: 10.1037/t01004-000

CrossRef Full Text | Google Scholar

23. Osman A, Wong JL, Bagge CL, Freedenthal S, Gutierrez PM, Lozano G. The Depression Anxiety Stress Scales-21 (DASS-21): further examination of dimensions, scale reliability, and correlates. J Clin Psychol. (2012) 68:1322–38. doi: 10.1002/jclp.21908

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Vaughan RS, Edwards EJ, MacIntyre TE. Mental health measurement in a post Covid-19 world: psychometric properties and invariance of the DASS-21 in athletes and non-athletes. Front Psychol. (2020) 11:590559. doi: 10.3389/fpsyg.2020.590559

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Henry JD, Crawford JR. The short-form version of the Depression Anxiety Stress Scales (DASS-21): construct validity and normative data in a large non-clinical sample. Br J Clin Psychol. (2005) 44:227–39. doi: 10.1348/014466505X29657

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Yildirim A, Boysan M, Kefeli MC. Psychometric properties of the Turkish version of the Depression Anxiety Stress Scale-21 (DASS-21). Br J Guid Counsel. (2018) 2018:1–14. doi: 10.1080/03069885.2018.1442558

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Ali AM, Ahmed A, Sharaf A, Kawakami N, Abdeldayem SM, Green J. The Arabic version of the depression anxiety stress scale-21: cumulative scaling and discriminant-validation testing. Asian J Psychiatr. (2017) 30:56–8. doi: 10.1016/j.ajp.2017.07.018

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Bibi A, Lin M, Zhang XC, Margraf J. Psychometric properties and measurement invariance of Depression, Anxiety and Stress Scales (DASS-21) across cultures. Int J Psychol. (2020) 2020:12671. doi: 10.1002/ijop.12671

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Scholten S, Velten J, Bieda A, Zhang XC, Margraf J. Testing measurement invariance of the Depression, Anxiety, and Stress Scales (DASS-21) across four countries. Psychol Assess. (2017) 29:1376–90. doi: 10.1037/pas0000440

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Zanon C, Brenner RE, Baptista MN, Vogel DL, Rubin M, Al-Darmaki FR, et al. Examining the dimensionality, reliability, and invariance of the depression, anxiety, and stress scale-21 (DASS-21) Across Eight Countries. Assessment. (2020) 2020:1073191119887449. doi: 10.1177/1073191119887449

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Page AC, Hooke GR, Morrison DL. Psychometric properties of the Depression Anxiety Stress Scales (DASS) in depressed clinical samples. Br J Clin Psychol. (2007) 46:283–97. doi: 10.1348/014466506X158996

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Oei TPS, Sawang S, Goh YW, Mukhtar F. Using the Depression Anxiety Stress Scale 21 (DASS-21) across cultures. Int J Psychol. (2013) 2013:755535. doi: 10.1080/00207594.2012.755535

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Ali AM, Green J. Factor structure of the depression anxiety stress Scale-21 (DASS-21): unidimensionality of the Arabic version among Egyptian drug users. Subst Abuse Treat Prev Policy. (2019) 14:40. doi: 10.1186/s13011-019-0226-1

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Wise FM, Harris DW, Olver JH. The DASS-14: improving the construct validity and reliability of the depression, anxiety, and stress scale in a cohort of health professionals. J Allied Health. (2017) 46:e85–90. Available online at: https://pubmed.ncbi.nlm.nih.gov/29202170/

PubMed Abstract | Google Scholar

35. Lee EH, Moon SH, Cho MS, Park ES, Kim SY, Han JS, et al. The 21-item and 12-item versions of the depression anxiety stress scales: psychometric evaluation in a Korean Population. Asian Nurs Res. (2019) 13:30–7. doi: 10.1016/j.anr.2018.11.006

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Ali AM, Alkhamees AA, Hori H, Kim Y, Kunugi H. The Depression Anxiety Stress Scale 21: development and validation of the depression anxiety stress scale 8-item in psychiatric patients and the general public for easier mental health measurement in a post-COVID-19 world. Int J Environ Res Public Health. (2021) 18:10142. doi: 10.3390/ijerph181910142

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Ali AM, Hendawy AO, Al-Amer R, Shahrour G, Ali EM, Alkhamees AA, et al. Psychometric evaluation of the Depression Anxiety Stress Scale 8 among women with chronic non-cancer pelvic pain. Sci Rep. (2022) 2022:1212124. doi: 10.21203/rs.3.rs-1212124/v1

CrossRef Full Text | Google Scholar

38. Ali AM, Hori H, Kim Y, Kunugi H. The Depression Anxiety Stress Scale 8-items expresses robust psychometric properties as an ideal shorter version of the Depression Anxiety Stress Scale 21 among healthy respondents from three continents. Front Psychol. (2022) 13:799769. doi: 10.3389/fpsyg.2022.799769

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Office Office of the Surgeon General (US) Center for Mental Health Services (US) National National Institute of Mental Health (US). Mental Health: Culture, Race and Ethnicity: A Supplement to Mental Health: A Report of the Surgeon General. Rockville (MD): Substance Abuse and Mental Health Services Administration (US). Chapter 2 Culture Counts: The Influence of Culture and Society on Mental Health. (2001).

Google Scholar

40. Messina A. Caregivers of People With Dementia and Mental Health During COVID-19: Findings From a Cross-Sectional Study. Version 1. Zenodo (2021). doi: 10.5281/zenodo.4748651

CrossRef Full Text | Google Scholar

41. Bottesi G, Ghisi M, Altoè G, Conforti E, Melli G, Sica C. The Italian version of the Depression Anxiety Stress Scales-21: factor structure and psychometric properties on community and clinical samples. Compr Psychiatry. (2015) 60:170–81. doi: 10.1016/j.comppsych.2015.04.005

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Boffo M, Mannarini S, Munari C. Exploratory structure equation modeling of the UCLA loneliness scale: a contribution to the Italian adaptation. TPM. (2012) 19:345–63. doi: 10.4473/TPM19.4.7

CrossRef Full Text | Google Scholar

43. Hughes ME, Waite LJ, Hawkley LC, Cacioppo JT. A short scale for measuring loneliness in large surveys: results from two population-based studies. Res Aging. (2004) 26:655–72. doi: 10.1177/0164027504268574

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Ali AM, Ahmed AH, Smail L. Psychological climacteric symptoms and attitudes toward Menopause among Emirati Women. Int J Environ Res Public Health. (2020) 17:5028. doi: 10.3390/ijerph17145028

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Ali AM, Hori H, Kim Y, Kunugi H. Predictors of nutritional status, depression, internet addiction, Facebook addiction, and tobacco smoking among women with eating disorders in Spain. Front Psychiatry. (2021) 12:2001. doi: 10.3389/fpsyt.2021.735109

PubMed Abstract | CrossRef Full Text | Google Scholar

46. Ali AM, Hendawy AO, Almarwani AM, Alzahrani N, Ibrahim N, Alkhamees AA, et al. The Six-item Version of the Internet Addiction Test: Its development, psychometric properties, and measurement invariance among women with eating disorders and healthy school and university students. Int J Environ Res Public Health. (2021) 18:12341. doi: 10.3390/ijerph182312341

PubMed Abstract | CrossRef Full Text | Google Scholar

47. Ali AM, Hendawy AO, Elhay ESA, Ali EM, Alkhamees AA, Kunugi H, et al. The Bergen Facebook Addiction Scale: its psychometric properties and invariance among women with eating disorders. BMC Women's Health. (2022) 22:99. doi: 10.1186/s12905-022-01677-2

PubMed Abstract | CrossRef Full Text | Google Scholar

48. Henseler J, Ringle CM, Sarstedt M. A new criterion for assessing discriminant validity in variance-based structural equation modeling. J Acad Market Sci. (2015) 43:115–35. doi: 10.1007/s11747-014-0403-8

CrossRef Full Text | Google Scholar

49. Meade AW, Bauer DJ. Power and precision in confirmatory factor analytic tests of measurement invariance. Struct Eq Model. (2007) 14:611–35. doi: 10.1080/10705510701575461

CrossRef Full Text | Google Scholar

50. Rutkowski L, Svetina D. Assessing the hypothesis of measurement invariance in the context of large-scale international surveys. Educ Psychol Meas. (2014) 74:31–57. doi: 10.1177/0013164413498257

CrossRef Full Text | Google Scholar

51. Kenny DA, Kaniskan B, McCoach DB. The performance of RMSEA in models with small degrees of freedom. Sociol Methods Res. (2015) 44:486–507. doi: 10.1177/0049124114543236

PubMed Abstract | CrossRef Full Text | Google Scholar

52. Shi D, DiStefano C, Maydeu-Olivares A, Lee T. Evaluating SEM model fit with small degrees of freedom. Multivariate Behav Res. (2021) 2021:1–36. doi: 10.1080/00273171.2020.1868965

PubMed Abstract | CrossRef Full Text | Google Scholar

53. Ali AM, Al-Amer R, Kunugi H, Stănculescu E, Taha SM, Saleh MY, et al. The Arabic version of the Impact of Event Scale – Revised: psychometric evaluation in psychiatric patients and the general public within the context of COVID-19 outbreak and quaran-tine as collective traumatic events. J Personal Med. (2022) 12:681. doi: 10.3390/jpm12050681

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: psychological distress/anxiety/depression, dementia/cognitive impairment/Alzheimer's disease/Parkinson's disease, short form of the Depression Anxiety Stress Scale 21/Depression Anxiety Stress Scale 8-items, factor structure/psychometric properties/structural validity/criterion validity/known-group validity/validation/measurement invariance/discriminant validity, old age/elders/elderly, loneliness, informal/family caregivers, spouse/adult children

Citation: Ali AM, Alameri RA, Hendawy AO, Al-Amer R, Shahrour G, Ali EM, Alkhamees AA, Ibrahim N and Hassan BH (2022) Psychometric evaluation of the depression anxiety stress scale 8-items (DASS-8)/DASS-12/DASS-21 among family caregivers of patients with dementia. Front. Public Health 10:1012311. doi: 10.3389/fpubh.2022.1012311

Received: 05 August 2022; Accepted: 26 September 2022;
Published: 25 October 2022.

Edited by:

Yuan Yuan Wang, De Montfort University, United Kingdom

Reviewed by:

Raphael Machado Castilhos, Clinical Hospital of Porto Alegre, Brazil
Mijung Lee, Korea Armed Forces Nursing Academy, South Korea

Copyright © 2022 Ali, Alameri, Hendawy, Al-Amer, Shahrour, Ali, Alkhamees, Ibrahim and Hassan. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Abdulmajeed A. Alkhamees, a.alkhamees@qu.edu.sa

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.