Euntaek Hong
Joohee Lee
Seowon Yoon
Surin Cho
Yong-Chun Bahk
Jeongwon Choi
Kee-Hong Choi- 1School of Psychology, Korea University, Seoul, Republic of Korea
- 2Department of Psychology, Michigan State University, East Lansing, MI, United States
- 3Samsung Medical Center, Seoul, Republic of Korea
- 4Korea University Mental Health Institute, Sejong, Republic of Korea
- 5National Youth Policy Institute, Sejong, Republic of Korea
Background: Depression, anxiety, and suicidal ideation are significant mental health problems among adolescents, especially in South Korea, which has one of the highest adolescent suicide rates globally. However, few standardized and validated mental health screening tools exist for this population. This study aimed to examine the psychometric properties and establish normative data for the Mental Health Screening Tool for Depressive Disorder (MHS: D), Generalized Anxiety Disorder (MHS: A), and Suicide Risk (MHS: S) in South Korean adolescents.
Methods: An online survey involving 6,689 students and out-of-school youths (aged 10–18 years) was conducted between July and August 2021. Psychometric properties—including reliability, validity, and measurement invariance—were assessed by comparing adolescent and adult samples and demographic subgroups within the adolescent sample.
Results: All three screening tools demonstrated excellent internal consistency (Cronbach’s α: MHS: D = 0.92, MHS: A = 0.93, and MHS: S = 0.86) and adequate unidimensional factor structure in the adolescent sample. A multi-group confirmatory factor analysis showed that the unidimensional factor structure of each instrument was maintained between the adolescent and adult samples, and that measurement invariance was maintained across adolescent sex and age subgroups. Reference norms indicated higher symptom prevalence among girls compared to boys, with symptom severity increasing with age. Significant correlations with mental health indicators (i.e., somatization, self-harm, perceived stress, and peritraumatic COVID-19 stress) supported the high construct validity of the instruments and highlighted the detrimental impact of mental health concerns on overall well-being.
Conclusion: The MHS: D, MHS: A, and MHS: S demonstrated excellent psychometric properties across sex and age subgroups in a representative adolescent sample. Using these validated tools in clinical and community settings can aid in monitoring adolescent mental health and preventing suicide risk.
1 Introduction
1.1 Background
Approximately 10–20% of adolescents worldwide experience psychological problems (Barican et al., 2022; Kieling et al., 2011). A significant proportion of mental health issues first appear during adolescence (Merikangas et al., 2010). Conditions such as depression and anxiety during this critical period can lead to functional impairment (Dunn and Goodyer, 2006) and chronic mental illness (Kessler and Wang, 2008), resulting in increased suicide risk (Balazs et al., 2013). South Korea’s highly competitive educational environment contributes to a high prevalence of depression and anxiety among the youth, leading to increased suicide risk and the world’s highest youth suicide rate for over 20 years (Jung and Cho, 2020; Kim, 2018). South Korea’s youth suicide rate reached a record high of 11.7 deaths per 100,000 in 2021 (Ministry of Gender Equality and Family, 2023). Immediate preventive measures and interventions are critical to reducing the adolescent suicide rate in South Korea, highlighting the importance of accessible and effective screening for youth depression, anxiety, and suicide at an early stage. To accurately detect mental health concerns among adolescents, screening instruments must be validated to ensure they are suitable for assessing psychological problems in this demographic (Mangione et al., 2022).
For accurate mental health screening of South Korean adolescents, screening instruments must demonstrate strong psychometric properties—such as internal consistency and validity—and consistently assess adolescents’ mental health across different sex and age groups. Mental health fluctuates by age and sex during adolescence, with the prevalence rates of depression, anxiety, and suicide risk being lower in early adolescence and tending to increase during mid-adolescence (Copeland et al., 2014; Costello et al., 2003; Nock et al., 2013) and being higher in female adolescents compared to their male counterparts (Lu, 2019; Merikangas et al., 2010; Nock et al., 2013; Rice et al., 2019). It is also important to keep in mind that adolescent developmental differences in the phenomenology of depression and anxiety (Weiss and Garber, 2003; Zahn–Waxler et al., 2000), as well as the prevalence, could have significant impact on mental health screening.
Therefore, widely used MHS instruments such as the Patient Health Questionnaire-9 (PHQ-9) (Kroenke et al., 2001), 7-item Generalized Anxiety Disorder Scale (GAD-7) (Spitzer et al., 2006), and Suicidal Behaviors Questionnaire (SBQ) (Osman et al., 2001) have been validated for use with the adolescent population, including measurement invariance analysis (Adjorlolo et al., 2022; Kliem et al., 2024; Löwe et al., 2008a; Richardson et al., 2010; Romano et al., 2022; Tiirikainen et al., 2019). However, measurement consistency of these tools across demographic subgroups has not yet been established for South Korean adolescents. Also, to our knowledge, there are no studies of depression, anxiety, and suicide risk screening scales for adolescents that include normative data, although some exist for South Korean adults (Kang et al., 2021; Shin et al., 2020). Since scores of mental health screeners typically do not follow a normal distribution, only presenting T- or Z-scores without normative percentiles is insufficient (Crawford et al., 2009). Before using screening tools for adolescents, their psychometric properties and measurement consistency must be evaluated, and normative reference data with percentile ranks should be established in a representative sample.
1.2 MHS tool for South Korean adolescents
In South Korea, mental health screening tools (MHS) were developed to facilitate the early detection and prevention of mental health disorders, targeting depressive disorder (MHS: D) (Park et al., 2022), generalized anxiety disorder (MHS: A) (Kim et al., 2021), and suicide risk (MHS: S) (Yoon et al., 2020). These tools were systematically created over a 3-year research period through literature reviews, expert consultations, and preliminary studies with both clinical and non-clinical participants to ensure item validity and refinement. Each tool underwent evaluation for convergent and discriminant validity through comparisons with existing psychological measures. The MHS: D was evaluated against the BDI-II (Beck et al., 1996; Park et al., 2020), PHQ-9 (Cho and Kim, 1998; Kroenke et al., 2001), and CES-D (Cho and Kim, 1998; Radloff, 1977); the MHS: A was assessed through comparisons with the GAD-7 (Ahn et al., 2019; Spitzer et al., 2006), BAI (Beck et al., 1988; Oh et al., 2018), and PSWQ (Lim et al., 2008; Meyer et al., 1990). The MHS: S established optimal items and cutoff points based on suicide risk criteria. The Mini-International Neuropsychiatric Interview (Sheehan et al., 1998; Yoo et al., 2006) served as the diagnostic reference standard, with blinded procedures implemented to minimize bias and ensure reliability.
Each tool demonstrated higher diagnostic sensitivity and specificity than existing measures (Kim et al., 2021; Park et al., 2022; Yoon et al., 2020). The MHS: D effectively identified depressive disorders, while the MHS: A proved capable of detecting generalized anxiety disorder at an early stage. The MHS: S exhibited strong accuracy in assessing suicide risk across different severity levels. They all demonstrated appropriate psychometric properties, including internal consistency and convergent validity, and can be effectively applied in clinical settings. Additionally, their concise and efficient format makes them highly adaptable for use in online mental health services and applications.
While MHS tools can adequately measure depressive and anxiety symptoms and suicide risk in South Korean adult samples, the psychometric properties and normative data of these tools have not yet been validated among adolescents. Further research is, therefore, needed to establish the validity, reliability, measurement invariance, and normative data of MHS tools in Korean youth sample, considering adolescents’ developmental characteristics.
1.3 Study aims
This study examined the psychometric properties of the MHS: D, MHS: A, and MHS: S and provided the normative data of these tools in a nationally representative sample of South Korean adolescents aged 10–18 years. We first examined the internal consistency, factor structure, and validity of each tool within an adolescent cohort. Subsequently, multi-group confirmatory factor analysis (MGCFA) was performed to verify the measurement consistency between adult and adolescent samples and between different sex and age (school grade) subgroups within the adolescent cohort. We examined various aspects of the mental health status of South Korean adolescents to investigate the construct validity of MHS tools and the impact of common mental health concerns on other clinical symptoms.
The specific aims of this study were to
1. Examine the internal consistency, item response characteristics, and factor structure of each screening tool within the adolescent population.
2. Conduct MGCFA to ascertain the measurement invariance of each tool between the adolescent and adult samples, and between age (school grade) and sex subgroups within the adolescent population.
3. Generate normative data according to sex and different age categories.
4. Examine correlations between screening tools and other mental health aspects.
2 Materials and methods
2.1 Participants
This study used data from the “National Survey on the Mental Health Status of Teenagers,” conducted by the National Youth Policy Institute in 2021. This survey assessed the prevalence of mental health problems among out-of-school adolescents (those who had dropped out of, or never enrolled in school), their exposure to mental health protective and risk factors during the COVID-19 pandemic, and their awareness and use of community mental health services. Participants were selected using stratified cluster sampling, resulting in a nationwide sample of 5,937 students from 4th grade in elementary school to 3rd grade in high school. Additionally, 752 out-of-school adolescents aged 10–18 years were randomly sampled from 220 regional dream centers across the country. Data were collected from July to August 2021, during the social distancing period in South Korea, through a self-administered online survey.
To verify the measurement invariance of the MHS tools between the adolescent and adult groups, data from the online versions of the MHS: D, MHS: A, and MHS: S that were collected in an adult group validation study were employed (Kim et al., 2021; Park et al., 2022; Yoon et al., 2020). This dataset included 527 adults, with 270 participants consecutively sampled from those visiting university hospitals and the remainder recruited via online advertisements. The mean age of the adult participants was 38.6 years, with 340 female participants (64.5%).
2.2 Instruments
General demographic characteristics (e.g., sex, age, school, cigarette and alcohol use, sleep quality) and clinical scales pertaining to MHS tools were selected from the “Survey on the Mental Health Status of Teenagers” (Choi et al., 2021), as detailed below. To measure the correlation between MHS tools and negative mental health outcomes, this study employed self-report scales for somatization, self-harm behavior, perceived stress, and COVID-19 peritraumatic distress.
2.2.1 MHS tool for depression
The MHS: D is a self-report measure for the screening and intervention for major depressive disorder in mental health service settings (Park et al., 2022). It comprises 12 items enquiring about symptoms of major depressive disorder over the preceding 2 weeks, with responses scored on a five-point Likert scale from 0 (not at all) to 4 (extremely). The overall score reflects symptom severity. Higher scores for items 10 and 11, which measure significant changes in appetite, contribute to the total score. The MHS: D demonstrated excellent validity and reliability in a validation study using a South Korean adult sample, including a clinical population. A total score of 8–11 indicates mild symptoms, 12–19 indicates moderate symptoms, and 20 or higher indicates severe symptoms. A cutoff score of 17 indicates major depressive disorder. The internal consistency of the MHS: D was excellent (Cronbach’s alpha: 0.95).
2.2.2 MHS tool for anxiety
The MHS: A is a self-report measure used for screening and intervention for generalized anxiety disorder in mental health service settings (Kim et al., 2021). It comprises 11 items enquiring about symptoms of generalized anxiety disorder over the preceding 2 weeks, with responses scored on a five-point Likert scale from 0 (not at all) to 4 (extremely). The overall score reflects symptom severity. The MHS: A demonstrated excellent validity and reliability in a validation study with a South Korean adult sample, including a clinical population. A total score of 10–19 indicates mild anxiety, 20–29 indicates moderate anxiety, and 30 or higher indicates severe anxiety. A cutoff score of 15 indicates generalized anxiety disorder. The MHS: A showed excellent internal consistency (Cronbach’s alpha: 0.97).
2.2.3 MHS tool for suicide risk
The MHS: S is a self-report measure for screening and intervention for suicide risk in mental health service settings (Yoon et al., 2020). It comprises four items enquiring about suicide-related symptoms over the preceding 2 weeks, with responses scored on a five-point Likert scale from 0 (never) to 4 (always). The overall score reflects symptom severity, considering a score of 1–2 as positive risk, and 3 or higher as high risk. The MHS: S demonstrated excellent validity and reliability in a validation study with a South Korean adult sample, including a clinical population. The internal consistency of the MHS: S online test in the adult sample was good (Cronbach’s alpha: 0.82).
2.2.4 Korean children’s somatization inventory
The K-CSI is a self-reported measure of somatic symptoms adapted from Walker et al.’s original inventory (Walker et al., 1991). It assesses the distress caused by 36 physical symptoms over the preceding week, with responses scored on a four-point Likert scale from 0 (no symptoms) to 3 (very severe). The K-CSI demonstrated good validity in a study on Korean adolescents (Cronbach’s alpha: 0.87) (Shin, 2003). In this study, the internal consistency of the scale was good (Cronbach’s alpha: 0.87).
2.2.5 Korean version of the self-harm inventory
The Korean version of the Self-Harm Inventory (K-SHI) is a self-report measure of intentional self-harm behavior adapted from the original scale by Sansone et al. (1998). It comprises 22 items enquiring about self-harm behavior within the last 6 months, with responses scored as either 1 (yes) or 0 (no). Following a validation study with Korean adolescents (Kim et al., 2019), the Institutional Review Board of the Korea Youth Policy Institute recommended modifications to the scale to protect respondents’ rights because of the sensitive nature of certain items (Choi et al., 2011). Consequently, only five items were selected to assess self-harm behavior. In this study, the internal consistency of the K-SHI was good (Cronbach’s alpha: 0.88).
2.2.6 Korean perceived stress scale for adolescents
The Korean perceived stress scale for adolescents (KPSS-A) is a self-report measure of perceived stress adapted from the original scale (Cohen et al., 1983). It comprises 10 items, with responses scored on a five-point Likert scale from 0 (never) to 4 (very often). The KPSS-A has been validated in a cohort of South Korean adolescents (Cronbach’s alpha: 0.90) (Yoon and Kim, 2019), and its internal consistency in this study was adequate (Cronbach’s alpha: 0.72).
2.2.7 COVID-19 peritraumatic distress index
The COVID-19 peritraumatic distress index (CPDI) is a self-report measure for traumatic distress related to COVID-19, encompassing symptoms of depression, anxiety, specific phobias, cognitive changes, avoidance and compulsive behavior, physical symptoms, and reduced social functioning (Qiu et al., 2020). It comprises 24 items, with responses scored on a five-point Likert scale from 0 (not experienced at all) to 4 (almost always experienced). Higher scores indicate greater distress. For the survey, the Korean version was developed through cross-translation by two bilingual individuals, and the reverse translation was subsequently validated (Choi et al., 2021). The internal consistency of the CPDI in this study was excellent (Cronbach’s alpha: 0.91).
2.3 Statistical analysis
The mean scores, item intercorrelations, and internal consistency of each tool (MHS: D, MHS: A, and MHS: S) were calculated to assess the psychometric characteristics of the screening tools. To test the internal consistency of the tools, Cronbach’s α of total items and coefficients when individual items were deleted were measured. CFA was conducted to confirm the factor structure of each tool.
To ensure that the consistency of the measurement was maintained across adult and adolescent populations, as well as across sex and age groups (elementary school: aged 11–13 years, middle school: aged 14–16 years, high school: aged 17–19 years), we tested for measurement invariance using MGCFA. Measurement invariance refers to whether the same factor structure is maintained across different populations, such as sex, race, and age. Testing the measurement invariance of a screening tool is important to ensure that data from different groups are interpreted consistently. This study follows hierarchical successive steps according to Byrne (2011). First, a configural invariance test is conducted to verify that the factor structure is consistent across the subgroups. Configural invariance tests focus on ensuring that the same constructs exist within each group and that each construct is measured by the same observed variable. In this phase, differences in factor loadings and intercepts are allowed. Second, if configural invariance holds, a metric invariance test is conducted to ensure that the item means are equivalent across subgroups, by restricting factor loadings to be equal across subgroups. When it is confirmed that the restricted model does not have a significantly worse model fit compared to the previous baseline (configural) model, metric invariance is met, and we can move on to the next phase. If metric invariance does not hold, partial metric invariance is analyzed after releasing factor loadings of some items according to the modification index (MI). Third, if full or partial metric invariance holds, a scalar invariance test is performed to ensure that the items measure the same unit across the subgroups. This involves restricting the factor loadings to be equal across subgroups. If the goodness-of-fit of this model is not significantly worse than the previous model (metric), full scalar invariance is met. If scalar invariance did not hold, partial scalar invariance was analyzed after releasing the intercepts of some items according to the MI.
During CFA and MGCFA analysis, the following criteria were used to determine goodness-of-fit: root mean square error of approximation (RMSEA) ≤ 0.08, comparative fit index (CFI) > 0.90, standardized root mean squared residual (SRMR) ≤ 0.05 (Byrne, 2011), and invariance between the model and the less restricted one was verified based on differences in RMSEA, CFI, and SRMR. Metric invariance was determined by the following criteria: ΔCFI ≤ −0.01, ΔRMSEA ≤ 0.15, ΔSRMR ≤ 0.030, indicating that each factor loading is maintained across subgroups. Scalar invariance was determined by the following criteria: ΔCFI ≤ −0.01, ΔRMSEA ≤ 0.15, ΔSRMR ≤ 0.01, indicating that each intercept of the factor loading is maintained across subgroups (Chen, 2007). If the model did not meet the criteria, we released factor loadings or intercepts of some items and assessed the partial invariance.
To provide normative data for the MHS: D, MHS: A, and MHS: S, percentile ranks by age and sex were calculated to give the total score for each instrument. To test the construct validity of the MHS tools, we examined the correlations between the MHS total scores and clinical measures related to depression, anxiety, and suicidality as well as somatization, perceived stress, and COVID-19-related stress.
Mplus Version 8 (Muthén and Muthén, 2017) was used to conduct MGCFA, and other analyses were performed using R version 4.1.2 (R Core Team, 2021).
2.4 Ethical considerations
Ethical approval was provided by the Institutional Review Boards of the National Youth Policy Institute (202106-HR-Unique-009), Korea University (1040548-KU-IRB-15-92-A-1 [R-A-1] [R-A-2] [R-A-2]), and Ilsan Paik Hospital (ISPAIK 2015-05-221-009). Participants’ informed written consent was obtained.
3 Results
3.1 Sample characteristics
Table 1 shows the characteristics of 6,689 adolescents (53.6% girls). They ranged in age from 10 to 18 (M = 14.3, SD = 2.6) years, with 30.5% in elementary school, 29.1% in middle school, 29.2% in high school, and 11.2% were out-of-school adolescents. The MHS: D displayed excellent internal consistency (Cronbach’s α: 0.92), with a mean score of 4.88 (SD = 7.29); the MHS: A had an overall mean score of 4.35 (SD = 7.23), displaying excellent internal consistency (Cronbach’s α: 0.93); and the overall mean score for the MHS: S was 0.66 (SD = 2.00), showing good internal consistency (Cronbach’s α: 0.86). Descriptive statistics for each instrument and item are presented in Table 2.
Table 1. Sample characteristics (N = 6689).
Table 2. Means and internal validity of mental health screening tools.
3.2 Factor analysis
A CFA was conducted to determine whether each screening tool had a single-factor structure. The internal validity of the structure was evaluated using the goodness-of-fit index, determined using the following criteria: RMSEA ≤ 0.08, CFI > 0.90, and SRMR ≤ 0.05. The goodness-of-fit for the MHS: D, MHS: A, and MHS: S all supported a unidimensional structure: MHS: D [χ2(44) = 654.334, p < 0.001, CFI = 0.925, SRMR = 0.040, RMSEA = 0.064 (90% CI 0.060–0.069)]; MHS: A [χ2(44) = 521.380, p < 0.001, CFI = 0.934, SRMR = 0.040, RMSEA = 0.056 (90% CI 0.052–0.061)]; and MHS: S [χ2(2) = 12.507, p < 0.001, CFI = 0.989, SRMR = 0.018, RMSEA = 0.040 (90% CI 0.021–0.061)].
3.3 Measurement invariance
To ensure that the factor structure of each screening instrument was maintained in the adolescent population, we conducted an MGCFA between the MHS outcomes measured in adult validation studies and the outcomes collected in this study. Validation studies conducted on adult populations identified a single-factor structure for each instrument and reported excellent validity and reliability, with CFI ranging from 0.945 to 0.985 and SRMR ranging from 0.025 to 0.04 (Kim et al., 2021; Park et al., 2022; Yoon et al., 2020). Results showed that partial scalar measurement invariance between the adolescent and adult groups was supported for the MHS: D [χ2(105) = 1016.468, p < 0.001, CFI = 0.924, SRMR = 0.040, RMSEA = 0.067 (90% CI 0.063–0.071)]; for Item 12 (sleep disturbance), scalar measurement invariance of the MHS: D between the adult and adolescent groups was not supported. After MI analysis of each item, an intercept of item 12 was freely estimated, and partial scalar measurement invariance of MHS: D between adolescents and adults was met. Full scalar measurement invariance between the adult and adolescent groups was supported for the MHS: A [χ2(108) = 1094.141, p < 0.001, CFI = 0.914, SRMR = 0.049, RMSEA = 0.069 (90% CI 0.065–0.072)]. For the MHS: S, there was a partial scalar measurement invariance between the two groups [χ2(16) = 16.440, p < 0.001, CFI = 0.979, SRMR = 0.031, RMSEA = 0.044 (90% CI 0.032–0.058)]. For Item 2 (suicidal thoughts), the scalar measurement invariance of the MHS: S across subgroups was not supported. After examining the MI of each item, an intercept of item 2 was freely estimated, and partial scalar measurement invariance of MHS: S between adolescents and adults was met. Detailed results of the MGCFA between adult and adolescent samples are presented in Supplementary Table S1.
To ensure that the factor structure of each screening instrument was maintained across the adolescent demographic subgroups, we conducted MGCFA between the MHS outcomes of the age and sex subgroups (Supplementary Table S2). For the MHS: D, partial scalar measurement invariance across age and measurement invariance across sex were supported [age: χ2(168) = 745.029, p < 0.001, CFI = 0.925, SRMR = 0.049, RMSEA = 0.056 (90% CI 0.051–0.060); sex: χ2(108) = 778.317, p < 0.001, CFI = 0.917, SRMR = 0.049, RMSEA = 0.061 (90% CI 0.057–0.065)]. Scalar measurement invariance between age subgroups was not supported for Items 10/11 (appetite change) and 3 (psychomotor agitation). Based on MI analysis of each item, intercepts of Item 10/11 (all groups), and Item 3 (elementary) were freely estimated, and partial scalar measurement invariance of MHS: D between age groups was met. Scalar measurement invariance between adolescent subgroups was supported for the MHS: A [age: χ2(172) = 756.422, p < 0.001, CFI = 0.918, SRMR = 0.054, RMSEA = 0.055 (90% CI 0.051–0.059); sex: χ2(108) = 620.856, p < 0.001, CFI = 0.925, SRMR = 0.044, RMSEA = 0.053 (90% CI 0.049–0.057)]. Scalar measurement invariance across sex subgroups and partial scalar measurement invariance across age subgroups were supported for the MHS: S [age: χ2(16) = 16.440, p <0.001, CFI = 1, SRMR = 0.033, RMSEA = 0.005 (90% CI 0.000–0.028); sex: χ2(16) = 27.680, p <0.001, CFI = 0.982, SRMR = 0.037, RMSEA = 0.033 (90% CI 0.018–0.047)]. Scalar measurement invariance between age subgroups was not supported for Items 2 (suicidal thoughts) and 3 (past attempts), and intercepts of Item 2 (elementary) and Item 4 (high school) are freely estimated based on the MI of each item, and the partial scalar measurement invariance of MHS: S between age groups was met.
3.4 Normative data displayed by percentile ranks for the total scores of MHS tools
Supplementary Tables S3–S5 present normative data for the MHS: D (Supplementary Table S3), MHS: A (Supplementary Table S4), and MHS: S (Supplementary Table S5) for different age and sex groups. The percentiles in the tables can be used to determine where an individual’s MHS score falls in comparison to the normative population as a whole and to the normative population of adolescents in the individual’s sex and age group. The percentile rank tends to decrease with age and among females. For example, for the MHS: D cutoff of 17, the overall norm percentile is 93.2, but it is 97.7 for elementary school males and 88.8 for high school females (Supplementary Table S4).
3.5 Correlations with other clinical symptoms and COVID-19-related stress
Higher MHS: D, MHS: A, and MHS: S scores were significantly associated with self-harm, somatization, perceived stress, and COVID-19-related stress indicators (all p < 0.005; Table 3). Pearson’s correlation coefficients showed that the MHS: D scores are highly correlated with self-harm (r = 0.357), somatization (r = 0.552), and perceived stress (r = 0.627). The MHS: A scores are highly correlated with self-harm (r = 0.346), somatization (r = 0.599), and perceived stress (r = 0.620). The MHS: S exhibited moderate to high correlations with self-harm (r = 0.385), somatization (r = 0.429), and perceived stress (r = 0.443). Strong correlations between COVID-19-related stress and the MHS: D (r = 0.607), MHS: A (r = 0.636), and MHS: S (r = 0.478) were observed.
Table 3. Correlations between MHSs and clinical indicators.
4 Discussion
For the South Korean youth population, this is the first standardization and validation study of mental health scales, conducted with a large representative sample of adolescents (N = 6,689). This study provided the psychometric properties and normative data of three MHS tools developed in South Korea: MHS: D, MHS: A, and MHS: S.
4.1 Psychometric properties and normative data of MHS tools for South Korean adolescents
The three tools had good-to-excellent reliability when administered to an adolescent normative sample (MHS: D α = 0.92, MHS: A α = 0.93, and MHS: S α = 0.86) and acceptable goodness-of-fit values in factor analyses. We also confirmed that all three instruments had a single-factor structure, as in the adult population, and that they measured depression, anxiety, and suicide risk equivalently in adult and adolescent populations. The finding that MHS tools in adult and adolescent populations have the same psychometric properties and measurement invariance suggests that cutoff points for depressive and anxiety disorders and suicidality derived from studies of structured diagnostic-based MHS tools for adults could be applicable to adolescents.
This study also provided normative data for depression, anxiety, and suicide risk instruments in a sample of 6,689 South Korean adolescents. Normative data with percentile ranks according to total scores would provide clinicians with more information about an individual’s mental health. The reference norms would also provide an easier and more informative interpretation for adolescents who want to know their mental health status accurately.
4.2 Measurement invariance and developmental difference between demographic subgroups
Measurement invariance comparison of adolescent subgroup scores found that the adolescent screening tools equivalently measured depression, anxiety, and suicide risk regardless of one’s age and sex, and this indicates that the scores could be generalized across different demographic characteristics of the screening population.
The measurement invariance tests also indicated that some single items should be used with caution when interpreting psychological symptoms, considering differences in adolescents’ developmental characteristics. For Item 12 of the MHS: D (insomnia), which did not meet full scalar measurement invariance between adolescents and adults, this likely reflects that insomnia is a common symptom of depression in adolescents (Roberts et al., 1995). However, there is no significant association between insomnia and the onset of major depressive disorder in adolescents (Rice et al., 2019). Therefore, rather than interpreting insomnia as having a specific effect on depression in adolescents, this finding may reflect a developmental characteristic of adolescence, in which adolescents report sleep difficulties more frequently than adults (de Zambotti et al., 2018); and a cultural characteristic, in which Asian adolescents sleep less than other cultures (Olds et al., 2010). Psychomotor abnormalities and appetite changes were non-full-scalar measurement invariant across adolescent age groups. The intercept difference in the psychomotor abnormalities item may replicate previous findings that older adolescents with depression are more likely to experience psychomotor symptoms (Baji et al., 2009), which appear to be strongly associated with psychomotor changes owing to neurodevelopmental changes during adolescence (Cioni and Sgandurra, 2013). Appetite changes might be influenced by hormonal changes that occur during the rapid growth process of adolescence and cultural factors, such as the unique adolescent culture of body dissatisfaction (Maxwell and Cole, 2009) that is notable in South Korea (Kim, 2018). In the case of suicide ideation and attempt items, this appears to reflect the tendency for the rate of suicidal ideation to spike after 14 years of age (Nock et al., 2013). These items are a comprehensive measure of suicide attempts with no time limit; thus, older individuals may have accumulated suicide attempts and consequently scored higher on the relevant items. Therefore, caution should be exercised when using specific item scores in isolation to interpret mental health problems in adolescents (MHS: D Items 3, 10/11, and 12; MHS: S Items: 2 and 4), considering the developmental and cultural characteristics of South Korean adolescents.
Notably, the interpretation of the sum and mean differences in scores for each group is not compromised even if full scalar invariance is violated for a few items (Alvarez et al., 2016; Steenkamp and Baumgartner, 1998). Although the age-specific youth psychometric and general characteristics explained above made some screening tools achieve only partial measurement invariance, all three MHS instruments are equivalent measures of mental health problems in adolescents of different ages and sexes.
Normative data indicate that girls tend to have lower percentile ranks than boys, and older age groups tend to have lower percentile ranks than younger age groups for the same total score. This means that a higher proportion of girls compared to boys, and older age groups compared to younger ones, are at risk for depression, anxiety, and suicidal risk. This result aligns with former findings that older age and female sex are associated with greater vulnerability to internalized psychological problems and higher suicidality (Copeland et al., 2014; Lee, 2012; Lu, 2019; Nock et al., 2013; Oh and Seon, 2013). Therefore, the results of the MHS should be interpreted in relation to the percentile rank for each age and sex. For example, an MHS: D score of 13 for male elementary school seniors may be considered a level of depression that does not reach the clinical cutoff, but they are experiencing severe depression (top 5%) compared to other male senior elementary school peers.
In addition, even if the percentile rank of scores obtained is low compared to the overall norm and identifies a relatively common mental health problem, it would be misleading to interpret that the severity of mental health problems decreases. For example, MHS: S scores of 3 or higher are relatively common among female high-school-level adolescents: about 1 in 10 (89.5% in sum score 3). However, given that the MHS tools’ measurement consistency has been met in adults and adolescents, the score results should be still interpreted that she has a high suicide risk, as the score indicates that she is in the high-risk group according to the MHS: S cutoff.
The findings ensure that developmental and psychosocial factors in adolescents significantly influence mental health score differences, but not to the extent that they distort measurement invariance between demographic subgroups. Various factors appear to contribute to psychopathology in adolescents, including biological vulnerabilities; gender role differences; the effects of physical, cognitive, and emotional development during puberty; and academic performance and peer relationships (Franić et al., 2010; Kashani and Orvaschel, 1990; Makri-Botsari, 2005). Therefore, aligning with the results of measurement invariance and norm difference between age subgroups, this study emphasizes that though MHS tools could be used universally in South Korean adolescents, score differences between age and sex groups should be interpreted considering understanding the unique developmental and cultural context of an adolescent.
4.3 Correlation between MHS tools and negative mental health outcomes
The MHS: D, MHS: A, and MHS: S were all highly correlated with scores on instruments indicating mental health risk, suggesting that all three instruments had adequate construct validity. In previous studies, poor adolescent mental health, such as depression, anxiety, and suicidality, were highly associated with maladaptive responses, such as somatization and self-harm (Hawton et al., 2013; Lipowski, 1988; Löwe et al., 2008b; Moran et al., 2012) and perceived stress levels (Chen and Kuo, 2020; Lee, 2012). All three screening tools were highly positively correlated with somatization, self-harm, and perceived stress, which confirms that they are accurate measures of mental health issues. In addition to confirming the construct validity of the MHS instrument, we also confirmed that adolescent depression and anxiety are risk factors for high somatization and self-harm. We ensured that untreated common mental health concerns could contribute to worsening the quality of life and even the overall health and safety of adolescents.
The strong association between COVID-19-related stress and depression, anxiety, and suicide risk found in this study aligns with studies showing that the pandemic and social distancing measures significantly impacted public mental health. Prolonged social distancing in South Korea owing to the pandemic introduced new stressors, such as technical difficulties, decreased concentration, and lack of motivation, which adversely impacted academic performance and mental health (Adnan and Anwar, 2020; Branje and Morris, 2021; Huang and Ougrin, 2021; Marciano et al., 2022; Stewart et al., 2022). These conditions might also have led to an increase in depression, anxiety, and suicide risk among adolescents observed in this study, and vice versa, especially when one who has depression and anxiety symptoms is prone to experience high stress owing to COVID-19. Because evidence is mixed as to whether COVID-19 negatively affected the prevalence of depression, anxiety, and suicidal ideation in the South Korean adolescent population (Jo et al., 2023; Kim et al., 2023), this issue needs further exploration.
Although the global prevalence of depression, anxiety, and suicide risk increases as adolescents age, there is a particular problem that comes with increasing school levels in South Korea. For Korean adolescents, admission to top colleges is overly emphasized as a prerequisite for a successful future. Students must earn high scores on the Suneung (College Scholastic Ability Test) and maintain good Naeshin (GPA in high school) to be accepted. In general, they are advised to spend their entire day studying for the Suneung and Naeshin subjects, and this intense preparation begins in earnest in high school around age 16 (making things worse, most adolescents begin preparing for this critical stage in middle school and even earlier in elementary school). During this time, they experience extreme pressure to be perfect academically. However, rather than providing them with coping strategies to handle this harsh situation, their parents and the school environment implicitly or explicitly force them to be more competitive in order to achieve “high.” Surely, this unique competitive circumstances have worsened overall mental health problems of Korean adolescents (Kim, 2024; Park and Chung, 2014), compared to one from any other cultural backgrounds. Even for youth who have dropped out of school for academic, health, or other reasons, having inherently internalized the label of having dropped out midway in the “normal” path to “success,” lack of occupational support and social stigma against out-of-school youth could make them vulnerable to mental health threats (Chae and Bae, 2024). All groups of South Korean adolescents have been facing special psychosocial challenges, leading to chronic mental health issues, resulting in an increased risk of suicide.
To address these, providing continuous mental health monitoring with screening tools is essential, which could help subsequent diagnosis and preventive measures and interventions (Daniunaite et al., 2021; Loy et al., 2024). In South Korea, adolescents are regularly screened for emotional and behavioral problems at school every three years (Student Emotional and Behavioral Screening Test). However, these screenings are limited to identifying general mental health problems and are not intended to screen for specific mental health problems such as general anxiety disorder, depressive disorders, and suicide risk, resulting in limited prevention and treatment for specific symptoms. Further, this regular screening excludes out-of-school adolescents. The use of validated, evidence-based screening tools in community and in-and-out-of-school settings for youth will help individuals and professionals accurately assess their own mental health and suicide risk, allowing for more appropriate and personalized prevention and intervention. The use of validated MHS tools in conjunction with the sex-and age-specific norms will provide more accurate information about the severity of a client’s mental health problems.
4.4 Limitations and future research
This study had some limitations. First, it was conducted with South Korean adolescents, which may limit its generalizability to other cultures. Future studies should examine the reliability and validity of these instruments among adolescents from different cultural backgrounds, and cross-cultural measurement consistency by collecting measurement data with MHS tools from different cultural backgrounds and conducting measurement invariance tests with the normative sample in this study (i.e., Stevanovic et al., 2017), to gain universality of these tools. Second, diagnosis by a clinician through a structured interview was not included. Therefore, the MHS cut-off points for adolescents could remain provisional, as the associations between total scores and actual diagnoses have not yet been analyzed. However, validation studies of the MHS: D, MHS: A, and MHS: S in adults included structured interviews to demonstrate the diagnostic validity of the screening tools (Kim et al., 2021; Park et al., 2022; Yoon et al., 2020), succeeding to set the exact cut-off points of depression, anxiety and suicide risk for adults, and this study confirmed that each MHS tool could measure consistently in both adult and adolescent populations and that the adult cut-off points be applied to adolescents the same, at least tentatively. Future studies should include structured interviews with adolescents to rigorously establish cutoff points for major depressive disorder, generalized anxiety disorder, and suicidality.
In addition, although many out-of-school youth were sampled in this survey, the study focus was on standardizing and validating the MHS in the South Korean adolescent population, which prevented further exploration of mental health and suicide risk characteristics in out-of-school populations. Further, although the year 2020–2022 was a period of sustained negative effects of social distancing owing to COVID-19, analysis of the long-term impact of the pandemic on participants’ mental health is limited as we employed a cross-sectional design. During a period of significant pandemic-related restrictions, the survey was conducted and confirmed strong associations between pandemic-related stress and depression, anxiety, and suicide risk. However, since this is a cross-sectional study that only examines a specific point in time, interpretations of causal relationships between variables (e.g., that worsening depression levels in adolescents may have been caused by increased pandemic-related distress) should be limited. A longitudinal study could be conducted to examine the causal relationship between COVID-induced distress and mental health. Finally, few attempts in the survey were made to identify or control factors that could influence biased and subjective responses among adolescents, such as underreporting or overreporting due to peer pressure, or differences in literacy of adolescents. Future studies aiming to validate screening tools for adolescent population should incorporate research designs that account for or control response bias.
The strength of this study is that it used data from over 6,000 adolescents nationwide to confirm the psychometric properties of screening tools. This study analyzed all adolescent age groups, not just those in specific school grades, including out-of-school adolescents. Using the adolescent sample with out-of-school participants enhanced the generalizability of the results for South Korean adolescents with different educational backgrounds because these youths are more vulnerable to emotional, adjustment, and environmental challenges than in-school adolescents, and this might impact the overall mental health status of adolescents. Further, measurement invariance across age groups confirmed that the MHS tools are valid measures of mental health for all adolescents in South Korea. In addition, survey data were collected online, which can be used as a basis for incorporating the tools into applications and online platforms targeting adolescents. Therefore, this study provides evidence that these screening tools can be used to measure depression, anxiety, and suicidality in adolescents, and explore the detrimental effect of mental health concerns on the overall quality of life and safety of South Korean adolescents.
4.5 Conclusion
The MHS: D, MHS: A, and MHS: S demonstrated good-to-excellent reliability and validity in a sample of South Korean adolescents. Each instrument also demonstrated a unidimensional construct and adequate measurement invariance across sex and age subgroups. This study also provided youth normative data for the MHS, which makes the MHS easier to interpret. Adolescent depression and anxiety are correlated with worsening mental health and increased suicide risk, and the detrimental effects of COVID-19 on adolescents’ health problems were observed. Unresolved psychosocial problems in South Korea are a major contributor to the high suicide risk among adolescents. However, adolescent mental health problems are preventable public health issues. These screening tools with normative references are highly useful for clinicians in community settings and on web-based platforms for identifying ongoing depression, anxiety, and suicidality in adolescents.
Data availability statement
The data analyzed in this study is subject to the following licenses/restrictions: The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request. Requests to access these datasets should be directed to ZGF2aWQwMTc3QGtvcmVhLmFjLmty.
Ethics statement
The studies involving humans were approved by National Youth Policy Institute (202106-HR-Unique-009), Korea University (1040548-KU-IRB-15-92-A-1 [R-A-1] [R-A-2] [R-A-2]), and Ilsan Paik Hospital (ISPAIK 2015-05-221-009). The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study. In the case of adolescents, written informed consent was provided by their legal guardians/next of kin.
Author contributions
EH: Conceptualization, Data curation, Investigation, Software, Writing – original draft, Writing – review & editing, Formal analysis, Methodology. JL: Conceptualization, Writing – original draft, Writing – review & editing. SY: Conceptualization, Writing – original draft, Writing – review & editing. SC: Conceptualization, Writing – original draft, Writing – review & editing. Y-CB: Conceptualization, Writing – original draft, Writing – review & editing. JC: Conceptualization, Data curation, Writing – review & editing. K-HC: Conceptualization, Writing – review & editing, Funding acquisition.
Funding
The author(s) declare that financial support was received for the research and/or publication of this article. This work was supported by the National Research Foundation of Korea (NRF-2023S1A5C2A0709598711) and the Korean Radio Promotion Association.
Acknowledgments
The authors would like to thank National Youth Policy Institute for data collection and provision, and thank Editage (www.editage.co.kr) for English language editing.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
The author(s) declared that they were an editorial board member of Frontiers, at the time of submission. This had no impact on the peer review process and the final decision.
Generative AI statement
The authors declare that no Gen AI was used in the creation of this manuscript.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2025.1589136/full#supplementary-material
References
Adjorlolo, S., Anum, A., and Amin, J. M. (2022). Validation of the suicidal behaviors questionnaire-revised in adolescents in Ghana. J. Ment. Health 31, 302–308. doi: 10.1080/09638237.2020.1739239
Adnan, M., and Anwar, K. (2020). Online learning amid the COVID-19 pandemic: students’ perspectives. In ERIC: Reports 45 U.S. Department of Education. Available online at: https://link.gale.com/apps/doc/A720238399/HRCA?u=anon~ee9b08ca&sid=googleScholar&xid=e2ddd15e.
Ahn, J.-K., Kim, Y., and Choi, K.-H. (2019). The psychometric properties and clinical utility of the Korean version of GAD-7 and GAD-2. Front. Psych. 10:127. doi: 10.3389/fpsyt.2019.00127
Alvarez, K., Wang, Y., Alegria, M., Ault-Brutus, A., Ramanayake, N., Yeh, Y.-H., et al. (2016). Psychometrics of shared decision making and communication as patient centered measures for two language groups. Psychol. Assess. 28, 1074–1086. doi: 10.1037/pas0000344
Baji, I., Lopez-Duran, N. L., Kovacs, M., George, C. J., Mayer, L., and Kapornai, K. (2009). Age and sex analyses of somatic complaints and symptom presentation of childhood depression in a Hungarian clinical sample. J. Clin. Psychiatry 70, 1467–1472. doi: 10.4088/JCP.08m04918
Balazs, J., Miklosi, M., Kereszteny, A., Hoven, C. W., Carli, V., Wasserman, C., et al. (2013). Adolescent subthreshold-depression and anxiety: psychopathology, functional impairment and increased suicide risk. J. Child Psychol. Psychiatry 54, 670–677. doi: 10.1111/jcpp.12016
Barican, J. L., Yung, D., Schwartz, C., Zheng, Y., Georgiades, K., and Waddell, C. (2022). Prevalence of childhood mental disorders in high-income countries: a systematic review and meta-analysis to inform policymaking. Evid. Based Ment. Health 25, 36–44. doi: 10.1136/ebmental-2021-300277
Beck, A. T., Epstein, N., Brown, G., and Steer, R. A. (1988). An inventory for measuring clinical anxiety: psychometric properties. J. Consult. Clin. Psychol. 56, 893–897. doi: 10.1037/0022-006X.56.6.893
Beck, A. T., Steer, R. A., and Brown, G. K. (1996). Beck Depression Inventory–II (BDI-II) [Database record]. APA PsycTests. doi: 10.1037/t00742-000
Branje, S., and Morris, A. S. (2021). The impact of the COVID-19 pandemic on adolescent emotional, social, and academic adjustment. J. Res. Adolesc. 31, 486–499. doi: 10.1111/jora.12668
Byrne, B. M. (2011). Structural equation modeling with Mplus: Basic concepts, applications, and programming. Taylor & Francis Group. Available online at: http://ebookcentral.proquest.com/lib/korea-ebooks/detail.action?docID=957904.
Chae, H.-J., and Bae, S.-M. (2024). The association between social stigma, career barrier, and depressive symptoms among out-of-school Korean adolescents based on a national sample. Child Adolesc. Soc. Work J. 41, 781–788. doi: 10.1007/s10560-023-00920-5
Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Struct. Equ. Model. 14, 464–504. doi: 10.1080/10705510701301834
Chen, Y.-L., and Kuo, P.-H. (2020). Effects of perceived stress and resilience on suicidal behaviors in early adolescents. Eur. Child Adolesc. Psychiatry 29, 861–870. doi: 10.1007/s00787-019-01401-w
Cho, M. J., and Kim, K. H. (1998). Use of the center for epidemiologic studies depression (CES-D) scale in Korea. J. Nerv. Ment. Dis. 186, 304–310. doi: 10.1097/00005053-199805000-00007
Choi, I. J., Mo, S. H., Kang, J. H., Kim, Y. H., and Lee, J. Y. (2011). A study on mental health improvement policy for children and adolescents: general report. National Youth Policy Institute, 3––10.
Choi, J. W., Moon, H. Y., Jeon, J. A., and Bahk, Y. C. (2021). Survey on the mental health status of teenagers.
Cioni, G., and Sgandurra, G. (2013). Chapter 1- Normal psychomotor development. O. Dulac, M. Lassonde, and H. B. Sarnat (O. Dulac, M. Lassonde, and H. B. Sarnat Eds.), Handbook of clinical neurology (111, 3–15). Elsevier.
Cohen, S., Kamarck, T., and Mermelstein, R. (1983). A global measure of perceived stress. J. Health Soc. Behav. 24, 385–396. doi: 10.2307/2136404
Copeland, W. E., Angold, A., Shanahan, L., and Costello, E. J. (2014). Longitudinal patterns of anxiety from childhood to adulthood: the Great Smoky Mountains study. J. Am. Acad. Child Adolesc. Psychiatry 53, 21–33. doi: 10.1016/j.jaac.2013.09.017
Costello, E. J., Mustillo, S., Erkanli, A., Keeler, G., and Angold, A. (2003). Prevalence and development of psychiatric disorders in childhood and adolescence. Arch. Gen. Psychiatry 60, 837–844. doi: 10.1001/archpsyc.60.8.837
Crawford, J. R., Garthwaite, P. H., and Slick, D. J. (2009). On percentile norms in neuropsychology: proposed reporting standards and methods for quantifying the uncertainty over the percentile ranks of test scores. Clin. Neuropsychol. 23, 1173–1195. doi: 10.1080/13854040902795018
Daniunaite, I., Truskauskaite-Kuneviciene, I., Thoresen, S., Zelviene, P., and Kazlauskas, E. (2021). Adolescents amid the COVID-19 pandemic: a prospective study of psychological functioning. Child Adolesc. Psychiatry Ment. Health 15:45. doi: 10.1186/s13034-021-00397-z
de Zambotti, M., Goldstone, A., Colrain, I. M., and Baker, F. C. (2018). Insomnia disorder in adolescence: diagnosis, impact, and treatment. Sleep Med. Rev. 39, 12–24. doi: 10.1016/j.smrv.2017.06.009
Dunn, V., and Goodyer, I. M. (2006). Longitudinal investigation into childhood-and adolescence-onset depression: psychiatric outcome in early adulthood. Br. J. Psychiatry 188, 216–222. doi: 10.1192/bjp.188.3.216
Franić, S., Middeldorp, C. M., Dolan, C. V., Ligthart, L., and Boomsma, D. I. (2010). Childhood and adolescent anxiety and depression: beyond heritability. (1527-5418 (Electronic)).
Hawton, K., Saunders, K., Topiwala, A., and Haw, C. (2013). Psychiatric disorders in patients presenting to hospital following self-harm: a systematic review. J. Affect. Disord. 151, 821–830. doi: 10.1016/j.jad.2013.08.020
Huang, H. C.-H., and Ougrin, D. (2021). Impact of the COVID-19 pandemic on child and adolescent mental health services. BJPsych Open 7:e145. doi: 10.1192/bjo.2021.976
Jo, E., Seo, K., Nam, B., Shin, D., Kim, S., Jeong, Y., et al. (2023). Deterioration of mental health in children and adolescents during the COVID-19 pandemic. J. Korean Acad. Child Adolesc. Psychiatry 34, 21–29. doi: 10.5765/jkacap.220041
Jung, J., and Cho, S. Y. (2020). The effects of depression, anxiety, and parents’ support on suicide ideation and attempts by gender among Korean adolescents. J. Child Fam. Stud. 29, 1458–1466. doi: 10.1007/s10826-020-01697-2
Kang, E., Rhee, Y. E., Kim, S., Lee, J., and Yun, Y. H. (2021). Quality of life and depression in the general Korean population: normative data and associations of the 12-item short form health survey (SF-12) and the McGill quality of life questionnaire (MQOL) with depression (patient health questionnaire-9) and socioeconomic status. Appl. Res. Qual. Life 16, 1673–1687. doi: 10.1007/s11482-020-09838-x
Kashani, J. H., and Orvaschel, H. (1990). A community study of anxiety in children and adolescents. Am. J. Psychiatry 147, 313–318. doi: 10.1176/ajp.147.3.313
Kessler, R. C., and Wang, P. S. (2008). The descriptive epidemiology of commonly occurring mental disorders in the United States. Annu. Rev. Public Health 29, 115–129. doi: 10.1146/annurev.publhealth.29.020907.090847
Kieling, C., Baker-Henningham, H., Belfer, M., Conti, G., Ertem, I., Omigbodun, O., et al. (2011). Child and adolescent mental health worldwide: evidence for action. Lancet (London, England) 378, 1515–1525. doi: 10.1016/S0140-6736(11)60827-1
Kim, S. (2018). Eating disorders, body dissatisfaction, and self-esteem among south Korean women. Soc. Behav. Personal. 46, 1537–1546. doi: 10.2224/sbp.6801
Kim, J.-H. (2024). Stress and coping mechanisms in south Korean high school students: academic pressure, social expectations, and mental health support. J. Res. Soc. Sci. Hum. 3, 45–54. doi: 10.56397/JRSSH.2024.05.09
Kim, H., Lee, Y. J., and Jung, S. J. (2023). Trends in depressive symptoms and suicidality of south Korean adolescents: comparison of expected and observed prevalence during the COVID-19 pandemic. J. Adolesc. Health 73, 79–87. doi: 10.1016/j.jadohealth.2023.02.014
Kim, S. H., Park, K., Yoon, S., Choi, Y., Lee, S. H., and Choi, K. H. (2021). A brief online and offline (paper-and-pencil) screening tool for generalized anxiety disorder: the final phase in the development and validation of the mental health screening tool for anxiety disorders (MHS: a). Front. Psychol. 12:639366. doi: 10.3389/fpsyg.2021.639366
Kim, S., Woo, S., Koo, H., and Lee, J. (2019). Validation of the Korean version of the self-harm inventory (K-SHI). Cogn. Behav. Ther. Korea 19, 205–228. doi: 10.33703/cbtk.2019.19.2.205
Kliem, S., Sachser, C., Lohmann, A., Baier, D., Brähler, E., Gündel, H., et al. (2024). Psychometric evaluation and community norms of the PHQ-9, based on a representative German sample. Front. Psych. 15:1483782. doi: 10.3389/fpsyt.2024.1483782
Kroenke, K., Spitzer, R. L., and Williams, J. B. W. (2001). Validity of a brief depression severity measure. J. Gen. Intern. Med. 16, 606–613. doi: 10.1046/j.1525-1497.2001.016009606.x
Lee, E. H. (2012). Review of the psychometric evidence of the perceived stress scale. Asian Nurs. Res. (Korean Soc. Nurs. Sci.) 6, 121–127. doi: 10.1016/j.anr.2012.08.004
Lim, Y. J., Kim, Y. H., Lee, E. H., and Kwon, S. M. (2008). The Penn State worry questionnaire: psychometric properties of the Korean version. Depress. Anxiety 25, E97–E103. doi: 10.1002/da.20356
Lipowski, Z. J. (1988). Somatization: the concept and its clinical application. Am. J. Psychiatry 145, 1358–1368. doi: 10.1176/ajp.145.11.1358
Löwe, B., Decker, O., Müller, S., Brähler, E., Schellberg, D., Herzog, W., et al. (2008a). Validation and standardization of the generalized anxiety disorder screener (GAD-7) in the general population. Med. Care 46, 266–274. doi: 10.1097/MLR.0b013e318160d093
Löwe, B., Mussell, M., Schellberg, D., Spitzer, R. L., Williams, J. B. W., and Kroenke, K. (2008b). Depression, anxiety and somatization in primary care: syndrome overlap and functional impairment [article]. Gen. Hosp. Psychiatry 30, 191–199. doi: 10.1016/j.genhosppsych.2008.01.001
Loy, J. K., Klam, J., Dötsch, J., Frank, J., and Bender, S. (2024). Exploring adolescent mental health during the COVID-19 crisis – strengths and difficulties. Front. Public Health 12:1357766. doi: 10.3389/fpubh.2024.1357766
Lu, W. (2019). Adolescent depression: National Trends, risk factors, and healthcare disparities. Am. J. Health Behav. 43, 181–194. doi: 10.5993/AJHB.43.1.15
Makri-Botsari, E. (2005). Risk/protective effects on adolescent depression: Role of individual, family and peer factors. Psychol. Stud. 50, 50–61.
Mangione, C. M., Barry, M. J., Nicholson, W. K., Cabana, M., Chelmow, D., Coker, T. R., et al. (2022). Screening for depression and suicide risk in children and adolescents. JAMA 328:1534. doi: 10.1001/jama.2022.16946
Marciano, L., Ostroumova, M., Schulz, P. J., and Camerini, A.-L. (2022). Digital media use and adolescents' mental health during the Covid-19 pandemic: a systematic review and meta-analysis. Front. Public Health 9:793868. doi: 10.3389/fpubh.2021.793868
Maxwell, M. A., and Cole, D. A. (2009). Weight change and appetite disturbance as symptoms of adolescent depression: toward an integrative biopsychosocial model. Clin. Psychol. Rev. 29, 260–273. doi: 10.1016/j.cpr.2009.01.007
Merikangas, K. R., He, J. P., Burstein, M., Swanson, S. A., Avenevoli, S., Cui, L., et al. (2010). Lifetime prevalence of mental disorders in U.S. adolescents: results from the National Comorbidity Survey Replication--Adolescent Supplement (NCS-A). J. Am. Acad. Child Adolesc. Psychiatry 49, 980–989. doi: 10.1016/j.jaac.2010.05.017
Meyer, T. J., Miller, M. L., Metzger, R. L., and Borkovec, T. D. (1990). Development and validation of the Penn State worry questionnaire. Behav. Res. Ther. 28, 487–495. doi: 10.1016/0005-7967(90)90135-6
Ministry of Gender Equality and Family (2023). 2021 Youth Statistics. Seoul: Ministry of Gender Equality and Family.
Moran, P., Coffey, C., Romaniuk, H., Olsson, C., Borschmann, R., Carlin, J. B., et al. (2012). The natural history of self-harm from adolescence to young adulthood: a population-based cohort study. Lancet 379, 236–243. doi: 10.1016/S0140-6736(11)61141-0
Nock, M. K., Green, J. G., Hwang, I., McLaughlin, K. A., Sampson, N. A., Zaslavsky, A. M., et al. (2013). Prevalence, correlates, and treatment of lifetime suicidal behavior among adolescents: results from the National Comorbidity Survey Replication Adolescent Supplement. JAMA Psychiatry 70, 300–310. doi: 10.1001/2013.jamapsychiatry.55
Oh, H., Park, K., Yoon, S., Kim, Y., Lee, S.-H., Choi, Y. Y., et al. (2018). Clinical utility of Beck anxiety inventory in clinical and nonclinical Korean samples. Front. Psych. 9:666. doi: 10.3389/fpsyt.2018.00666
Oh, J. H., and Seon, H. Y. (2013). The study on the factors related to academic stress of elementary and middle school students. Korea J. Couns. 14, 1981–1994. doi: 10.15703/kjc.14.3.201306.1981
Olds, T., Blunden, S., Petkov, J., and Forchino, F. (2010). The relationships between sex, age, geography and time in bed in adolescents: a meta-analysis of data from 23 countries. Sleep Med. Rev. 14, 371–378. doi: 10.1016/j.smrv.2009.12.002
Osman, A., Bagge, C. L., Gutierrez, P. M., Konick, L. C., Kopper, B. A., and Barrios, F. X. (2001). The suicidal behaviors questionnaire-revised (SBQ-R): validation with clinical and nonclinical samples. Assessment 8, 443–454. doi: 10.1177/107319110100800409
Park, J.-Y., and Chung, I.-J. (2014). Adolescent suicide triggered by problems at school in Korea: analyses focusing on depression, suicidal ideation, plan, and attempts as four dimensions of suicide. Child Indic. Res. 7, 75–88. doi: 10.1007/s12187-013-9197-3
Park, K., Jaekal, E., Yoon, S., Lee, S.-H., and Choi, K.-H. (2020). Diagnostic utility and psychometric properties of the Beck depression inventory-II among Korean adults. Front. Psychol. 10:2934. doi: 10.3389/fpsyg.2019.02934
Park, K., Yoon, S., Cho, S., Choi, Y., Lee, S.-H., and Choi, K.-H. (2022). Final validation of the mental health screening tool for depressive disorders: a brief online and offline screening tool for major depressive disorder. Front. Psychol. 13:992068. doi: 10.3389/fpsyg.2022.992068
Qiu, J., Shen, B., Zhao, M., Wang, Z., Xie, B., and Xu, Y. (2020). A nationwide survey of psychological distress among Chinese people in the COVID-19 epidemic: implications and policy recommendations. Gen. Psychiatr. 33:e100213. doi: 10.1136/gpsych-2020-100213
Radloff, L. S. (1977). The CES-D scale: a self-report depression scale for research in the general population. Appl. Psychol. Meas. 1, 385–401. doi: 10.1177/014662167700100306
R Core Team (2021). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. Available at: https://www.R-project.org/
Rice, F., Riglin, L., Lomax, T., Souter, E., Potter, R., Smith, D. J., et al. (2019). Adolescent and adult differences in major depression symptom profiles. J. Affect. Disord. 243, 175–181. doi: 10.1016/j.jad.2018.09.015
Richardson, L. P., McCauley, E., Grossman, D. C., McCarty, C. A., Richards, J., Russo, J. E., et al. (2010). Evaluation of the patient health Questionnaire-9 item for detecting major depression among adolescents. Pediatrics 126, 1117–1123. doi: 10.1542/peds.2010-0852
Roberts, R. E., Lewinsohn, P. M., and Seeley, J. R. (1995). Symptoms of DSM-III-R major depression in adolescence: evidence from an epidemiological survey. J. Am. Acad. Child Adolesc. Psychiatry 34, 1608–1617. doi: 10.1097/00004583-199512000-00011
Romano, I., Ferro, M. A., Patte, K. A., and Leatherdale, S. T. (2022). Measurement invariance of the GAD-7 and CESD-R-10 among adolescents in Canada. J. Pediatr. Psychol. 47, 585–594. doi: 10.1093/jpepsy/jsab119
Sansone, R. A., Wiederman, M. W., and Sansone, L. A. (1998). The self-harm inventory (SHI): development of a scale for identifying self-destructive behaviors and borderline personality disorder. J. Clin. Psychol. 54, 973–983. doi: 10.1002/(sici)1097-4679(199811)54:7<973::aid-jclp11>3.0.co;2-h
Sheehan, D. V., Lecrubier, Y., Sheehan, K. H., Amorim, P., Janavs, J., Weiller, E., et al. (1998). The mini-international neuropsychiatric interview (MINI): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J. Clin. Psychiatry 59, 22–33.
Shin, H. K. (2003). Investigation on reliability and validity of the Korean children somatization inventory and somatic symptoms in elementary school children. Korean J. Clin. Psychol. 22, 569–586.
Shin, C., Ko, Y.-H., An, H., Yoon, H.-K., and Han, C. (2020). Normative data and psychometric properties of the patient health Questionnaire-9 in a nationally representative Korean population. BMC Psychiatry 20, 1–10. doi: 10.1186/s12888-020-02613-0
Spitzer, R. L., Kroenke, K., Williams, J. B., and Löwe, B. (2006). A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch. Intern. Med. 166, 1092–1097. doi: 10.1001/archinte.166.10.1092
Steenkamp, J.-B. E. M., and Baumgartner, H. (1998). Assessing measurement invariance in cross-national consumer research. J. Consum. Res. 25, 78–90. doi: 10.1086/209528
Stevanovic, D., Bagheri, Z., Atilola, O., Vostanis, P., Stupar, D., Moreira, P., et al. (2017). Cross-cultural measurement invariance of the revised child anxiety and depression scale across 11 world-wide societies. Epidemiol. Psychiatr. Sci. 26, 430–440. doi: 10.1017/S204579601600038X
Stewart, T. M., Fry, D., McAra, L., Hamilton, S., King, A., Laurie, M., et al. (2022). Rates, perceptions and predictors of depression, anxiety and post traumatic stress disorder (PTSD)-like symptoms about Covid-19 in adolescents. PLoS One 17:e0266818. doi: 10.1371/journal.pone.0266818
Tiirikainen, K., Haravuori, H., Ranta, K., Kaltiala-Heino, R., and Marttunen, M. (2019). Psychometric properties of the 7-item generalized anxiety disorder scale (GAD-7) in a large representative sample of Finnish adolescents. Psychiatry Res. 272, 30–35. doi: 10.1016/j.psychres.2018.12.004
Walker, L. S., Garber, J., and Greene, J. W. (1991). Somatization symptoms in pediatric abdominal pain patients relation to chronicity of abdominal pain and parent somatization. J. Abnorm. Child Psychol. 19, 379–394. doi: 10.1007/BF00919084
Weiss, B., and Garber, J. (2003). Developmental differences in the phenomenology of depression. Dev. Psychopathol. 15, 403–430. doi: 10.1017/s0954579403000221
Yoo, S.-W., Kim, Y.-S., Noh, J.-S., Oh, K.-S., Kim, C.-H., NamKoong, K., et al. (2006). Validity of Korean version of the mini-international neuropsychiatric interview. Anxiety Mood 2, 50–55.
Yoon, J., and Kim, J. (2019). Validation study of the Korean version of perceived stress scale for adolescents. Korean J. Health Psychol. 24, 569–586. doi: 10.17315/kjhp.2019.24.3.003
Yoon, S., Park, K., and Choi, K. H. (2020). The ultra brief checklist for suicidality. J. Affect. Disord. 276, 279–286. doi: 10.1016/j.jad.2020.07.037
Keywords: suicide risk, depression, anxiety, adolescence, validation, screening tool, public mental health, COVID-19
Citation: Hong E, Lee J, Yoon S, Cho S, Bahk Y-C, Choi J and Choi K-H (2025) Screening mental health risks for adolescents in South Korea. Front. Psychol. 16:1589136. doi: 10.3389/fpsyg.2025.1589136
Edited by:
Gudberg K. Jonsson, University of Iceland, IcelandReviewed by:
Fabio Bellia, University of Studies G. d’Annunzio Chieti and Pescara, ItalyŞeyma Erdem Torun, Yuksek Ihtisas Training and Research Hospital, Türkiye
Copyright © 2025 Hong, Lee, Yoon, Cho, Bahk, Choi and Choi. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Jeongwon Choi, ZG9jY2p3QG55cGkucmUua3I=; Kee-Hong Choi, a2Nob2kxQGtvcmVhLmFjLmty