Skip to main content

ORIGINAL RESEARCH article

Front. Psychiatry, 09 March 2023
Sec. Adolescent and Young Adult Psychiatry
This article is part of the Research Topic Psychometrics in Psychiatry 2022: Adolescent and Young Adult Psychiatry View all 7 articles

Psychometric properties of the Patient Health Questionnaire-4 among Hong Kong young adults in 2021: Associations with meaning in life and suicidal ideation

  • 1Centre on Behavioral Health, Faculty of Social Sciences, The University of Hong Kong, Pokfulam, Hong Kong SAR, China
  • 2Department of Social Work and Social Administration, Faculty of Social Sciences, The University of Hong Kong, Pokfulam, Hong Kong SAR, China
  • 3Centre for Suicide Research and Prevention, Faculty of Social Sciences, The University of Hong Kong, Pokfulam, Hong Kong SAR, China

Background: Young adults in Hong Kong are subject to elevated psychological distress given the societal stressors such as civil unrest and COVID-19 pandemic and suicide is a leading cause of death among them. The present study aimed to evaluate the psychometric properties and measurement invariance of the 4-item Patient Health Questionnaire-4 (PHQ-4) as a brief measure of psychological distress and its associations with meaning in life and suicidal ideation (SI) in young adults.

Materials and methods: A mobile survey recruited a large and random sample of 1,472 young adults (Mean age = 26.3 years, 51.8% males) in Hong Kong in 2021. The participants completed the PHQ-4 and Meaning in Life Questionnaire–short form (MLQ-SF) for presence of meaning in life (MIL), SI, COVID-19 impact, and exposure to suicide. Confirmatory factor analysis was conducted to examine the factorial validity, reliability, and measurement invariance of PHQ-4 and MLQ-SF across gender, age, and distress subgroups. Multigroup structural equation model evaluated and compared the direct and indirect effects of latent MIL factor on SI via latent PHQ-4 factor across distress groups.

Results: Both MIL and PHQ-4 supported a 1-factor model with good composite reliability (Ω = 0.80–0.86) and strong factor loadings (λ = 0.65–0.88). Both factors showed scalar invariance across gender, age, and distress groups. MIL showed significant and negative indirect effects (αβ = −0.196, 95% CI = −0.254 to −0.144) on SI via PHQ-4. PHQ-4 showed a stronger mediating role between MIL and SI in the distress group (Δ = −0.146, 95% CI = −0.252 to −0.049) than the non-distress group. Higher MIL predicted higher likelihoods of help-seeking (Odds ratios = 1.46, 95% CI = 1.14–1.88).

Conclusion: The present results support adequate psychometric properties in terms of factorial validity, reliability, convergent validity, and measurement invariance for the PHQ-4 in young adults in Hong Kong. The PHQ-4 demonstrated a substantial mediating role in the relationship between meaning in life and SI in the distress group. These findings support clinical relevance for using the PHQ-4 as a brief and valid measure of psychological distress in the Chinese context.

Introduction

Hong Kong has undergone both civil unrest and COVID-19 pandemic in the past years and these events act as societal stressors and predispose citizens to elevated levels of mental distress (1). Suicidal behavior (SB) is a leading cause of death among youths and young adults in Hong Kong (2). SB in adolescents and young adults is a global challenge that carries clinical relevance to various socio-economic factors (3) and reduced life expectancy (4). Epidemiological surveys in Hong Kong (5, 6) found the prevalence of probable depression and suicidal ideation (SI) to range from 11.2 to 25.7% and 4.3 to 9.1% among respondents sampled between 2019 and 2020. Common risk factors of SB in youths included depression, mental disorders, psychosocial stressors, and exposure to suicide (79).

The Interpersonal Theory of Suicide (10, 11) states that experiences of perceived burdensomeness and thwarted belongingness contribute to SI which could lead to SB and suicide attempt (SA) (12). Presence of meaning in life (MIL) refers to the subjective sense that one’s life is meaningful and Kleiman and Beaver (13) proposed MIL as a potential resiliency factor of SI. Recent studies have associated presence of MIL with lower psychological distress (14, 15) and lower risks of SI among adolescents (16, 17). Higher presence of MIL was associated with lower levels of SI and SB among suicidal patients attending a psychiatric emergency department (18). Costanza, Amerio (19) have postulated that MIL could mediate the relationships between perceived burdensomeness and thwarted belongingness with SI.

The Patient Health Questionnaire (PHQ-9) is a 9-item self-report measurement tool of depressive and somatic symptoms with good construct validity and diagnostic ability of major depression (2022). The shortened 4-item version of the PHQ-9 (PHQ-4) is an ultra-brief screening tool of mental distress over the past 2 weeks (23). The PHQ-4 comprises two items each from the PHQ-9 and the Generalized Anxiety Disorder scale. Though the PHQ-4 has been validated in cultural contexts such as Greek, Korean, and German samples (2426), no existing studies have validated the psychometric properties of the PHQ-4 in the Chinese context. Besides, it is important to examine the stability of the measurement parameters of PHQ-4 across demographic groups. Equality of factor loadings and item thresholds are prerequisites to compare the latent mean of PHQ-4 factor across groups in an unbiased manner (27). Despite the established relationships among MIL, psychological distress, and SI, no existing studies have examined the potential mediating role of PHQ-4 between MIL and SI.

In light of the research gaps, the present study conducted a systematic evaluation of the psychometric properties of the PHQ-4 in a large sample of Chinese young adults in Hong Kong. This study had several hypotheses. In Hypothesis 1, the PHQ-4 and MIL factors would show satisfactory factorial validity and reliability. In Hypothesis 2, both factors would show measurement invariance across demographic groups. In Hypothesis 3, the PHQ-4 factor would display adequate convergent validity in terms of negative correlations with MIL and positive correlations with COVID-19 impact, exposure to suicide, and SI. In Hypothesis 4, the PHQ-4 would partially mediate the relationship between MIL and SI. The first objective was to examine the factorial validity and reliability of the PHQ-4 and MIL. The second objective was to test the measurement invariance of the PHQ-4 and MIL across gender, age, and distress groups. The third objective aimed to examine the mediating role of PHQ-4 in the relationship between MIL and SI. The fourth objective was to examine the associated factors of help-seeking behaviors among distressed respondents.

Materials and methods

Study design and procedures

The present cross-sectional study recruited young adults under random sampling via a phone survey. The survey was part of the surveillance research on the youth mental wellness under the OpenUp project. OpenUp is a 24-h emotional support program that provides online text-based counseling service for youth and young adults (28, 29). Inclusion criteria included residence in Hong Kong, aged between 18 and 36, able to understand spoken Cantonese. The telephone survey was administered by the Social Science Research Centre in the University of Hong Kong. Using mobile number prefixes published by the Office of the Communications Authority in Hong Kong, a random sample of 125,746 mobile phone numbers was generated. The computer assisted telephone interviewing system was used to contact potential respondents from 18:30 to 22:30 in the weekdays. The telephone interviewers were fluent in Cantonese and received prior trainings for conducting the interviews. Robust quality control was used to check the validity of telephone interviews for self-report measurements via audio recording and random callbacks.

The survey successfully completed 1,501 phone interviews between August and December 2021. The survey response rate was 68.9% with 544 refusals and 132 uncompleted interviews. The final study sample was 1,472 respondents after excluding 29 participants who were aged below 18 years. The participants provided oral informed consent before answering a self-report questionnaire on phone in around 5 min. Participation in the survey was voluntary and all information provided by the participants was kept strictly confidential. The respondents were provided contact information of 24-h hotlines and online services for emotional support in case they felt distressed during the interview. Ethical approval for this project was obtained from the Human Research Ethics Committee of the author’s university (Reference number: EA1709039).

Measures

The PHQ-4 is an international brief screening scale for anxiety and depressive symptoms (23) and has been used widely in the general population (24, 26, 30) and various clinical samples (25, 3133). This scale assessed four symptoms of mental distress of the respondents over the past 2 weeks. An example item was “feeling down, depressed or hopeless.” The items were answered on a 4-point Likert scale from 0 = “not at all” to 3 = “nearly every day.” The Chinese version of the PHQ-9 has been validated in a community sample of 1,045 adults in China (34). The total PHQ-4 score has a theoretical range from 0 to 12, with higher scores denoting greater distress. In the present sample, all four PHQ-4 items showed positive skewness (0.81–1.58) and substantial floor effects with 30.4–62.4% of the respondents endorsing the minimum category. They were treated as ordinal categorical variables in subsequent analyses.

Meaning in life was assessed by the Presence subscale of the 6-item short form of the Meaning in Life Questionnaire (MLQ-SF) (35). This subscale consisted of three items on the presence of MIL. An example item was “My life has a clear sense of purpose.” The three items were rated on a 7-point Likert scale from 1 = “absolutely untrue” to 7 = “absolutely true” and the total MIL score were derived by averaging the three item scores. In the present sample, the three MLQ-SF items followed a normal continuous distribution (skewness = −0.30 to 0.05) without any floor or ceiling effects. The Chinese version of the MLQ-SF has recently been validated in student samples in Hong Kong (36).

The questionnaire inquired demographic characteristics such as gender, age, and student status. The impact of COVID-19 was measured by asking the respondents the extent they were distressed by the pandemic on a 5-point Likert scale from 1 (not at all) to 5 (severe). SI was assessed by asking whether they had considered suicide in the past 12 weeks; and exposure to suicide was assessed by asking whether they personally knew someone who attempted suicide before. The respondents were asked whether they encountered any distressing issues in the past 4 weeks, and if yes, they were asked a follow-up question on whether they had sought help for the distressing issues (37).

Data analysis

Descriptive statistics and polychoric correlations of the MLQ-SF and PHQ-4 items were obtained. The dataset had minimal missing data except for one MIL and PHQ-4 item. Missing data were handled using full information maximum likelihood under the missing-at-random assumption (38). Psychometric properties of the PHQ-4 and MLQ-SF were examined in four steps. First, their factorial validity was evaluated by confirmatory factor analysis (CFA). The 2-factor CFA model was estimated under the robust weighted least square estimator in Mplus 8.6. One residual covariance was added between the two anxiety items of the PHQ-4 based on theoretical justifications. Model fit was evaluated using the following criteria on the fit indices (39): comparative fit index (CFI) ≥ 0.95, Tucker-Lewis index (TLI) ≥ 0.95, root-mean-square error of approximation (RMSEA) ≤ 0.06, and standardized root mean square residuals (SRMR) ≤ 0.06. Composite reliability of the factors was evaluated via McDonald Omega (Ω) with values of at least 0.75 indicating good reliability.

The second step evaluated the measurement invariance of the PHQ-4 and MLQ-SF across gender, age (youths and young adults), and distress groups. Configural invariance models were estimated using multiple-group CFA under robust weighted least square estimator as the baseline model. In the configural model, different factor loadings and thresholds/intercepts were estimated for the items across groups. These parameters were constrained to be equal across the groups in the scalar invariance model (27). Model comparison was conducted via the chi-square difference test and the change in model fit indices (40). A decrease of less than 0.01 for ΔCFI and an increase of less than 0.01 for ΔRMSEA and ΔSRMR constituted support for scalar measurement invariance (41). Structural invariance tests examined the equality of factor means across groups. Model identification was achieved by fixing the factor loading at one and comparison of latent means was based on a standardized metric. Third, convergent validity of the PHQ-4 factor was examined via its bivariate correlations with the MIL factor, COVID-19 impact, exposure to suicide, self-report distress, and SI. We compared the profiles of participants with and without self-report distress via chi-square test and independent t-tests using SPSS 26. Effect sizes were indicated by Cohen d (42) with cut-off scores of 0.2, 0.5, and 0.8 denoting small, moderate, and large effect sizes, respectively. Statistical significance was set at the 0.05 in the present study.

The fourth step investigated the mediating role of PHQ-4 in the relationship between MIL and SI. Direct and indirect effects of MIL on SI via PHQ-4 were evaluated using structural equation modeling (SEM), where the MIL factor, PHQ-4 factor, and SI were specified as latent predictor, latent mediator, and binary outcome, respectively. Gender, age, student status, COVID-19 impact, and exposure to suicide were included as control variables. R-square denoted the proportion of explained variance of the dependent variables. To account for the likely skewed distribution, the indirect effects were estimated using 10,000 bootstrap draws and regarded as statistically significant if the 95% confidence interval (CI) excluded zero. The total natural indirect effect and pure natural direct effect were presented as odds ratios (OR) for the binary SI based on counterfactuals (43). Multigroup SEM was performed to compare the indirect effects of MIL on SI via PHQ-4 across the non-distress and distress groups. Logistic regression was performed to examine the factors associated with help-seeking among distressed respondents.

Results

Sample profile of young adults

Table 1 reports the sample profiles and item descriptive statistics. Half of the sample (51.7%) were males with a mean age of 26.3 years (SD = 3.78). One-tenth (10.1%) of the respondents reported SI and 31.2% of them personally knew someone who attempted suicide before. Half (51.6%) of them encountered distressing issues in the past 4 weeks and 84.7% of them had sought help for the distress. The sample reported average total scores of 2.72 (SD = 2.42) and 4.38 (SD = 1.35) for PHQ-4 and MIL, respectively. SI was negatively correlated with the MIL items (r = −0.28 to −0.33, p < 0.01) and positively correlated with COVID impact, exposure to suicide, and the PHQ-4 items (r = 0.20–0.55, p < 0.01).

TABLE 1
www.frontiersin.org

Table 1. Descriptive statistics and polychoric correlations of the study variables in the sample.

CFA results and measurement invariance

As shown in Table 2, the 2-factor CFA model provided a good approximate fit to the data. The significant chi-square test (p < 0.01) could be attributed to the relatively large sample size (N > 1,000). Substantial factor loadings were found for the PHQ-4 (λ = 0.65–0.88, p < 0.01) and MIL (λ = 0.79–0.85, p < 0.01) factors with satisfactory composite reliability (Ω = 0.80–0.86). There was a significant residual correlation (r = 0.45, p < 0.01) between the two PHQ-4 anxiety items. The configural invariance models provided adequate model fit across gender, age, and distress groups. The chi-square difference tests were significant across gender (χ2 = 33.3, df = 14, p < 0.01) but not across age and distress groups (χ2 = 19.4–24.1, df = 14, p = 0.05–0.15). The scalar invariance models did not show deteriorated fit indices with ΔCFI, ΔRMSEA, and ΔSRMR all falling within ± 0.01. Females showed significantly higher latent means in PHQ-4 and MIL (d = 0.15–0.24, p < 0.01) than males. Young adults showed significantly lower latent means in PHQ-4 (d = 0.18, p < 0.01) and higher latent means in MIL (d = 0.21, p < 0.01) than youths. The distress group showed significantly higher latent means in PHQ-4 (d = 1.34, p < 0.01) and lower latent means in MIL (d = 0.39, p < 0.01) than non-distress group.

TABLE 2
www.frontiersin.org

Table 2. Fit indices of CFA and SEM of meaning in life and Patient Health Questionnaire-4 in the overall sample and across subgroups.

Convergent validity of PHQ-4 and MIL

The PHQ-4 and MIL factors were negatively and moderately correlated (r = −0.41, p < 0.01). The PHQ-4 factor was positively correlated with COVID impact (r = 0.19, p < 0.01), exposure to suicide (r = 0.19, p < 0.01), and SI (r = 0.59, p < 0.01). As Table 3 shows, significantly more participants in the distress group were exposed to suicide and had SI (χ2 = 40.9–58.3, p < 0.01) than the non-distress group. There were significant and small group differences (d = 0.21–0.38, p < 0.01) in terms of age, COVID-19 impact, and MIL. The distress group showed substantially higher levels (d = 0.88, p < 0.01) of PHQ-4 than the non-distress group.

TABLE 3
www.frontiersin.org

Table 3. Comparison of the profiles across participants with and without self-report distress in the past 4 weeks.

Results of mediation analysis

As shown in Table 2, the SEM provided an adequate fit to the overall sample. Females showed higher levels of MIL and PHQ-4 (β = 0.15–0.17, p < 0.05). Age was positively associated with MIL (β = 0.04, p < 0.01). Student status was not significantly associated (p = 0.18–0.78) with the study variables. COVID-19 impact was associated with higher levels of PHQ-4 (β = 0.11, p < 0.01) and lower levels of MIL (β = −0.13, p < 0.01). Exposure to suicide was positively associated with PHQ-4 and SI (β = 0.30–0.44, p < 0.01). MIL showed a negative effect on PHQ-4 (β = −0.43, p < 0.01) and PHQ-4 had a positive effect on SI (β = 0.45, p < 0.01). The model explained 21.0 and 41.3% of the variances of PHQ-4 and SI, respectively. Table 4 lists the direct and indirect effects and associated odds ratios of MIL on SI via PHQ-4 in the overall SEM. MIL showed significant and negative direct and indirect effects on SI via PHQ-4. The PHQ-4 factor accounted for 53.7% of the total effect of MIL on SI.

TABLE 4
www.frontiersin.org

Table 4. Direct and indirect effects and associated odds ratios from meaning in life to suicidal ideation via PHQ-4 in the overall structural equation model and across distress groups.

Figure 1 depicts the factor loadings and regression paths among MIL, PHQ-4, and SI in the multigroup SEM. The negative effect of MIL on PHQ-4 was significantly stronger (Δ = −0.174, p = 0.028) in the distress group than the non-distress group. The distress group showed a significantly stronger positive effect of PHQ-4 on SI (Δ = 0.233, p = 0.039) than the non-distress group. As Table 4 shows, the distress group showed a significantly stronger indirect effect of MIL on SI via PHQ-4 (Δ = −0.146, 95% CI = −0.252 to −0.049) than the non-distress group. The negative direct effect of MIL factor on SI was not statistically significant (Δ = 0.105, 95% CI = −0.121 to 0.335) across the two groups. The PHQ-4 factor accounted for 19.7 and 57.9% of the total effect of MIL on SI in the non-distress and distress groups, respectively.

FIGURE 1
www.frontiersin.org

Figure 1. Path coefficients from meaning in life to suicidal ideation (SI) via PHQ-4 in structural equation model across non-distress and distress groups. PHQ-4, Patient Health Questionnaire-4; the regression paths and factor loadings in the non-distress and distress groups are shown in blue and red, respectively. Regression paths among the latent variables and SI are bolded and the indirect effects from meaning in life to SI via PHQ-4 are highlighted in green.

Associated factors of help-seeking in the distress group

As shown in Table 5, females were significantly associated with a higher likelihood of help-seeking (90.7%) than males (78.9%). Age, student status, COVID-19 impact, exposure to suicide, PHQ-4, and SI were not significantly associated (p = 0.50–0.99) with help-seeking behaviors. Higher MIL was significantly associated with a higher likelihood of help-seeking.

TABLE 5
www.frontiersin.org

Table 5. Logistic regression of help-seeking behaviors on associated factors in the distress group.

Discussion

The present study systematically evaluated the psychometric properties of the PHQ-4 in a large random sample of young adults in Hong Kong. The CFA results demonstrated factorial validity and reliability of the PHQ-4 and MIL factors and supported Hypothesis 1. Consistent with recent studies (2426, 35), the PHQ-4 and MIL factors showed scalar measurement invariance across gender and age. This lends empirical support to Hypothesis 2. In addition, both factors demonstrated scalar measurement invariance across distress groups in the Chinese context. The scalar measurement invariance enables unbiased and meaningful comparisons of the latent levels between young adults with and without distress. The PHQ-4 factor showed significant correlations with MIL, SI, COVID impact, and exposure to suicide in the expected directions. The large differences in the latent and observed PHQ-4 scores across the distress groups support Hypothesis 3 in terms of adequate convergent validity. The SEM results provided evidence for Hypothesis 4 and the PHQ-4 mediated around half of the total effect from MIL to SI in the overall sample.

Consistent with previous findings (13, 18, 19), our findings provided empirical support on the protective role of presence of MIL against SI. The findings not only demonstrate the potential clinical relevance of using PHQ-4 as a brief and direct screening tool of SI, but also inform clinical practice on refinement of SB risk assessment via a meaning-oriented approach (44). Multigroup SEM revealed significantly greater negative indirect effects of MIL on SI via PHQ-4 in the distress group than the non-distress group. This finding implies a stronger mediating role for PHQ-4 in the distress group, in which over half of the prevention effect of SI could be attributed to the capacity of MIL to lower the psychological distress. In comparison, the PHQ-4 only accounted for one-fifth of the effect of MIL on SI in the non-distress group. Compared to the PHQ-4, the three MIL questions inquired the general well-being of the respondents and MIL could be more relevant to the general population with comparably better mental health. More than half of the young adults encountered distressing issues in the past 4 weeks and the majority of them had sought help for their distress. One should note that the prevalence of suicide ideation in the distress group was four times as high as in the non-distress group. The increased exposure to suicide, greater COVID-19 impact, and lower MIL point to greater service needs for these distressed individuals.

The present findings have important implications that could influence and clinically guide the practical implications. COVID-19 impact was found to be indirectly related to mental health distress via MIL in a recent study (14). Our findings contributed to the literature by demonstrating that elevated levels of psychological distress further led to SI. In a study among 1,477 psychiatric inpatients in Switzerland (45), distinct pandemic-related fear patterns could manifest during lockdown periods under the COVID-19 pandemic in the form of loneliness and isolation, loss of work, feelings of powerlessness. COVID-19 related fears could act as an underlying source of psychological distress and lead to mental health symptoms. Another large-scale study among 8,177 university students in Italy (46) found social isolation due to the pandemic to contribute to psychological distress in young people. The mental health symptoms could be linked to interpersonal factors in the young adults related to suicidality.

In contrast to previous findings (47), help-seeking behaviors were not significantly associated with SI and PHQ-4 in the distress group. Rather than shortage of mental health professionals, lack of perceived needs for treatment could be the primary reason why persons with psychological distress chose not to seek help (48). Suicide stigma could act as barriers to seek help among the distressed individuals (49). Nguyen, Le (47) found informal and formal help-seeking to be negatively and positively associated with SI, respectively. It would be of practical importance to distinguish the patterns and motives of different help-seeking behaviors (37). Given the potential benefits of online help-seeking behaviors to bridge barriers to traditional help-seeking (48), tailored preventive strategies are recommended to evaluate the feasibility of providing early intervention for the vulnerable youths via online emotional support programs. Magson, Freeman (50) examined the protective factors for temporal changes in mental health of the adolescents during the COVID-19 pandemic. Future longitudinal studies could explore the moderating role of MIL (5153) on other protective factors such as resilience (54) in the progression of SI (55) and development of SA (56).

The present study has a number of strengths. First, young people are often prone to question the value system and MIL could contribute substantially to their well-being (57). Despite the potential importance and clinical implications, the relationship between MIL and SI remains undervalued in the current literature. The present study addressed a topical research question by focusing on the population of young adults as one of the vulnerable groups with regard to SI and SB under the COVID-19 pandemic. Second, we recruited a large sample of young adults via random sampling in Hong Kong. The random sampling design and moderately high response rate lent support to the representativeness of the sample. Third, SEM is a latent variable modeling technique that accounts for the measurement errors of the constructs and offers more precise estimates of the regression coefficients. Since ignored measurement errors in the mediator could distort the direct and indirect effects, the use of factor analysis model for multiple indicators of the MIL and PHQ-4 as latent variables strengthened the credibility of the results (43).

Several limitations should be noted about the present study. First, cross-sectional study design did not permit examination of the test-retest reliability and temporal stability of the factor structure. Longitudinal studies are recommended to explore the longitudinal measurement invariance of the PHQ-4 and track the temporal change in PHQ-4 over time. Second, the sample respondents only reported SI but not SA. A large-scale cohort study found that exposure to self-harm in others and diagnosis of psychiatric disorder differentiated the suicide attempters from the suicide ideators (58). Future longitudinal studies are needed to differentiate between suicide ideators and suicide attempters and elucidate risk factors that contribute to progression from SI to SA. Third, the present study focused only on young adults and our results may not be generalized to other age groups. Future studies are needed to elucidate the potential protective role of MIL as a resiliency factor to SI among older adults as in Beach et al. (59) and Heisel et al. (60).

Fourth, the present sample only completed the PHQ-4 but not the PHQ-9. We could not test the comparability of the PHQ-4 and PHQ-9 scores. The phone sampling design did not allow us to assess the criterion validity of the PHQ-4. Further studies are needed to compare the diagnostic ability of the PHQ-4 on psychiatric morbidity with other established scales. Fifth, the present SEM only controlled for the effects of COVID-19 impact, exposure to suicide, and self-report distress. Future studies should include other risk factors of suicide such as bullying victimization and self-harm. Sixth, the impact of COVID-19 on the respondents was only assessed via a single item, which was subject to concerns such as unreliability and low content validity. Validated scales such as the Tokyo Metropolitan Distress Scale for Pandemic (61) and Mental Impact and Distress Scale: COVID-19 (62) should be used as reliable measurement of pandemic-specific impact.

Conclusion

The present study contributes to a better understanding of the psychometric properties of the PHQ-4 in a large sample of young adults in Hong Kong. The results provide empirical support for adequate factorial validity, reliability, convergent validity, and scalar measurement invariance across gender, age, and distress groups. The PHQ-4 factor demonstrated a substantial mediating role in the relationship between MIL and SI in the overall sample and the distress group. The use of PHQ-4 is recommended as a valid and reliable measure of general psychological distress in future studies in the Chinese context.

Data availability statement

The original contributions presented in this study are included in the article/Supplementary material, further inquiries can be directed to the corresponding authors.

Ethics statement

The studies involving human participants were reviewed and approved by Human Research Ethics Committee of the University of Hong Kong (HREC Number = EA1709039). The patients/participants provided their written informed consent to participate in this study.

Author contributions

TF: conceptualization, data curation, formal analysis, literature review, methodology, validation, visualization, and writing—original draft. RH: conceptualization, software, resources, and writing—review and editing. PY: conceptualization, investigation, project administration, methodology, writing—review and editing, supervision, and funding acquisition. All authors contributed to the article and approved the submitted version.

Funding

This study was supported by the Hong Kong Jockey Club Charities Trust, the General Research Fund grant (GRF/HKU 17606521) and the Collaborative Research Fund (C7151-20GF) of the Research Grants Council. The funding organization had no role in the study design, collection, analysis and interpretation of data, in the writing of the manuscript, and in the decision to submit the manuscript for publication.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyt.2023.1138755/full#supplementary-material

References

1. Hou W, Lee T, Liang L, Li T, Liu H, Ettman C, et al. civil unrest, Covid-19 stressors, anxiety, and depression in the acute phase of the pandemic: a population-based study in Hong Kong. So Psychiatry Psychiatr Epidemiol. (2021) 56:1499–508. doi: 10.1007/s00127-021-02037-5

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Chen Y, Yang C, Pinkney E, Yip P. The age-period-cohort trends of suicide in Hong Kong and Taiwan, 1979-2018. J Affect Disord. (2021) 295:587–93. doi: 10.1016/j.jad.2021.08.084

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Cai Z, Chen M, Ye P, Yip P. Socio-economic determinants of suicide rates in transforming China: a spatial-temporal analysis from 1990 to 2015. Lancet Reg Health Western Pac. (2022) 19:100341. doi: 10.1016/j.lanwpc.2021.100341

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Sagna A, Kemp M, DiNitto D, Choi N. Impact of suicide mortality on life expectancy in the United States, 2011 and 2015: age and sex decomposition. Public Health. (2020) 179:76–83. doi: 10.1016/j.puhe.2019.09.024

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Hou W, Hall B, Liang L, Li T, Liu H, Galea S. Probable depression and suicidal ideation in Hong Kong amid massive civil unrest. Ann Epidemiol. (2021) 54:45–51. doi: 10.1016/j.annepidem.2020.09.006

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Ni M, Yao X, Leung K, Yau C, Leung C, Lun P, et al. Depression and post-traumatic stress during major social unrest in Hong Kong: a 10-year prospective cohort study. Lancet. (2020) 395:273–84. doi: 10.1016/S0140-6736(19)33160-5

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Gijzen M, Rasing S, Creemers D, Smit F, Engels R, De Beurs D. Suicide ideation as a symptom of adolescent depression. A network analysis. J Affect Disord. (2021) 278:68–77. doi: 10.1016/j.jad.2020.09.029

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Bilsen J. Suicide and youth: risk factors. Front Psychiatry. (2018) 9:540. doi: 10.3389/fpsyt.2018.00540

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Sahimi H, Mohd Daud T, Chan L, Shah S, Rahman F, Nik Jaafar N. Depression and suicidal ideation in a sample of Malaysizan healthcare workers: a preliminary study during the Covid-19 pandemic. Front Psychiatry. (2021) 12:658174. doi: 10.3389/fpsyt.2021.658174

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Van Orden K, Witte T, Cukrowicz K, Braithwaite S, Selby E, Joiner T. The interpersonal theory of suicide. Psychol Rev. (2010) 117:575–600. doi: 10.1037/a0018697

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Chu C, Buchman-Schmitt J, Stanley I, Hom M, Tucker R, Hagan C, et al. The interpersonal theory of suicide: a systematic review and meta-analysis of a decade of cross-national research. Psychol Bull. (2017) 143:1313–45. doi: 10.1037/bul0000123

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Joiner T. Why People Die by Suicide. Cambridge, MA: Harvard University Press (2005).

Google Scholar

13. Kleiman E, Beaver JKA. Meaningful life is worth living: meaning in life as a suicide resiliency factor. Psychiatry Res. (2013) 210:934–9. doi: 10.1016/j.psychres.2013.08.002

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Yu Y, Yu Y, Hu J. Covid-19 among Chinese high school graduates: psychological distress, growth, meaning in life and resilience. J Health Psychol. (2022) 27:1057–69. doi: 10.1177/1359105321990819

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Schnell T, Krampe H. Meaning in life and self-control buffer stress in times of Covid-19: moderating and mediating effects with regard to mental distress. Front Psychiatry. (2020) 11:582352. doi: 10.3389/fpsyt.2020.582352

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Lew B, Chistopolskaya K, Osman A, Huen J, Abu Talib M, Leung A. Meaning in life as a protective factor against suicidal tendencies in Chinese university students. BMC Psychiatry. (2020) 20:73. doi: 10.1186/s12888-020-02485-4

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Aviad-Wilchek Y, Ne’eman-Haviv V. The relation between a sense of meaning in life and suicide potential among disadvantaged adolescent girls. Int J Off Ther Comp Criminol. (2018) 62:1474–87. doi: 10.1177/0306624x16684566

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Costanza A, Baertschi M, Richard-Lepouriel H, Weber K, Pompili M, Canuto A. The presence and the search constructs of meaning in life in suicidal patients attending a psychiatric emergency department. Front Psychiatry. (2020) 11:327. doi: 10.3389/fpsyt.2020.00327

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Costanza A, Amerio A, Aguglia A, Serafini G, Amore M. Meaning in life and demoralization constructs in light of the interpersonal theory of suicide: a trans-theoretical hypothesis for a cross-sectional study. Psychol Res Behav Manag. (2020) 13:855–8. doi: 10.2147/PRBM.S279829

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Lowe B, Unutzer J, Callahan C, Perkins A, Kroenke K. Monitoring depression treatment outcomes with the patient health questionnaire-9. Med Care. (2004) 42:1194–201. doi: 10.1097/00005650-200412000-00006

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Kaggwa M, Najjuka S, Ashaba S, Mamun M. Psychometrics of the patient health questionnaire (Phq-9) in Uganda: a systematic review. Front Psychiatry. (2022) 13:781095. doi: 10.3389/fpsyt.2022.781095

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Leonhart R, de Vroege L, Zhang L, Liu Y, Dong Z, Schaefert R, et al. Comparison of the factor structure of the patient health questionnaire for somatic symptoms (Phq-15) in Germany, the Netherlands, and China. A transcultural structural equation modeling (Sem) study. Front Psychiatry. (2018) 9:240. doi: 10.3389/fpsyt.2018.00240

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Kroenke K, Spitzer R, Williams J, Lowe B. An ultra-brief screening scale for anxiety and depression: the Phq-4. Psychosomatics. (2009) 50:613–21. doi: 10.1176/appi.psy.50.6.613

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Christodoulaki A, Baralou V, Konstantakopoulos G, Touloumi G. Validation of the patient health questionnaire-4 (Phq-4) to screen for depression and anxiety in the Greek general population. J Psychosom Res. (2022) 160:110970. doi: 10.1016/j.jpsychores.2022.110970

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Kim H, Shin C, Lee S, Han C. Standardization of the Korean version of the patient health questionnaire-4 (Phq-4). Clin Psychopharmacol Neurosci. (2021) 19:104–11. doi: 10.9758/cpn.2021.19.1.104

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Wicke F, Krakau L, Loewe B, Beutel M, Braehler E. Update of the standardization of the patient health questionnaire-4 (Phq-4) in the general population. J Affect Disord. (2022) 312:310–4. doi: 10.1016/j.jad.2022.06.054

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Van de Schoot R, Lugtig P, Hox JA. Checklist for Testing measurement invariance. Eur J Dev Psychol. (2012) 9:486–92. doi: 10.1080/17405629.2012.686740

CrossRef Full Text | Google Scholar

28. Yip P, Chan W, Cheng Q, Chow S, Hsu S, Law Y, et al. A 24-hour online youth emotional support: opportunities and challenges. Lancet Reg Health West Pac. (2020) 4:100047. doi: 10.1016/j.lanwpc.2020.100047

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Yip P, Chan W, Chan C, He L, Xu Y, Chan E, et al. The opportunities and challenges of the first three years of open up, an online text-based counselling service for youth and young adults. Int J Environ Res Public Health. (2021) 18:13194. doi: 10.3390/ijerph182413194

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Lowe B, Wahl I, Rose M, Spitzer C, Glaesmer H, Wingenfeld K, et al. A 4-item measure of depression and anxiety: validation and standardization of the patient health questionnaire-4 (Phq-4) in the general population. J Affect Disord. (2010) 122:86–95. doi: 10.1016/j.jad.2009.06.019

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Ahmadi SM, Masjedi Arani A, Bakhtiari M, Davazdah Emamy MH. Psychometric properties of Persian version of patient Health questionnaires-4 (PHQ-4) in coronary heart disease patients. Iran J Psychiatry Behav Sci. (2019) 13:e85820. doi: 10.5812/ijpbs.85820

CrossRef Full Text | Google Scholar

32. Renovanz M, Soebianto S, Tsakmaklis H, Keric N, Nadji-Ohl M, Beutel M, et al. Evaluation of the psychological burden during the early disease trajectory in patients with intracranial tumors by the ultra-brief patient health questionnaire for depression and anxiety (Phq-4). Supportive Care Cancer. (2019) 27:4469–77. doi: 10.1007/s00520-019-04718-z

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Weihs K, Wiley J, Crespi C, Krull J, Stanton A. Predicting future major depression and persistent depressive symptoms: development of a prognostic screener and Phq-4 cutoffs in breast cancer patients. Psychooncology. (2018) 27:420–6. doi: 10.1002/pon.4472

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Wang W, Bian Q, Zhao Y, Li X, Wang W, Du J, et al. Reliability and validity of the Chinese version of the patient health questionnaire (Phq-9) in the general population. Gen Hosp Psychiatry. (2014) 36:539–44. doi: 10.1016/j.genhosppsych.2014.05.021

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Steger M, Samman E. Assessing meaning in life on an international scale: psychometric evidence for the meaning in life questionnaire-short form among Chilean households. Int J Wellbeing. (2012) 2:182–95. doi: 10.5502/ijw.v2.i3.2

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Yuen, M, Chan R, Wong S, Yau J, Zhang J, Ho E, et al. Appropriateness of the dispositional hope scale (Dhs) and meaning in life questionnaire: short form (Mlq-Sf) for use with regular and gifted students in Hong Kong. High Ability Stud. (2022) 1–13. doi: 10.1080/13598139.2022.2159336

CrossRef Full Text | Google Scholar

37. Junus A, Yip P. Suicide risk profile and the social convoy: population-level patterns of the young generation’s help-seeking behavior and implications for suicide prevention. J Affect Disord. (2022) 297:559–69. doi: 10.1016/j.jad.2021.10.106

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Little R, Rubin D. Statistical Analysis with Missing Data. 3rd ed. New York, NY: John Wiley & Sons (2019).

Google Scholar

39. Hu L, Bentler P. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model. (1999) 6:1–55. doi: 10.1080/10705519909540118

CrossRef Full Text | Google Scholar

40. Cheung G, Rensvold R. Evaluating goodness-of-fit indexes for testing measurement invariance. Struct Equ Model. (2002) 9:233–55. doi: 10.1207/S15328007SEM0902_5

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Chen F. Sensitivity of goodness of fit indexes to lack of measurement invariance. Struct Equ Model. (2007) 14:464–504. doi: 10.1080/10705510701301834

CrossRef Full Text | Google Scholar

42. Cohen J. Statistical Power Analysis for the Behavioral Sciences. 2nd ed. Hillsdale, NJ: Lawrence Erlbaum Associates (1988).

Google Scholar

43. Muthén B, Asparouhov T. Causal effects in mediation modeling: an introduction with applications to latent variables. Struct Equ Model. (2015) 22:12–23. doi: 10.1080/10705511.2014.935843

CrossRef Full Text | Google Scholar

44. Liu Y, Usman M, Zhang J, Raza J, Gul H. Making sense of Chinese employees’ suicide ideation: does meaning in life matter? Omega. (2021) 83:212–38. doi: 10.1177/0030222819846721

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Costanza A, Macheret L, Folliet A, Amerio A, Aguglia A, Serafini G, et al. Covid-19 related fears of patients admitted to a psychiatric emergency department during and post-lockdown in Switzerland: preliminary findings to look ahead for tailored preventive mental health strategies. Medicina. (2021) 57:1360. doi: 10.3390/medicina57121360

PubMed Abstract | CrossRef Full Text | Google Scholar

46. Amerio A, Bertuccio P, Santi F, Bianchi D, Brambilla A, Morganti A, et al. Gender differences in Covid-19 lockdown impact on mental health of undergraduate students. Front Psychiatry. (2022) 12:813130. doi: 10.3389/fpsyt.2021.813130

PubMed Abstract | CrossRef Full Text | Google Scholar

47. Nguyen M, Le T, Nguyen H, Ho M, Nguyen H, Vuong Q. Alice in Suicideland: exploring the suicidal ideation mechanism through the sense of connectedness and help-seeking behaviors. Int J Environ Res Public Health. (2021) 18:3681. doi: 10.3390/ijerph18073681

PubMed Abstract | CrossRef Full Text | Google Scholar

48. Wong K, Chan C, Chan M, Wong C, Cheng Q, Xiong C, et al. Who seeks help online? Comparing online and offline help-seeking preferences amongst youths with suicidal ideation. J Affect Disord. (2021) 292:21–9. doi: 10.1016/j.jad.2021.05.056

PubMed Abstract | CrossRef Full Text | Google Scholar

49. Fong T, Yip P, Chan M, Ho R. Factor structure and measurement invariance of the stigma of suicide scale – short form among adolescents and early adults in Hong Kong. Assessment. (2022) 29:285–95. doi: 10.1177/1073191120976857

PubMed Abstract | CrossRef Full Text | Google Scholar

50. Magson N, Freeman J, Rapee R, Richardson C, Oar E, Fardouly J. Risk and protective factors for prospective changes in adolescent mental health during the Covid-19 pandemic. J Youth Adolesc. (2021) 50:44–57. doi: 10.1007/s10964-020-01332-9

PubMed Abstract | CrossRef Full Text | Google Scholar

51. Corona C, Van Orden K, Wisco B, Pietrzak R. Meaning in life moderates the association between morally injurious experiences and suicide ideation among us combat veterans: results from the national health and resilience in veterans study. Psychol Trauma. (2019) 11:614–20. doi: 10.1037/tra0000475

PubMed Abstract | CrossRef Full Text | Google Scholar

52. Marco J, Canabate M, Llorca G, Perez S. Meaning in life moderates hopelessness, suicide ideation, and borderline psychopathology in participants with eating disorders: a longitudinal study. Clin Psychol Psychother. (2020) 27:146–58. doi: 10.1002/cpp.2414

PubMed Abstract | CrossRef Full Text | Google Scholar

53. Wang, Z, Wang X, Peng Y, Liu C, He J. Recalled childhood maltreatment and suicide risk in Chinese college students: the mediating role of psychache and the moderating role of meaning in life. J Adult Dev. (2022) 30. doi: 10.1007/s10804-022-09422-7

CrossRef Full Text | Google Scholar

54. Rossi R, Jannini T, Socci V, Pacitti F, Lorenzo G. Stressful life events and resilience during the covid-19 lockdown measures in Italy: association with mental health outcomes and age. Front Psychiatry. (2021) 12:635832. doi: 10.3389/fpsyt.2021.635832

PubMed Abstract | CrossRef Full Text | Google Scholar

55. Fong T, Cheng Q, Yip P. Change in suicidal ideation and associated factors among young adults in Hong Kong from 2018 to 2019: a latent transition analysis. Soc Psychiatry Psychiatr Epidemiol. (2021) 57:1027–38. doi: 10.1007/s00127-021-02203-9

PubMed Abstract | CrossRef Full Text | Google Scholar

56. Sinclair S, Bryan C, Bryan A. Meaning in life as a protective factor for the emergence of suicide ideation that leads to suicide attempts among military personnel and veterans with elevated Ptsd and depression. Int J Cogn Ther. (2016) 9:87–98. doi: 10.1521/ijct.2016.9.1.87

CrossRef Full Text | Google Scholar

57. Krok D. When is meaning in life most beneficial to young people? Styles of meaning in life and well-being among late adolescents. J Adult Dev. (2018) 25:96–106. doi: 10.1007/s10804-017-9280-y

PubMed Abstract | CrossRef Full Text | Google Scholar

58. Mars B, Heron J, Klonsky ED, Moran P, O’Connor R, Tilling K, et al. What distinguishes adolescents with suicidal thoughts from those who have attempted suicide? A population-based birth cohort study. J Child Psychol Psychiatry. (2019) 60:91–9. doi: 10.1111/jcpp.12878

PubMed Abstract | CrossRef Full Text | Google Scholar

59. Beach V, Brown S, Cukrowicz K. Examining the relations between hopelessness, thwarted interpersonal needs, and passive suicide ideation among older adults: does meaning in life matter? Aging Ment Health. (2021) 25:1759–67. doi: 10.1080/13607863.2020.1855102

PubMed Abstract | CrossRef Full Text | Google Scholar

60. Heisel M, Flett G. Does recognition of meaning in life confer resiliency to suicide ideation among community-residing older adults? A longitudinal investigation. Am J Geriatr Psychiatry. (2016) 24:455–66. doi: 10.1016/j.jagp.2015.08.007

PubMed Abstract | CrossRef Full Text | Google Scholar

61. Shiwaku H, Doi S, Miyajima M, Matsumoto Y, Fujino J, Hirai N, et al. Novel brief screening scale, Tokyo metropolitan distress scale for pandemic (Tmdp), for assessing mental and social stress of medical personnel in Covid-19 pandemic. Psychiatry Clin Neurosci. (2021) 75:24–5. doi: 10.1111/pcn.13168

PubMed Abstract | CrossRef Full Text | Google Scholar

62. Fong T, Chang K, Ho R. Association between quarantine and sleep disturbance in Hong Kong adults: the mediating role of Covid-19 mental impact and distress. Front Psychiatry. (2023) 14:1127070. doi: 10.3389/fpsyt.2023.1127070

CrossRef Full Text | Google Scholar

Keywords: measurement invariance, mediation, psychological distress, meaning in life, Patient Health Questionnaire-4 (PHQ-4), suicidal ideation, young adults, scale validation

Citation: Fong TCT, Ho RTH and Yip PSF (2023) Psychometric properties of the Patient Health Questionnaire-4 among Hong Kong young adults in 2021: Associations with meaning in life and suicidal ideation. Front. Psychiatry 14:1138755. doi: 10.3389/fpsyt.2023.1138755

Received: 06 January 2023; Accepted: 23 February 2023;
Published: 09 March 2023.

Edited by:

Tjhin Wiguna, University of Indonesia, Indonesia

Reviewed by:

Alessandra Costanza, University of Geneva, Switzerland
Lu Qinghua, Shandong Mental Health Center, China

Copyright © 2023 Fong, Ho and Yip. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Paul S. F. Yip, sfpyip@hku.hk

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.