Original Research ARTICLE
Parent-Child Diagnostic Agreement on Anxiety Symptoms with a Structured Diagnostic Interview for Mental Disorders in Children
- 1Clinical Child and Adolescent Psychology, Department of Psychology, Ruhr-Universität Bochum, Bochum, Germany
- 2Kinder- und Jugendpsychiatrische Klinik, Universitäre Psychiatrische Kliniken, Basel, Switzerland
- 3Clinical Child and Adolescent Psychology and Psychotherapy, University of Koblenz-Landau, Landau, Germany
Objective: In clinical structured diagnostic interviews, diagnoses based on parent and child reports have low to moderate agreement. The aims of the present study are (1) to examine diagnostic agreement on anxiety disorders between parents and children on the levels of current and lifetime diagnostic category and diagnoses focusing in particular on diagnostic criteria and (2) to identify parent- and child-related diagnoses predictors for diagnostic agreement.
Method: The sample consisted of 166 parent-child dyads interviewed with the Structured Diagnostic Interview for Mental Disorders in Children (Kinder-DIPS, Schneider et al., 2009). The children (51.8% girls) were between the ages of 7 and 18 years (M = 10.94; SD = 2.22).
Results: Overall, parent-child agreement on the diagnostic category of anxiety disorder (k = 0.21; k = 0.22) and the specific anxiety diagnoses (base rate > 10%) of social phobia, specific phobia and separation anxiety disorder (k = 0.24–0.52; k = 0.19–0.43) and corresponding diagnostic criteria (k = 0.22–0.67; k = 0.24–0.41) were low to moderate with the highest agreement on separation anxiety disorder (k > 0.43). Lower maternal depression, and higher social support reported by mother and father were associated with higher parent-child agreement. Maternal depression was indicated as the strongest predictor. Parental sense of competence, parental anxiety, the amount of parent-child interaction and the child's age and gender had no predictive value.
Conclusions: Parent-child agreement can be expected to be higher on the level of anxiety criteria compared to specific anxiety diagnoses and diagnostic anxiety category. Psychological strains in the family—especially maternal depression and low social support—lower the parent-child agreement on anxiety symptoms. Child- and relation-related variables (age, gender, amount of time parent(s) and children interact) play no role in the prediction of low parent-child agreement.
Anxiety disorders are the most common mental health disorders in children and adolescents (collectively “children”) with a worldwide-pooled prevalence of 6.5% (Polanczyk et al., 2015). The reliable and valid identification of anxiety disorders is an important clinical task, as anxiety disorders in childhood are a major risk factor for the development of further mental disorders (e.g., Woodward and Fergusson, 2001; Kossowsky et al., 2013). Structured (including semi-structured) interviews are the “gold standard” for diagnosing mental disorders (Costello et al., 2005; In-Albon et al., 2011; Merten and Schneider, in press). Interviews permit exchange between interviewer and interviewed person and require less literacy in the interviewed person, among other advantages. The assessment of child psychopathology requires diagnostic information from multiple informants to increase the validity and reliability of the assessment (Achenbach, 2006). Although, studies have shown that children and adolescents report their own emotional or behavioral problems reliably and validly (Arseneault et al., 2005; Luby et al., 2007), parents contribute valuable information of a different kind about the child's behavior and emotional problems (Achenbach, 2006).
An early benchmarking meta-analysis on cross-informant agreement about behavioral and emotional problems of 1.5–19-year-old children by Achenbach et al. (1987) yielded low mean kappa values of about 0.25 for the agreement between child and parent on diagnostic information. Higher but still low agreement (k < 0.40) was reported in recent studies for anxiety disorders (e.g., Jensen et al., 1999; Grills and Ollendick, 2003; Choudhury et al., 2003) with the highest agreement for separation anxiety disorder (SAD) (k < 0.32), followed by social phobia (SoP) (k < 0.28) and specific phobia (SP) (k < 0.24; Grills and Ollendick, 2002; Choudhury et al., 2003; Brown-Jacobsen et al., 2011). Overall, parents were found to report more diagnoses of anxiety than their children. However, more diverse findings were found about the distribution of endorsed criteria between parents and children according to separate specific anxiety disorders. For example, children reported more criteria of SAD whereas parents endorsed more criteria of SoP, SP, and GAD (Choudhury et al., 2003; Reuterskiöld et al., 2008).
Earlier studies showed that parents and children agreed more on diagnostic problems that are concrete, observable, severe, and unambiguous (Herjanic and Reich, 1982; Salbach-Andrae et al., 2009; Hoffman and Chu, 2015). Comer and Kendall (2004), for example, found higher agreement on symptoms compared to diagnoses assessed with the Anxiety Disorders Interview Schedule (ADIS; Silverman and Albano, 1996). Additionally, they found higher agreement on diagnostic symptoms that were observable and not school-related.
According to the Kinder-DIPS, a low to moderate agreement (average k = 0.26) across all diagnostic criteria were found in a community sample (N = 234, age range 11–17) (Propp et al., 2014). Parent-child agreement could not be reported on the level of specific diagnoses due to low base rates (0–4%). Therefore, no explicit results for diagnostic levels of anxiety disorders were reported.
Predictors of Parent-Child Agreement
Several reviews showed that informant characteristics influence parent-child agreement (Reyes and Kazdin, 2005; Smith, 2007). The present results substantiate and add to previous findings, as, in contrast to earlier studies, both informant- and relation-related variables specified for anxiety disorders will be investigated. Informant-related predictors such as the child's age and gender as well as parental psychopathology such as depression and anxiety have been frequently studied. Relation-related variables such as the amount of parent-child contact, social support or parental sense of competence have been rarely investigated. The following section provides the current state of research for these variables.
Several studies examined the predictive value of the child's age and gender on parent-child diagnostic agreement with inconsistent results. Indications for a higher parent-child agreement was found for older and younger age groups as well as for boys and for girls (e.g., Edelbrock et al., 1986; Achenbach et al., 1987; Rapee et al., 1994; Jensen et al., 1999; Sourander et al., 1999; Berg-Nielsen et al., 2003; van der Ende and Verhulst, 2005). The majority of studies found no influence of age or gender (e.g., Cantwell et al., 1997; Choudhury et al., 2003; Grills and Ollendick, 2003; Martin et al., 2004; Karver, 2006; Kiss et al., 2007).
Anxious or depressed parents reported more clinical symptoms in their children than parents without psychopathological problems (Briggs-Gowan et al., 1996; Chilcoat and Breslau, 1997; Najman et al., 2000; Chi and Hinshaw, 2002; Treutler and Epkins, 2003; Rothen et al., 2009). Two different hypotheses are salient about the interpretation of the report of anxious or depressed parents. The first hypothesis is that parents overestimate the amount of symptoms due to their own negative bias (Richters, 1992). The second hypothesis describes that depressed parents are more accurate in evaluating their children's anxiety- or depression-related symptomatology. This is supported by the depression-realism effect that indicates that depressed people make more accurate and realistic judgments than non-depressed people, the so-called “sadder but wiser” phenomenon (Alloy and Abramson, 1979; Moore and Fresco, 2012).
Some researchers suggest that agreement is less influenced by age and gender than by the total time parents and children spend together (Grills and Ollendick, 2003; Treutler and Epkins, 2003). It is expected that parents who spend more time with their children are presumed to know more about the emotions and behaviors of their children than parents who spend less time with their offsprings. However, no empirical data are available answering this research question.
Parents with a high level of social support and self-efficacy showed increased parental capacity including responsive caretaking and higher attention to the child's signals (Coleman and Karraker, 2000). It has been shown that if parental capacity is reduced by depressive symptomatology, parents feel more competent in their parental role if they have a social supportive environment (Kötter et al., 2011). Thus, both factors are expected to lead to higher parent-child agreement.
In sum, parent-child agreement was found to be generally low on structured diagnostic interviews. Agreement on anxiety disorders was found to be higher than in other childhood disorders. However, variances in agreement were indicated according to the diagnostic level, type of disorder, and characteristics of criteria (e.g., observability). Furthermore, different informant- and relation-related predictors were identified to influence parent-child agreement. Until now, the impact of type of diagnostic levels on parent-child agreement in childhood anxiety and possible predictors like parental self-efficacy and quantity of parent-child interaction were not investigated for structured diagnostic interviews in a clinical and non-clinical sample. Therefore, the aims of the present study were to investigate (1) the amount of parent-child agreement on three different diagnostic levels (diagnostic category, diagnoses, and diagnostic criteria) of childhood anxiety disorders using the Kinder-DIPS and (2) the predicting value of informant- and relation-related variables on parent-child agreement on diagnostic criteria. Based on previous research, we hypothesized that parents and children agree low on the diagnostic category and diagnoses but moderate on diagnostic criteria. We hypothesized, furthermore, that diagnostic agreement is higher between parents who spend more time with their younger children compared with parents and older children. In line with earlier studies, parent-child agreement is expected to decrease when parental depression and anxiety increases and social support and parental sense of competence decreases.
Materials and Methods
A total of 257 Kinder-DIPS interviews were conducted at either the outpatient clinic (54.5%) of the University of Basel or at psychiatric and psychological services (45.5%) in Basel. Participants interviewed at the two sites did not differ considerably in terms of demographic information: Children in both groups were around 11 years old (M = 10.63–11.95, SD = 1.63–3.52) and parents were in their early forties (M = 41.68–45.14, SD = 4.73–6.30). The group seen at the outpatient setting (University) included 44.6% boys while of the group interviewed at the psychiatric and psychological services 55% were boys. A greater number of parents seen at the outpatient setting (82%) were married compared to parents at the psychiatric and psychological services (60%).
Demographic information largely matched when the interview partner was the mother or both parents: The participants were similar with respect to children's age (M = 10.89–11.01); SD = 2.00–2.54) and gender (boys = 47.1–50.0%). Also, in both groups, mothers respectively mother and father were in their early forties (M = 42.4–44.70, SD = 4.79–5.48). There was a difference between the two groups with respect to the marital status. 68.8% of mothers interviewed alone were married, whereas 81.4% of parents interviewed together were married.
In 147 (57.2%) interviews a diagnosis of at least one anxiety disorder as primary diagnosis was assigned. In 32 parent-child dyads no diagnosis (12.5%) was assigned. In additional 78 (30.4%) interviews another clinical disorder except anxiety disorders was assigned, however, these interviews were excluded from our analyses to maintain the focus on anxiety disorders. Interview partners were mothers (36.3%), fathers (1.7%), or both parents (56.4%). Interview data with fathers and missing information about the interview partner (5.1%) were deleted pairwise from further analyses.
The final sample consisted of 166 children (51.8% girls) between the ages of 6 and 18 years (M = 10.94; SD = 2.22). Of them 128 (77.1%) were interviewed in the outpatient clinic of the University of Basel and 38 (22.9%) at psychiatric and psychological services. Mothers' and fathers' average ages were 41.81 (SD = 4.84) and 45.13 (SD = 6.89), respectively (for an overview of sociodemographic data see Appendix A). A subgroup of participants (n = 129) filled out questionnaires to investigate parent and child related predictors on parent-child agreement.
Participant Recruitment and Selection Procedures
Participants were recruited for a treatment study for SAD at the University of Basel and from psychiatric and psychological services (Kinder- und Jugendpsychiatrie Baselland, KJP; Schulpsychologischer Dienst Basel-Stadt, SPD) between May 2004 and September 2008. Participants recruited at the University of Basel were screened for anxiety disorders before they underwent the Kinder-DIPS while participants recruited at psychiatric and psychological services were not selected by a specific primary diagnosis. The Kinder-DIPS was part of the initial diagnostic procedure. All participants needed a basic level of German literacy to complete the diagnostic assessment. Exclusion criteria for all participants were a comorbid diagnosis of pervasive developmental disorder and acute drug abuse.
The studies had been approved by the local ethical committee for medical research. Prior to the interview, children and parents were informed about the interview process and gave their written informed consent. For children younger than 16 years old, parents gave their written informed consent. Parents and children were interviewed separately in random order, having different interviewers for their Kinder-DIPS interviews. For each interview current and lifetime diagnoses were derived. Interviewers were blinded to the child's referral reasons and they conducted parent and child interviews independently. All interviews were recorded and subsequently recoded by different raters to ensure interrater reliability. There were three diagnostic profiles for each child-parent(s) couple: (a) clinical diagnoses according to the child's interview, (b) clinical diagnoses according to the parents' interview, (c) a composite rating between a and b. The inter-rater reliability was calculated for the child and the parent interview separately. The diagnosis with the most severe rating (child or parent interview) was labelled as the primary diagnosis. Discrepant clinical ratings were discussed during regularly held conferences with two senior clinical supervisors until consensus was reached.
Prior to the interview, parents and children filled out several questionnaires which are described in detail in the measures section. Additionally, parents indicated how many hours per week they usually spend with their children.
The Structured Diagnostic Interview for Mental Disorders in Children (Kinder-DIPS), Original German Version (2nd Edition).
The Kinder-DIPS (Schneider et al., 2009) is a DSM-IV-TR-based (American Psychiatric Association, 2000) structured diagnostic interview assessing the most important areas of child psychopathology, as well as basic sociodemographic variables, in youths aged 6–18 years. The interview comprises independent, largely parallel parent and child versions. Inter-rater reliability for parent and child interviews in outpatient and inpatient settings is reported as good to very good for lifetime and current major diagnostic categories and diagnoses (Cohens Kappa 0.88–0.98; Neuschwander et al., 2013).
The following questionnaires were filled in by the mother and the father of the child.
Beck Depression Inventory (BDI), German Version.
Parents completed the BDI (Hautzinger et al., 1994), a widely used self-administered measure for the assessment of dysphoria and clinical depression, with high internal consistency (α = 0.88 for clinical samples) and good test-retest reliability (Hautzinger, 1991). In the present sample, the internal consistency was α = 0.79 for mothers' and α = 0.78 for fathers' reports.
Beck Anxiety Inventory (BAI), German Version
Parents filled in the Beck Anxiety Inventory (Beck and Steer, 1993; German translation: Margraf and Ehlers, 2002) a 21-item self-report questionnaire assessing current cognitive and somatic symptoms of anxiety on a 4-point scale. A high internal consistency (α ≥ 0.90 for clinical, α ≥ 0.75 for non-clinical samples), test-retest reliability (r ≥ 0.68) and validity with different anxiety scales (r ≥ 0.46) are reported (Goldschmidt and Berth, 2008). Internal consistencies of the parents' report were obtained in the present sample (mother: α = 0.90, father: α = 0.89).
Anxiety Sensitivity Index (ASI), German Version
The ASI (Reiss et al., 1986; German translation: Ehlers, 1986) is a self-administered 16-item list that measures anxiety sensitivity, the fear of anxiety and anxiety-related mental and bodily sensations on a 5-point Likert scale. High internal consistency (α > 0.80), and stable test-retest reliability (r > 0.70) are reported (Peterson and Plehn, 1999). Internal consistency in the present sample was α = 0.83 for both mothers' and fathers' reports.
Parenting Sense of Competence (PSOC) Scale, German Version
Parents filled in a 16-item self-report questionnaire assessing the perceived sense of parental competence on a 6-point Likert scale (Johnston and Mash, 1989; German translation: Miller, unpublished dissertation) on two scales “satisfaction” and “self-efficacy.” For the present purposes, the scale was reversed so that higher values indicated a higher amount of perceived parental competence. A high internal consistency (α ≥ 0.70) has been reported for the two subscales and the total scale (Johnston and Mash, 1989; Gilmore and Cuskelly, 2008) that was replicated for both parents in the present sample with α = 0.80.
Social Network and Social Support
Parents filled in two separate 10-item sets of questions measuring how much social support they receive and how large their social support network is on 4-point scales, translated and adapted version from The “Avon Longitudinal Study of Parents and Children” (ALSPAC) (O'Connor et al., 1999). Internal consistency in the present sample was for mothers' α = 0.77 and for fathers' reports α = 0.85.
Forty-eight interviewers (39 psychologists with Bachelor's degree; 9 psychologists with Master's degree), with a standardized training in the administration and scoring of the Kinder-DIPS conducted the interviews (see Kinder-DIPS manual for DSM-IV-TR; Neuschwander et al., 2013). All clinicians successfully completed a certification process under supervision. High inter-rater reliability for the parent (α ≥ 0.88) and child version (α ≥ 0.92) in the Kinder-DIPS for anxiety disorders were reported (Neuschwander et al., 2013).
Agreement between children and parents was computed using correlational statistics with SPSS 126.96.36.199 for Mac. All agreement statistics were calculated within both a “current” and a “lifetime” frame, as well as on three diagnostic levels: (1) diagnostic category (presence or absence of an anxiety disorder), (2) diagnoses (SAD, SoP, SP), and (3) diagnostic criteria. Kappa coefficient (k, (Cohen, 1960) and Yule's Y coefficient (Yule, 1912) were calculated to examine the parent-child agreement. The received values of kappa coefficient < 0.4 indicates low agreement, 0.4–0.6 moderate, 0.6–0.8 good, and >0.8 excellent agreement (Fleiss, 1981). Statistical significance of the kappa coefficient was determined with x2-exact tests. The Yule (1912) coefficient was proposed as a chance-corrected measure of agreement that is, contrary to the kappa statistic, independent of the prevalence of the observed event (Spitznagel and Helzer, 1985). Based on the odds ratio (standardized to range from −1 to 1), the Yule's Y is comparable to other correlational coefficients (Wirtz and Caspar, 2002). The kappa and Yule's Y statistics reduce reliability if prevalence of the observed events is low resulting in symmetrically or asymmetrically skewed marginal distributions of the contingency tables (Kraemer, 1979; Maclure and Willett, 1987; Thompson and Walter, 1988; Cicchetti and Feinstein, 1990; Feinstein and Cicchetti, 1990). Correlational statistics of parent-child agreement were only reported for diagnoses with a higher base-rate than 10% (a complete table of inter-rater measurements is available upon request). Additionally, total agreement as the percentage of the number of agreement between parent and child were reported.
For the investigation of child- and parent related predictors of diagnostic agreement, the frequency of disagreements rather than agreements on the diagnostic criteria per parent-child dyad were calculated to minimize the chance agreement on the absence of symptoms. Chance agreement on the absence of symptoms is typically high since children report a relative limited number of positive diagnostic criteria.
The predictors of parent-child agreement were investigated in three steps. First, unadjusted bivariate correlations (Pearson's r, two-tailed) were calculated between the number of parent-child agreement and predictor variables. Second, if there was a significant correlation between a predictor variable and the number of disagreement, a linear regression analyses and finally a multiple regression analyses were conducted with these variables. Child related variables were gender, age, and the amount of interaction time between child and parents. Parent related variables were scores on psychopathological (BDI, ASI, BAI), parenting (PSOC), and social support questionnaires.
According to parental report, 113 (68.1%) of the children met DSM-IV-TR criteria for a current anxiety disorder, and 122 (71.3%) of the children met DSM-IV-TR criteria for any lifetime diagnosis. According to child report, 79 (47.6%) of the children met DSM-IV-TR criteria for any current diagnosis, and 89 (52.0%) of the children met DSM-IV-TR criteria for a lifetime anxiety disorder.
Overall, children and parents agreed significant, but low to moderate on current and lifetime diagnostic information (see Tables 1, 2). On the level of diagnostic category, kappa values about the presence of a current (k = 0.22) or a lifetime (k = 0.21) anxiety disorder were low. On the level of current and lifetime diagnoses, kappa values (base rate > 10%) were low to moderate for SAD (k = 0.52; k = 0.43), SP (k = 0.24; k = 0.19), and SoP (k = 0.25; k = 0.28), indicating the highest agreement for SAD (current and lifetime diagnoses). Contingency tables (Table 1) showed that parents reported more current diagnoses than their children across all current and lifetime anxiety disorders.
Table 1. Parent-child agreement on current and lifetime DSM-IV-TR diagnostic anxiety symptoms on the levels of the diagnostic category and diagnoses assessed with the Kinder-DIPS.
Table 2. Parent-child agreement on current and lifetime DSM-IV-TR anxiety symptoms on the level of diagnostic criteria assessed with the Kinder-DIPS.
On the level of current and lifetime diagnostic criteria (see Table 2), kappa values were significant and moderate for SAD (k = 0.53–0.67; k = 0.49–0.57), low for SoP (k = 0.22–0.38; k = 0.24–0.38), and low for SP (k = 0.27–0.63; k = 0.24–0.41). Again, parents indicated more criteria as positive than their children when large discrepancies were found. The criterion with the lowest agreement in SoP and SP was “symptoms interfere with the person's normal routine, or cause marked distress” (current: k = 0.22, lifetime: k = 0.24).
Predictors of Parent-Child Agreement
For the regression analyses, 85 parent-child dyads with complete interview data for current diagnostic criteria were available. The interview data conducted with mothers and both parents were calculated in one group because there was no significant difference between the number of current diagnostic criteria children and parents/mothers disagreed upon, t(83) = 0.78, p = 0.44.
Child Related Predictors
Bivariate analysis (Pearson's r, two-tailed) showed no significant correlation between parent-child disagreement and the child's gender r(85) = 0.006, p = 0.95, age, r(85) = –0.19, p = 0.09 and total time of interaction, r(67) = –0.129, p = 0.30.
Parent- and Relation-Related Predictors
Overall, observed parental psychopathology was in a non-clinical range. The BDI and BAI scores were below the cut-off for mild symptoms. ASI and PSOC scores were at the lower bound of normative sample means reported for the general population (Johnston and Mash, 1989; Peterson and Plehn, 1999).
Bivariate analysis was calculated between parent-related factors and the number of disagreement. The analysis revealed that maternal BDI scores, r(79) = 0.309, p = 0.01 correlated significantly to the number of disagreement. Maternal ASI scores, r(80) = 0.190, p = 0.09 correlated not significantly to the number of disagreement. Social support rated by mothers r(81) = −0.268, p = 0.03 and by fathers r(66) = −0.219, p = 0.05 correlated significantly, indicating that higher maternal depression and lower social support reported by mother and father were associated with lower parent-child agreement. No significant correlations were found for maternal and paternal PSOC, BAI and paternal BDI and ASI scores, (r < 0.06, all p > 0.09).
Based on these results, four multiple regression analyses were performed with the frequency of disagreement on the diagnostic criteria as the dependent variable and (1) maternal BDI and ASI scores, (2) social support by mothers and fathers, (3) maternal BDI and social support scores, and (4) maternal BDI and paternal social support scores as independent variables. Beta coefficients are listed in Table 3, first line. The first model was significant, F(2, 76) = 4.75, p = 0.011, explaining 11.1% of the variance. Maternal BDI scores significantly increased with the number of disagreements whereas ASI scores added no significant variance to the model after controlling for depression scores. The second model was significant, F(2, 62) = 3.89, p = 0.028 explaining 11.1% of the variance. The predicting value of social support reported by mothers and fathers did not remain significant after controlling for each other. The third model was significant, F(2, 76) = 4.55, p = 0.014 explaining 10.7% of the variance. Maternal social support added no significant variance to the model after controlling for depression scores. The fourth model was significant, F(2, 60) = 7.25, p = 0.002 explaining 19.5% of the variance. Higher maternal depression and lower social support reported by the father predicted therefore parent-child disagreement.
Table 3. Multiple regression analyses of the total number of parent-child disagreement on current diagnostic criteria and maternal depression (BDI), maternal anxiety sensitivity (ASI), and parental social support.
The present study adds to previous research by examining parent–child agreement on all three diagnostic levels in one study design focusing on anxiety disorders as the most prevalent disorder in childhood. These diagnostic levels were (a) diagnostic category (anxiety disorder), (b) specific anxiety diagnoses (SAD, SoP, SP), and (c) diagnostic criteria (e.g., criterion A of social anxiety disorder). Furthermore, the present study adds to previous research by providing interview data of mothers and both parents from children between 7 and 18 years old representing the diversity in the clinical field. The use of a clinical and a non-clinical sample enhanced moreover the generalization of the results.
Parent-Child Agreement on Diagnostic Category and Diagnoses
In accordance with earlier studies (e.g., Grills and Ollendick, 2003; Comer and Kendall, 2004; Weems et al., 2011; Propp et al., 2014), parent-child agreement was low on the diagnostic category (average k = 0.22), higher but still low on specific anxiety diagnoses (average k = 0.34) and moderate on diagnostic criteria (average k = 0.52). A possible explanation for this difference might be that important diagnostic information is assessed at the level of diagnostic criteria that might get lost in the course of the diagnostic evaluation. For example, a parent-child dyad would agree on the level of criteria but not on the level of diagnoses and diagnostic category if parent and child agree on criterion A of SAD (e.g., child is extremely afraid of being separated from the parents) but not on criterion D of SAD (e.g., distressed or impaired in daily functioning). These findings highlight the importance of a combination of categorical and dimensional diagnostics since subclinical problems might be identified at the level of criteria but remain undiscovered at the level of diagnoses.
Parent-Child Agreement on Diagnostic Criteria
As expected, parent-child agreement on the level of diagnostic criteria varied between the types of anxiety disorder. Parents and children agreed more on criteria of SAD compared to SoP and SP replicating results of earlier studies (Jensen et al., 1999; Choudhury et al., 2003; Grills and Ollendick, 2003). Agreement on SAD was probably higher in the present sample because symptoms of SAD are separation-related (e.g., clinging, avoidance of being alone) and therefore more easily noticeable for parents than symptoms of SoP or SP. Furthermore, the prevalence rate for SAD was higher (n = 69) than for SoP (n = 42) and SP (n = 49) and therefore less susceptible for bias.
In general, parents endorsed more criteria than their children across all anxiety disorders analyzed in this study. One example therefore is the criterion E (“symptoms interfere with the person's normal routine, or cause marked distress”) of current and lifetime SP and SoP. These findings are supported by earlier studies that found that parents report generally more symptoms than their children (MacLeod et al., 1999; Martin et al., 2004). Anxious children, especially those with social phobia were identified to report fewer symptoms, particularly social avoidance than their parents (DiBartolo et al., 1998). A possible explanation might be that anxious children neglect symptoms to avoid a possible negative evaluation by seeming non-distressed. Alternatively, anxious children avoid negative feelings that might come up when they are reminded of anxiety provoking situations. Additionally, psychotherapeutic appointments are usually initiated by parents and not by children themselves. Parents might therefore have a clearer idea of concerned problems and why they are seeking help than their children which might result in lower diagnostic agreement.
Predictors on the Number of Anxiety Symptoms Parent and Child Agree on
The predictive analyses showed that the child's age and gender predicted not significantly the number of parent-child agreement. In spite of mixed results, the present findings replicated the results of the majority of empirical work that showed no effect of gender or age (e.g., Grills and Ollendick, 2003; Propp et al., 2014). The inconsistent findings in the existing literature might be caused by different age groups and age ranges covered in earlier studies. Some studies, for example, covered younger children (8–12, Barbosa et al., 2002; 7–14, Comer and Kendall, 2004), older children (11–17, Propp et al., 2014) or wider age ranges (7–18, Brown-Jacobsen et al., 2011; 7–17, Hoffman and Chu, 2015) with a mean age of around 11 years.
Parental Depression and Anxiety
In accordance with Propp et al. (2014), maternal depression predicted parent-child agreement on diagnostic criteria of anxiety disorders. The analysis of social support indicated a correlational result. Lower social support was associated with lower parent-child agreement. However, this relation was not significant after controlling for maternal depression. It can therefore be assumed that maternal depression is a strong predictor of parent-child agreement. It is still open to discussion whether depressed parents report more accurately or are biased about the symptoms of their children (Richters, 1992; Moore and Fresco, 2012). However, clinical suggestions about the relation between maternal psychopathology and parent-child agreement can be provided. It can be expected that parent-child agreement on anxiety symptoms decrease when mothers report (1) depressive mood and (2) low levels of social support. Furthermore, a potential buffering effect of social support on maternal depression can be suggested due to the correlational relation between these predictors leading to higher levels of parent-child agreement. This idea is supported by earlier findings that social support is a moderator between maternal depression and behavioral problems in children (Lee et al., 2006).
We were able to show for the first time that, analogue to mothers, paternal lower social support predicted lower parent-child agreement. No significant correlations were found for parental sense of competence, anxiety (sensitivity), and depression. So far, the impact of paternal variables on parent-child agreement is less studied than maternal variables (Grills and Ollendick, 2003). It has been suggested that mothers spend more time with their children and provide therefore more information about the child's behavior (De Los Reyes and Kazdin, 2004). This might be an explanation why fathers' psychopathology did not predict parent-child agreement in the present study. However, the positive correlation between reported social support of mothers and fathers indicated that this might be a shared predictor for parent-child agreement. Other than psychopathological variables, social support seemed to affect the whole family leading to a lower parent-child agreement.
Parental Sense of Competence
Furthermore, contrary to our expectations, parental sense of competence had no predicting value for parent-child agreement in the present study. An association between parental depression, self-efficacy, and social support has been reported by different studies (Herwig et al., 2004; Lee et al., 2006). In view of the high predicting value of maternal depression on parent-child agreement, it could be expected that mothers with a high level of parental self-efficacy would show higher levels of parent-child agreement due to increased parental capacity including responsive caretaking and more attention to the child's signals (Coleman and Karraker, 2000). This hypothesis was supported in the present study. Additionally, no significant effect was found for the amount of time parents and children spent together. A possible explanation might be that not the total amount of time but the quality of parent-child interaction predicts the extent to which parents and children agree upon behavioral and emotional difficulties (Grills and Ollendick, 2002). A further investigation of a potential moderating effect of different aspects of parenting (e.g., quality of communication) might be of value.
Despite the high number of participants, not all anxiety disorders (e.g., panic disorder, GAD) included in the structured diagnostic interview were represented because of the low base rates in this age group. Low base rates can lead to a limited interpretation of kappa because of its base rate dependency. Either a very low or a very high prevalence of the observed event leads to an underestimation of the kappa coefficient (Cicchetti and Feinstein, 1990; Sim and Wright, 2005). Another limitation is the limited generalizability of the present finding regarding parent- and child related predictors. Because of feasibility reasons we were only able to examine this research question in the sample of children with anxiety disorders treated in the university-related outpatient clinic. These results might therefore not be generalizable to inpatient clinical samples due to evidence that parent-child agreement differs between inpatient and outpatient clinical settings (e.g., Martin et al., 2004; van der Ende and Verhulst, 2005).
In conclusion, based on the existing research on parent-child agreement in structured diagnostic interviews, parent-child agreement in anxiety disorders can be expected to be low to moderate as replicated in the present study. Additionally, the present findings indicated that diagnostic agreement varies (1) between the diagnostic levels and (2) as a function of type of anxiety disorder. Higher parent-child agreement can be expected if the diagnostic symptoms are assessed on the level of diagnostic criteria rather than on diagnoses. Clinicians might benefit from a closer look at the anxiety symptoms parents and children agree upon in respect to diagnostic and therapeutic processes (Achenbach et al., 1987; Reyes, 2011).
There is additional growing evidence that parental psychopathology, and more specifically maternal depressive mood decreases the level of parent-child agreement. Until now, it is an open question whether maternal psychopathology increases the validity of mothers' diagnostic report. Additionally, low social support of both parents was associated with lower parent-child agreement. The assessment of maternal psychopathology and familial social support might be of additional value in interpreting diagnostic parent-child agreement.
Our treatment of human subjects and the conduct of research complied with the ethical standards set forth by APA and was approved by the local ethical committee for medical research. All subjects gave written informed consent in accordance with the Declaration of Helsinki.
Registration identification number: NCT00255112. Registry URL: http://www.clinicaltrials.gov
LP analyzed the data and drafted the manuscript. MN, TI, and SM conducted the research. SS and TI designed the research, and provided critical feedback. All authors read and approved the final manuscript.
This study was partly supported by Swiss National Science Foundation Grant 105314-116517, “Etiology and Psychological Treatment of Separation anxiety disorder-specific cognitive-behavioral therapy (CBT) program for children with separation anxiety disorder (SAD)” awarded to SS.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/article/10.3389/fpsyg.2017.00404/full#supplementary-material
SAD, Separation anxiety disorder; SoP, Social phobia; SP, Specific phobia; Kinder-DIPS, Structured Diagnostic Interview for Mental Disorders in Children (“Diagnostisches Interview bei psychischen Störungen im Kindes- und Jugendalter”).
Achenbach, T. M., McConaughy, S. H., and Howell, C. T. (1987). Child/adolescent behavioral and emotional problems: implications of cross-informant correlations for situational specificity. Psychol. Bull. 101, 213–232. doi: 10.1037/0033-2909.101.2.213
Arseneault, L., Kim-Cohen, J., Taylor, A., Caspi, A., and Moffitt, T. E. (2005). Psychometric evaluation of 5- and 7-year-old children's self-reports of conduct problems. J. Abnorm. Child Psychol. 33, 537–550. doi: 10.1007/s10802-005-6736-5
Berg-Nielsen, T. S., Vika, A., and Dahl, A. A. (2003). When adolescents disagree with their mothers: CBCL-YSR discrepancies related to maternal depression and adolescent self-esteem. Child Care Health Dev. 29, 207–213. doi: 10.1046/j.1365-2214.2003.00332.x
Briggs-Gowan, M. J., Carter, A. S., and Schwab-Stone, M. (1996). Discrepancies among mother, child, and teacher reports: examining the contributions of maternal depression and anxiety. J. Abnorm. Child Psychol. 24, 749–765. doi: 10.1007/BF01664738
Brown-Jacobsen, A. M., Wallace, D. P., and Whiteside, S. P. H. (2011). Multimethod, multi-informant agreement, and positive predictive value in the identification of child anxiety disorders using the SCAS and ADIS-C. Assessment 18, 382–392. doi: 10.1177/1073191110375792
Cantwell, D. P., Lewinsohn, P. M., Rohde, P., and Seeley, J. R. (1997). Correspondence between adolescent report and parent report of psychiatric diagnostic data. J. Am. Acad. Child Adolesc. Psychiatry 36, 610–619. doi: 10.1097/00004583-199705000-00011
Chi, T. C., and Hinshaw, S. P. (2002). Mother-child relationships of children with ADHD: the role of maternal depressive symptoms and depression-related distortions. J. Abnorm. Child Psychol. 30, 387–400. doi: 10.1023/A:1015770025043
Chilcoat, H. D., and Breslau, N. (1997). Does psychiatric history bias mothers' reports? An application of a new analytic approach. J. Am. Acad. Child Adolesc. Psychiatry 36, 971–979. doi: 10.1097/00004583-199707000-00020
Choudhury, M. S., Pimentel, S. S., and Kendall, P. C. (2003). Childhood anxiety disorders: parent-child (dis)agreement using a structured interview for the DSM-IV. J. Am. Acad. Child Adolesc. Psychiatry 42, 957–964. doi: 10.1097/01.CHI.0000046898.27264.A2
Coleman, P. K., and Karraker, K. H. (2000). Parenting self-efficacy among mothers of school-age children: conceptualization, measurement, and correlates. Family relations: an interdisciplinary J. Appl. Family Stud. 49, 13–24. doi: 10.1111/j.1741-3729.2000.00013.x
Comer, J. S., and Kendall, P. C. (2004). A symptom-level examination of parent-child agreement in the diagnosis of anxious youths. J. Am. Acad. Child Adolesc. Psychiatry 43, 878–886. doi: 10.1097/01.chi.0000125092.35109.c5
Costello, E. J., Egger, H., and Angold, A. (2005). 10-year research update review: the epidemiology of child and adolescent psychiatry disorders: I. methods and public health burden. J. Am. Acad. Child Adolesc. Psychiatry 44, 972–986. doi: 10.1097/01.chi.0000172552.41596.6f
DiBartolo, P. M., Albano, A. M., Barlow, D. H., and Heimberg, R. G. (1998). Cross-informant agreement in the assessment of social phobia in youth. J. Abnorm. Child Psychol. 26, 213–220. doi: 10.1023/A:1022624318795
Edelbrock, C., Costello, A. J., Dulcan, M. K., Conover, N. C., and Kala, R. (1986). Parent-child agreement on child psychiatric symptoms assessed via structured interview. J. Child Psychol. Psychiatry 27, 181–190. doi: 10.1111/j.1469-7610.1986.tb02282.x
Grills, A. E., and Ollendick, T. H. (2003). Multiple informant agreement and the anxiety disorders interview schedule for parents and children. J. Am. Acad. Child Adolesc. Psychiatry 42, 30–40. doi: 10.1097/00004583-200301000-00008
Herjanic, B., and Reich, W. (1982). Development of a structured psychiatric interview for children: agreement between child and parent on individual symptoms. J. Abnorm. Child Psychol. 10, 307–324. doi: 10.1007/BF00912324
Herwig, J. E., Wirtz, M., and Bengel, J. (2004). Depression, partnership, social support, and parenting: interaction of maternal factors with behavioral problems of the child. J. Affect. Disord. 80, 199–208. doi: 10.1016/S0165-0327(03)00112-5
Hoffman, L. J., and Chu, B. C. (2015). Target problem (mis) matching: predictors and consequences of parent-youth agreement in a sample of anxious youth. J. Anxiety Disord. 31, 11–19. doi: 10.1016/j.janxdis.2014.12.015
In-Albon, T., Dubi, K., Adornetto, C., Blatter-Meunier, J., and Schneider, S. (2011). Neue Ansätze in der Diagnostik von Angststörungen im Kindes- und Jugendalter und deren Gütekriterien. Klinische Diagnostik und Evaluation 4, 133–147.
Jensen, P. S., Rubio-Stipec, M., Canino, G., Bird, H. R., Dulcan, M. K., Schwab-Stone, M. E., et al. (1999). Parent and child contributions to diagnosis of mental disorder: are both informants always necessary? J. Am. Acad. Child Adolesc. Psychiatry 38, 1569–1579. doi: 10.1097/00004583-199912000-00019
Kiss, E., Gentzler, A. M., George, C., Kapornai, K., Tamas, Z., Kovacs, M., et al. (2007). Factors influencing mother-child reports of depressive symptoms and agreement among clinically referred depressed youngsters in Hungary. J. Affect. Disord. 100, 143–151. doi: 10.1007/s10802-005-9015-6
Kossowsky, J., Schneider, S., Taeymans, J., Locher, C., and Gaab, J. (2013). The separation anxiety hypothesis of panic disorder revisited: a meta-analysis. Am. J. Psychiatry 170, 768–781. doi: 10.1176/appi.ajp.2012.12070893
Kötter, C., Stemmler, M., Lösel, F., Bühler, A., and Jaursch, S. (2011). Medium-term effects of the EFFEKT-E preventive program for emotionally distressed mothers and their children in relation to psychosocial risk. Zeitschrift für Gesundheitspsychol. 19, 122–133. doi: 10.1026/0943-8149/a000043
Lee, L.-C., Halpern, C. T., Hertz-Picciotto, I., Martin, S. L., and Suchindran, C. M. (2006). Child care and social support modify the association between maternal depressive symptoms and early childhood behaviour problems: a US national study. J. Epidemiol. Community Health 60 305–310. doi: 10.1136/jech.2005.040956
Luby, J. L., Belden, A., Sullivan, J., and Spitznagel, E. (2007). Preschoolers' contribution to their diagnosis of depression and anxiety: uses and limitations of young child self-report of symptoms. Child Psychiatry Hum. Dev. 38, 321–338. doi: 10.1007/s10578-007-0063-8
MacLeod, R. J., McNamee, J. E., Boyle, M. H., Offord, D. R., and Friedrich, M. (1999). Identification of childhood psychiatric disorder by informant: comparisons of clinic and community samples. Can. J. Psychiatry 44, 144–150.
Martin, J. L., Ford, C. B., Dyer-Friedman, J., Tang, J., and Huffman, L. C. (2004). Patterns of agreement between parent and child ratings of emotional and behavioral problems in an outpatient clinical setting: when children endorse more problems. J. Dev. Behav. Pediatr. 25, 150–155. doi: 10.1097/00004703-200406000-00002
Najman, J. M., Williams, G. M., Nikles, J., Spence, S., Bor, W., O'Callaghan, M., et al. (2000). Mothers' mental illness and child behavior problems: cause-effect association or observation bias? J. Am. Acad. Child Adolesc. Psychiatry 39, 592–602. doi: 10.1097/00004583-200005000-00013
Neuschwander, M., In-Albon, T., Adornetto, C., Roth, B., and Schneider, S. (2013). Interrater reliability of the diagnostic interview bei psychischen Storungen im Kindes- und Jugendalter (Kinder-DIPS). Z. Kinder. Jugendpsychiatr. Psychother. 41, 319–334. doi: 10.1024/1422-4917/a000247
O'Connor, T. G., Thorpe, K., Dunn, J., and Golding, J. (1999). Parental divorce and adjustment in adulthood: findings from a community sample. J. Child Psychol. Psychiatry 40, 777–789. doi: 10.1111/1469-7610.00493
Peterson, R. A., and Plehn, K. (1999). “Measuring anxiety sensitivity,” in Anxiety Sensitivity: Theory, Research, and Treatment of the Fear of Anxiety, ed S. Taylor (Mahwah, NJ Lawrence Erlbaum Associates), 61–81.
Polanczyk, G. V., Salum, G. A., Sugaya, L. S., Caye, A., and Rohde, L. A. (2015). Annual research review: a meta-analysis of the worldwide prevalence of mental disorders in children and adolescents. J. Child Psychol. Psychiatry 56, 345–365. doi: 10.1111/jcpp.12381
Propp, O., Schilder, A., Hahlweg, K., Hannighofer, J., and Schulz, W. (2014). Übereinstimmung von Mutter-Kind-Aussagen und deren Einflussfaktoren am Beispiel des Kinder-DIPS in der Diagnostik psychischer Störungen im Jugendalter. Z. Klin. Psychol. Psychother. 43, 92–103. doi: 10.1026/1616-3443/a000258
Rapee, R. M., Barrett, P. M., Dadds, M. R., and Evans, L. (1994). Reliability of the DSM-III-R childhood anxiety disorders using structured interview: interrater and parent-child agreement. J. Am. Acad. Child Adolesc. Psychiatry 33, 984–992. doi: 10.1097/00004583-199409000-00008
Reiss, S., Peterson, R. A., Gursky, D. M., and McNally, R. J. (1986). Anxiety sensitivity, anxiety frequency and the prediction of fearfulness. Behav. Res. Ther. 24, 1–8. doi: 10.1016/0005-7967(86)90143-9
Reuterskiöld, L., Öst, L.-G., and Ollendick, T. (2008). Exploring child and parent factors in the diagnostic agreement on the Anxiety disorders interview schedule. J. Psychopathol. Behav. Assess. 30, 279–290. doi: 10.1007/s10862-008-9081-5
Reyes, A. D. L. (2011). Introduction to the special section: more than measurement error: discovering meaning behind informant discrepancies in clinical assessments of children and adolescents. J. Clin. Child Adolesc. Psychol. 40, 1–9. doi: 10.1080/15374416.2011.533405
Reyes, A. D. L., and Kazdin, A. E. (2005). Informant discrepancies in the assessment of childhood psychopathology: a critical review, theoretical framework, and recommendations for further study. Psychol. Bull. 131, 483–509. doi: 10.1037/0033-2909.131.4.483
Rothen, S., Vandeleur, C. L., Lustenberger, Y., Jeanpretre, N., Ayer, E., Gamma, F., et al. (2009). Parent-child agreement and prevalence estimates of diagnoses in childhood: direct interview versus family history method. Int. J. Methods Psychiatr. Res. 18, 96–109. doi: 10.1002/mpr.281
Salbach-Andrae, H., Klinkowski, N., Lenz, K., and Lehmkuhl, U. (2009). Agreement between youth-reported and parent-reported psychopathology in a referred sample. Eur. Child Adolesc. Psychiatry 18, 136–143. doi: 10.1007/s00787-008-0710-z
Treutler, C. M., and Epkins, C. C. (2003). Are discrepancies among child, mother, and father reports on children's behavior related to parents' psychological symptoms and aspects of parent-child relationships? J. Abnorm. Child Psychol. 31, 13–27. doi: 10.1023/A:1021765114434
van der Ende, J., and Verhulst, F. C. (2005). Informant, gender and age differences in ratings of adolescent problem behaviour. Eur. Child Adolesc. Psychiatry 14, 117–126. doi: 10.1007/s00787-005-0438-y
Weems, C. F., Feaster, D. J., Horigian, V. E., and Robbins, M. S. (2011). Parent and child agreement on anxiety disorder symptoms using the DISC predictive scales. Assessment 18, 213–216. doi: 10.1177/1073191110389278
Woodward, L. J., and Fergusson, D. M. (2001). Life course outcomes of young people with anxiety disorders in adolescence. J. Am. Acad. Child Adolesc. Psychiatry 40, 1086–1093. doi: 10.1097/00004583-200109000-00018
Keywords: parent-child agreement, parental psychopathology, structured diagnostic interview, kinder-DIPS, anxiety disorders
Citation: Popp L, Neuschwander M, Mannstadt S, In-Albon T and Schneider S (2017) Parent-Child Diagnostic Agreement on Anxiety Symptoms with a Structured Diagnostic Interview for Mental Disorders in Children. Front. Psychol. 8:404. doi: 10.3389/fpsyg.2017.00404
Received: 23 October 2016; Accepted: 03 March 2017;
Published: 27 March 2017.
Edited by:Stefania Mannarini, University of Padua, Italy
Reviewed by:Matteo Chiappedi, University of Pavia, Italy
Monica Bomba, University of Milan Bicocca, Italy
Copyright © 2017 Popp, Neuschwander, Mannstadt, In-Albon and Schneider. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Silvia Schneider, Silvia.Schneider@rub.de