Abstract
Background: To date, most research on aggression in mental disorders focused on active-aggressive behavior and found self-directed and other-directed active aggression to be a symptom and risk-factor of psychopathology. On the other hand, passive-aggressive behavior has been investigated less frequently and only in research on psychodynamic defense mechanisms, personality disorders, and dysfunctional self-control processes. This small number of studies primarily reflects a lack of a reliable and valid clinical assessment of passive-aggressive behavior. To address this gap, we developed the Test of Passive Aggression (TPA), a 24-item self-rating scale for the assessment of self-directed and other-directed passive-aggressive behavior.
Method: Study 1 examined the internal consistency and factorial validity of the TPA in an inpatient sample (N = 307). Study 2 investigated the retest-reliability, internal consistency, and construct validity (active aggression, personality traits, impulsivity) of the TPA in a student sample (N = 180).
Results: In line with our hypothesis, Exploratory Structural Equation Modeling revealed an acceptable to good fit of a bi-factorial structure of the TPA (Chi-square-df-ratio = 1.98; RMSR = 0.05, fit.off = 0.96). Both TPA scales showed good to excellent internal consistency (α = 0.83–0.90) and 4-week retest-reliability (rtt = 0.86). Correlations with well-established aggression scales, measures of personality, and impulsivity support discriminant and convergent validity of the TPA.
Conclusions: The TPA is a reliable and valid instrument for the assessment of self-directed and other-directed passive-aggressive behavior.
Introduction
Aggressive behavior is any behavior intended to harm oneself or others directly or indirectly (Buss, 1961). It can be differentiated into active and passive forms (Allen and Anderson, 2017). Active aggressive behavior comprises all forms of behavior including active engagement in the application of psychological or physical impairment, e.g., insulting someone or deliberate self-harm. Passive aggressive behavior is characterized by harmful inactivity and omission of active engagement, e.g., a lack of social support or neglect of one's own psychological needs. Therefore, aggression per se characterizes harmful behavior, but not to a personality trait (e.g., impulsivity), emotion (e.g., anger), or cognition (e.g., hostile attribution; Baron and Richardson, 2004). However, aggressive behavior tends to be stable over the life course and is thus assumed to represent a trait-like behavioral tendency (Huesmann et al., 2009). Although aggressive behavior is an evolutionary-based human problem-solving behavior (Buss and Shackelford, 1997), which can be adaptive in some contexts (Georgiev et al., 2013; Edmondson et al., 2016), it is also associated with high individual and societal costs (Laing and Bobic, 2002; Heilbron and Prinstein, 2008). Among other relevant risk factors for aggressive behavior [e.g., childhood sexual abuse (Fliege et al., 2009), hopelessness (Fox et al., 2015), impulsivity (Bresin, 2019)], aggressive behavior is related to psychopathology (Genovese et al., 2017). Prevalence rates of aggressive behavior in clinical samples exceed those of the general population, for both self-directed aggressive behavior [e.g., life-time prevalence of self-harm: 21 vs. 4% (Briere and Gil, 1998)] and other-directed aggressive behavior [e.g., 12 months prevalence of other-directed violence: 8–37% vs. 2% (Swanson et al., 2015)]. However, it is important to note that the vast majority of individuals affected by mental disorders does not show higher levels of aggressive behavior than the general population (Varshney et al., 2016). Nevertheless, individuals with mental disorders are an important population for research into aggressive behavior and for prevention of self-directed and other-directed aggressive behavior (Taft et al., 2012; Dutton and Karakanta, 2013; Hawton et al., 2013; Augsburger and Maercker, 2020).
Active aggressive behavior has been investigated extensively, which is reflected in the existence of well-established theoretical frameworks and many psychometric tests (Parrott and Giancola, 2007). For detailed information and reviews regarding active aggressive behavior in mental disorders, see, for e.g., Cafferky et al. (2018), Dutton and Karakanta (2013), Hawton et al. (2013), and Taft et al. (2012). By contrast, research on passive-aggressive behavior is relatively scarce, resulting in a smaller number of theories and a lack of psychometric tests (Parrott and Giancola, 2007). The term passive aggression was first used to characterize behavior of soldiers in World War II who acted in non-compliant ways to their superior's orders (Millon, 1993). In the aftermath, passive-aggressive personality disorder was included in the first version of the Diagnostic and Statistical Manual of Mental Disorders (DSM) and was characterized primarily by a set of behavioral symptoms (e.g., procrastination) (American Psychiatric Association, 1952). However, during various revisions of the DSM, the concept lost its substantive distinctiveness and was later renamed negativistic personality disorder. Thereby, affective symptom (e.g., moodiness) and cognitive characteristics (e.g., negativistic attitudes) were included and resulted in a large overlap with other personality disorders (Hopwood and Wright, 2012). This lack of clarity ultimately led to less research on passive-aggressive personality disorder and finally to its exclusion from DSM-5 (American Psychiatric Association, 2013). Therefore, for a long time it was also difficult to capture the clinical significance of the concept, since associated characteristics (e.g., moodiness) were partly subject to the concept or not. Given that research into other psychological fields [e.g., organizational psychology (Baron and Neuman, 1996; Neuman and Baron, 1998)] demonstrated firmly the relevance of passive-aggressive behavior, it is also important to re-examine passive-aggressive behavior from a clinical perspective. Apart from nosological research into passive-aggressive personality disorder, mainly two theoretical approaches have inspired clinical research into passive-aggressive behavior: Research on other-directed passive-aggressive behavior mainly originated from psychodynamic research into defense mechanisms (Cramer, 2015), and research on self-directed passive-aggressive behavior—sometimes also referred to as self-harm by omission (Turp, 2007)—mainly focused on self-control processes in depressive disorders (Rehm, 1977).
Passive-Aggression in Clinical Research
In psychodynamic research, defense mechanisms are defined as unconscious processes protecting the ego from emotional disturbance (e.g., fear) and instinctive urges (e.g., active aggression; Freud, 1936). Defense mechanisms are supposed to represent relatively stable traits (Bond, 2004), which are activated by internal or external conflicts (Segal et al., 2007). According to their capability to resolve conflicts, they are classified into mature, neurotic, and immature defenses (Andrews et al., 1993), with immature defense mechanisms being associated with childhood trauma or neglect (Romans et al., 1999; Nickel and Egle, 2006). Passive-aggressive behavior is conceptualized as an immature defense mechanism due to its negativistic and covert nature (Andrews et al., 1993; Schauenburg et al., 2007), thereby contributing to the suppression of emotional conflicts and impaired problem-solving capabilities (Cramer, 2015). Higher levels of passive-aggressive defense mechanisms are associated with more severe symptoms of anorexia nervosa (Tordjman et al., 1997), acute stress disorder (Santana et al., 2017), adjustment disorder (Ghazwin et al., 2017), borderline personality disorder (Zanarini et al., 2013), and deliberate self-harm (Baykara and Alban, 2018).
The self-control theory of depression is based on Kanfer's (1971) behavioral self-control model that proposes that individuals control their behavior using a feedback loop of self-monitoring, self-evaluation, and self-reinforcement. These processes are assumed to be distorted in patients with depressive symptoms due to dysfunctional cognitive biases and negative attributional styles (Rehm, 1977), which are supposed to develop in late childhood and get activated in stressful situations (Wang et al., 2010; Hu et al., 2015; Schierholz et al., 2016). The tendency of depressed patients to selectively focus on adverse stimuli and events (De Raedt and Koster, 2010) and to attribute these in a dysfunctional way (Hu et al., 2015) results in a negative self-evaluation (Orchard and Reynolds, 2018). Such a negative self-evaluation, in turn, is supposed to lead to excessive self-punishment and low levels of self-reward (Ciminero and Steingarten, 1978; Rozensky et al., 1981). Notably, the latter represents a form of self-directed passive-aggressive behavior and contributes to the development of depression (Fuchs and Rehm, 1977).
In summary, both approaches, in line with research on passive-aggressive personality disorder (Hopwood and Wright, 2012; Newton-Howes et al., 2015; Hopwood, 2018), assume that passive-aggressive behavior constitutes a relatively stable behavioral tendency that gets activated when individuals are exposed to internal or external stressors. Furthermore, passive-aggressive behavior is supposed to result from dysfunctional monitoring and evaluation processes, which are supposed to arise from negative childhood experiences. Therefore, passive aggression is assumed to be both a risk factor for and a result of psychopathology and interpersonal conflicts.
Psychometric Tests on Passive-Aggressive Behavior
The availability of a valid psychometric test is important for the development of a research field. To give an example, resilience research is closely related to the development of the sense of coherence questionnaire (Antonovsky, 1987; Eriksson and Lindström, 2006). The development of psychometric tests needs to follow the assumptions of the classical or probabilistic test theory (Hambleton and Jones, 1993). Moreover, tests need to fulfill quality criteria (i.e., objectivity, reliability, and validity). Although psychometric tests originated from the above-mentioned research traditions show good overall psychometric properties, their suitability for assessing passive-aggressive behavior is limited by their item content (e.g., Fydrich et al., 1997; Kuhl and Kazén, 1997; Mezo and Short, 2012). To date, clinical tests (i.e., of passive-aggressive personality disorders, defense mechanisms, or self-control mechanisms) assess broader nosological categories (including cognitions, emotions, and personality traits) instead of passive-aggressive behavior only. Additionally, psychometric tests from other psychological fields assess passive-aggressive behavior in very specific contexts (i.e., at the workplace) or from victim instead of perpetrator perspective (e.g., regarding social ostracism), and are thus not applicable in the clinical context (Williams and Sommer, 1997; Neuman and Baron, 1998, 2005). Therefore, in order to facilitate clinical research into passive-aggressive behavior, the current research project aimed at developing and validating the Test of Passive Aggression (TPA), a behavior-based test for the assessment of both self-directed and other-directed passive aggression.
Methods
Scale and Item Construction
Development of the TPA followed guidelines for the development of psychometric tests according to the classical test theory (Hambleton and Jones, 1993). First, the authors (CS, ME, SKS, HM, and TM) agreed on the definition of self-directed and other-directed passive-aggressive behavior: Passive-aggressive behavior is a stable behavioral disposition to harm oneself or others by omission in reaction to internal or external stressors. The test was supposed to consist of one scale for the assessment of self-directed passive aggression (TPA-SD) and another scale for the assessment of other-directed passive-aggression (TPA-OD). Second, the first author (CS) created a set of items, all of which followed the following pattern: (internal or external stressor) + (unpleasant feeling) + (passive-aggressive behavioral reaction). The scenarios were chosen to fit different backgrounds and thus reflect a broad range of daily scenarios (e.g., an argument with a partner, conflicts at work, or personal failure) to be more inclusive than previous instruments that were limited to specific contexts (e.g., conflicts at work). Even though all items were formulated by the first author (CS), previous assessment of passive-aggressive defense mechanisms and passive-aggressive personality disorder served as a basis for item generation of the TPA-OD scale (e.g., Andrews et al., 1993; Kuhl and Kazén, 1997). Items of the TPA-SD scale followed the rationale of the self-control theory of depression and therefore focused on behavioral patterns which deny one-self rewards, reinforcement, or self-satisfaction (Rehm, 1977; Mezo and Short, 2012). To reflect the stable character of passive-aggressive behavior, a five-point scale ranging from “1 = very unlikely” to “5 = very likely” was used, asking the respondents to estimate the probability to react in the described manner in general. Initially, 16 items each for the assessment of self-directed and other-directed passive-aggression were developed. At this point, 32 items for the assessment of active aggression had been formulated but were discarded in the following steps due to expert ratings and test statistics (mean item severity <0.20). Third, a pilot study was conducted to provide primarily information on test statistics (i.e., item severity, inter-item correlation) in a sample of adult (age ≥ 18 years) psychology students [N = 102, 86.27% females, M(age) = 21.44 years, SD(age) = 3.29]. For additional information on the pilot data, see Supplementary Material A. Based on these results, the authors (CS, EM, SS, HM, TM) refined the items and increased their number to 18 per scale (see Table 1 for the 36-item version of the TPA). Fourth, we analyzed the factorial structure in a larger clinical sample (Study 1), and fifth, we examined retest-reliability and construct validity of the TPA (Study 2).
Table 1
| Item | Item content | Scale |
|---|---|---|
| 1 | If I am feeling down, I do not allow myself to do things or activities that would have actually been good for me | TPA-SD |
| 2 | If I am successful at something, I overthink that success until I find something bad about it | TPA-SD |
| 3 | If I want to teach someone a lesson, I do not respond to his/her contact attempts and ignore his/her messages | TPA-OD |
| 4 | If I performed well at work/at study, I avoid talking about it with my family, because I do not think I really deserve any commends on it | TPA-SD |
| 5 | If someone has hurt my feelings, I refuse to support that person in difficult situations | TPA-OD |
| 6 | When I am irritated and notice that a friend is sad or upset, I do not ask what is bothering him/her | TPA-OD |
| 7 | If I have information that is useful to a person, I do not like, I still forward the information to that person* | TPA-OD |
| 8 | If I receive a present from someone, I will accept it, even when I have the feeling that I do not really deserve it* | TPA-SD |
| 9 | If I feel I have upset someone close to me, I subsequently forgo planned enjoyable activities, such as a good meal or wellness | TPA-SD |
| 10 | When someone takes time to support me in a stressful situation, I resist accepting the help because I cannot imagine truly deserving this support | TPA-SD |
| 11 | If I could help a person I do not like with a problem, I refuse from doing it | TPA-OD |
| 12 | When I plan my free time, I do not do what I assume is enjoyable for me, but rather I go by what other people, such as friends or family members, want me to do | TPA-SD |
| 13 | If I am angry at someone, I ignore that person and their needs | TPA-OD |
| 14 | If I am feeling down, I throw myself into taking care of everyday responsibilities, for e.g., work or housekeeping, instead of consciously doing something good for myself | TPA-SD |
| 15 | If I fail at something, I cancel planned leisure activities, for e.g., going to the cinema or going for shopping | TPA-SD |
| 16 | If I feel the need for interpersonal affection or an uplifting activity, I still continue in my daily routine instead of fulfilling that need | TPA-SD |
| 17 | If I have made a mistake, I refuse emotional support from other people afterwards | TPA-SD |
| 18 | If I am sad, I refuse to participate in activities that could cheer me up | TPA-SD |
| 19 | If someone at work/at university annoys me, I reduce my involvement in our teamwork | TPA-OD |
| 20 | If I am dissatisfied with someone's behavior, I do not address him/her directly, but react coolly or disinterestedly to his/her behavior | TPA-OD |
| 21 | If I have resources, for e.g., money or time, at my free disposal, I use them to make myself feel good* | TPA-SD |
| 22 | If I am angry at someone, I will not provide that person with emotional support | TPA-OD |
| 23 | When someone important to me has hurt me emotionally, I suspend existing habits with him/her, such as going for walks together or talking on the phone regularly | TPA-OD |
| 24 | If I am dissatisfied with the commitment of my colleagues in a team effort, I start performing at the minimum level required afterwards | TPA-OD |
| 25 | If someone has denied helping me with a problem, I am still willing to help that person with similar problems* | TPA-OD |
| 26 | If I know that someone I am upset with is about to make a mistake I do not make him/her aware of it | TPA-OD |
| 27 | If my partner does not see my needs, I pay him/her back by, for e.g., doing the shopping or cooking just for me | TPA-OD |
| 28 | Even when I am feeling bad, I still care more about other people's needs than my own | TPA-SD |
| 29 | If I am upset with a friend, I exclude him/her from enjoyable activities, for e.g., from trips or going to the cinema | TPA-OD |
| 30 | Even though I've had a particular wish for years, such as going on vacation or trying a new leisure activity, I always miss out on opportunities to fulfill that wish | TPA-SD |
| 31 | After an argument with someone close to me, I still try to give the day a positive turn afterwards, for e.g., by engaging in a hobby or some other pleasant leisure activity* | TPA-SD |
| 32 | When I doubt whether I have done a task well, I refuse to be complimented or rewarded by other people for this accomplishment | TPA-SD |
| 33 | After an argument with my partner, I refuse to show him/her any tenderness | TPA-OD |
| 34 | If I am upset with someone at work/at study, I do not give that person praise that they would have actually deserved | TPA-OD |
| 35 | When someone gives a kind comment to me, I am convinced that person just wants to be nice | TPA-SD |
| 36 | If a friend has disappointed me, I wait until he/she makes the first step toward me before getting back to him/her | TPA-OD |
Items of the 36-item version of the TPA.
Both studies used German versions of the Test of Passive Aggression. SD, self-directed aggression; OD, other-directed aggression.
inverse formulation.
Study 1
Study 1 aimed at initially validating and refining the 36-item version of the TPA. For this purpose, it examined the assumed bi-factorial structure of the TPA as well as its internal consistency and the relationships between other-directed and self-directed passive-aggression and depressive symptoms, somatoform symptoms, anxiety, and global psychopathological symptom severity.
Materials and Methods of Study 1
Participants and Procedure
A total of 319 patients 18 years and older participated in Study 1. Patients were recruited at a German psychosomatic clinic (MediClin Bliestal-Clinics, Blieskastel), where they received a 5-to-6-week multidisciplinary inpatient treatment. Twelve patients were excluded due to more than four missing values on the TPA. For the characteristics of the final sample see Table 2. Participants gave written informed consent according to the Declaration of Helsinki (World Medical Association, 2013) and completed the assessments described below on their arrival (M1) and again at their discharge (M2). Study 1 was preregistered at the German Clinical Trials Register (www.drks.de, ID: DRKS00014002), an online platform for preregistration of clinical studies.
Table 2
| M1 | M2 | |
|---|---|---|
| Female | 70.7% | 68.0% |
| Age mean | 53.21 years | 53.25 years |
| Age SD | 7.86 | 7.68 |
| Age range | 20–74 years | 20–72 years |
| Adjustment disorders | 39.60% | 40.80% |
| Mood disorders | 29.35% | 31.61% |
| Somatoform disorders | 17.41% | 15.52% |
| Anxiety disorders | 9.56% | 10.35% |
| Comorbidity rate | 48.50% | 46.10% |
Descriptive sample characteristics Study 1.
Total NM1 = 307; Total NM2 = 180. SD, Standard Deviation. Psychological diagnoses according to ICD-10. Comorbidity rate indicates the rate of at least one comorbid diagnosis.
Measures
The 36-item version of the TPA was used as a self-report assessment of passive-aggressive behavior. This TPA version consisted of 18 items for the assessment of self-directed passive-aggressive behavior and 18 items for the assessment of other-directed passive-aggressive behavior. Therefore, a bi-factorial structure—with one factor representing self-directed passive-aggressive behavior and the other factor representing other-directed passive-aggressive behavior—was assumed.
The Beck Depression Inventory–II (BDI-II) assessed the severity of depressive symptoms according to the Diagnostic and Statistical Manual of Mental Disorders-IV (DSM-IV; American Psychiatric Association, 1994; Beck et al., 1996; Hautzinger et al., 2009). Each of the 21 items is rated on a 0 to 3 scale, with higher scores indicating more severe depressive symptoms. The BDI-II is a well-established measure of depression with acceptable to excellent retest-reliability (rtt = 0.73 to 0.96; Wang and Gorenstein, 2013) and high validity (Hautzinger et al., 2009).
The Beck Anxiety Inventory (BAI) is a screening instrument to assess anxiety symptoms (Beck and Steer, 1993; Margraf and Ehlers, 2002). It consists of 21 items, rated on a 0 to 3 scale, with higher scores indicating more severe levels of anxiety. Whereas, the BAI shows excellent internal consistency (α = 0.91) and high validity, its retest-reliability is acceptable (rtt = 0.78; Geissner and Huetteroth, 2018).
The Hamburg Modules for the Assessment of Psychosocial Health in Clinical Practice (HEALTH-49; Rabung et al., 2007) assesses nine mental health-related subscales [somatoform complaints (SOM), depressiveness (DEP), phobic anxiety (PHO), psychological well-being, interactional problems, self-efficacy, activity and participation, social support, and social stress]. The scores of SOM (α = 0.82), DEP (α = 0.88), and PHO (α = 0.82–86) can be combined to a global symptom severity index (GSI, α = 0.89; Rabung et al., 2009).
Statistical Analysis
Exploratory Structural Equation Modeling (ESEM) was performed using R (Gascon et al., 2013) and the psych package (Revelle, 2015). All remaining statistical analyses were conducted using IBM SPSS Statistics version 25 (IBM Corp, 2017).
Item Reduction
As also indicated in the preregistration, Study 1 aimed to reduce items per scale to 12 for optimizing scales economy for use in clinical settings. For both subscales, item reduction followed a three-step procedure. First, all items with an item difficulty below 0.20 and above 0.80 were eliminated. Items severity was calculated by dividing the mean value per item by the maximum value per item (i.e., lower values represent higher item difficulty). Second, all items with an inter-item correlation below 0.30 were removed. Third, a primary axis factoring was conducted. The primary axis factoring was used for item reduction in order to choose the most representing items of each scale (i.e., items with the highest loading on the one factor solution). Subsequently, the bi-factorial structure of the refined TPA was analyzed using ESEM (see below).
Factorial Validity
The model-fit of the refined bi-factorial solution was analyzed using ESEM, which combines exploratory factor analysis with the assessment of model fit using structural equation modeling (SEM; Revelle, 2015). ESEM was found to be more appropriate than SEM for analyzing psychological instruments (Marsh et al., 2010, 2014). With respect to the current study, it is of particular importance that ESEM does not require zero cross-loadings, as other-directed and self-directed aggressive behavior are known to be strongly related (O'Donnell et al., 2015). All analyses used minimum residual estimations with pairwise exclusion and oblimin rotation. As the primary measures provided by the psych package, Chi-square-df-ratio (good fit < 2), Root Mean Square of the Residuals (RMSR, good fit > 0.05), and fit based upon off diagonal values (fit.off, good fit > 0.95) were used as fit indices (Hu and Bentler, 1999). Models were estimated for M1 and M2.
Internal Consistency and Item-Total Correlation
Internal consistency was calculated using Cronbach's alpha (α; Cronbach, 1951) and McDonald's omega (ω; McDonald, 1999). According to Mallery and George (2003), internal consistencies were interpreted as follows: >0.90 = excellent; >0.80 = good; >0.70 = acceptable; >0.60 = questionable; >0.50 = poor; and <0.50 = inacceptable. Internal consistencies as well as item-total correlations were analyzed for both points of assessment.
Association Between Passive-Aggressive Behavior and Symptom Clusters
Bivariate associations between passive-aggressive behavior and psychopathological symptom severity (BDI-II, BAI, SOM, DEP, PHO, and GSI) were analyzed using Pearson correlations. Given the strong correlation between depressive symptoms, somatoform symptoms, and anxiety symptoms (Rabung et al., 2009), two multiple regression analyses were conducted to assess the incremental proportion of variance of passive-aggressive behavior explained by each symptom domain (SOM, DEP, and PHO), under mutual control for the other symptom domains. Thereby, we aimed at investigating the unique association between depressive symptoms and passive-aggressive behavior irrespective of general psychopathology.
Results of Study 1
Item Reduction
One item of the TPA-OD was removed due to an item difficulty below 0.20 (item 27). Another five items were removed since all inter-item correlations fell below 0.30 (items 6, 7, 24, 25, 26). All remaining items demonstrated factor loadings above 0.30 on the one-factor solution of a principal axis factoring. All items of the TPA-SD showed an item difficulty above 0.20 and below 0.80. Four items were removed since all inter-item correlations were below 0.30 (items 1, 8, 21, 31). All remaining items showed factor loadings above 0.30 on the one-factor solution of a primary axis factoring. In order to reduce the number of items to 12, the two items exhibiting the lowest factor loading were removed (items 4, 28).
Model-Fit of the Two-Factor Solution
Fit indices of both measure points are presented in Table 3. Overall, ESEM revealed an acceptable to good model fit for the bi-factor solution of the refined TPA. Factor loadings of all items on the respective factor ranged between 0.45 and 0.69 at M1 and between 0.38 and 0.77 at M2. The correlation between TPA-SD and TPA-OD was strong at M1 (r = 0.52) and medium at M2 (r = 0.38).
Table 3
| RMSR | Fit.off | Chi-square | Chi-square-df-ratio | |
|---|---|---|---|---|
| M1 | 0.05 | 0.96 | 452.83 | 1.98 |
| M2 | 0.06 | 0.96 | 372.09 | 2.46 |
Model fit of ESEM.
RMSR, Root Mean Square of the Residuals; Fit.off, Fit based upon of diagonal values.
Internal Consistency and Item-Total Correlation
Internal consistencies were good at M1 (αother−directed = 0.83; ω other−directed = 0.83; αself−directed = 0.84; ω other−directed = 0.85) and M2 (αother−directed = 0.86; ω other−directed = 0.86; αself−directed = 0.89; ω self−directed = 0.89). Item-total correlations at M1 ranged between 0.40 and 0.61 for the TPA-OD and the TPA-SD. Similarly, at M2 item-total correlations ranged from 0.36 to 0.66 for the TPA-OD and from 0.38 to 0.73 for the TPA-SD. Further item characteristics are presented as Supplementary Material B.
Association Between Passive-Aggressive Behavior and Symptom Clusters
Bivariate correlations between both TPA scales and psychopathological symptom levels are presented in Table 4. In line with our hypotheses, both self-directed and other-directed passive-aggressive behavior were associated with all symptom domains. However, an association of other-directed passive-aggressive behavior with anxiety levels was represented in the BAI only. Results of the multiple regression analyses for the prediction of self-directed and other-directed passive-aggressive behavior based on depressive, phobic, and somatic symptoms are presented in Tables 5, 6. In line with self-control theory of depression, self-directed passive-aggressive behavior demonstrated a particularly strong unique association with depressive symptoms. By contrast, for none of the symptom domains a unique association with other-directed passive-aggressive behavior was detected.
Table 4
| TPA-OD | TPA-SD | |
|---|---|---|
| HEALTH-49-GSI | 0.19* | 0.39** |
| HEALTH-49-DEP | 0.15* | 0.39** |
| HEALTH-49-SOM | 0.14* | 0.34** |
| HEALTH-49-PHO | 0.17* | 0.26** |
| BDI-II | 0.14* | 0.40** |
| BAI | 0.09 | 0.39** |
Bivariate correlations of both TPA scales and symptom severities.
HEALTH-49, The Hamburg Modules for the Assessment of Psychosocial Health in Clinical Practice; GSI, general symptom index; SOM, somatoform complaints; DEP, depressiveness, PHO, phobic anxiety; BDI-II, Beck-Depression Inventory–II; BAI, Beck-Anxiety Inventory.
p < 0.05;
p < 0.001.
Table 5
| Beta | T | p | |
|---|---|---|---|
| HEALTH-49-DEP | 0.27 | 3.79 | <0.001 |
| HEALTH-49-SOM | 0.17 | 2.46 | 0.014 |
| HEALTH-49-PHO | 0.05 | 0.41 | 0.679 |
Multiple regression for prediction of TPA-SD.
Criterium is the self-directed passive-aggression scale of the TPA. HEALTH-49, The Hamburg Modules for the Assessment of Psychosocial Health in Clinical Practice; GSI, general symptom index; SOM, somatoform complaints; DEP, depressiveness, PHO, phobic anxiety. Model: F(3,280) = 19.01; R2 = 0.17; p < 0.001.
Table 6
| Beta | T | p | |
|---|---|---|---|
| HEALTH-49-DEP | 0.06 | 0.78 | 0.439 |
| HEALTH-49-SOM | 0.05 | 0.70 | 0.485 |
| HEALTH-49-PHO | 0.12 | 1.68 | 0.094 |
Multiple regression for prediction of TPA-OD.
Criterium is the other-directed passive-aggression scale of the TPA. HEALTH-49, The Hamburg Modules for the Assessment of Psychosocial Health in Clinical Practice; GSI, general symptom index; SOM, somatoform complaints; DEP, depressiveness; PHO, phobic anxiety. Model: F (3,280) = 3.44; R2 = 0.04; p = 0.017.
Discussion of Study 1
In Study 1, the 36-items version of the TPA was evaluated and reduced to its final 24-items form. Applying ESEM, we confirmed the bi-factorial structure of the TPA, consisting of TPA-SD and TPA-OD. Additionally, Study 1 verified good internal consistencies for both scales.
Study 1 also revealed small to moderate associations between passive-aggressive behavior and psychopathological symptom severity in a clinical inpatient sample. Other-directed passive-aggression was associated with global psychopathological symptom severity, but not with specific symptom domains. These results are in line with previous research showing that active other-directed aggressive behavior (Genovese et al., 2017) as well as passive-aggressive personality (Laverdière et al., 2019) and passive-aggressive defense style (Bond, 2004) are relevant in a broad range of mental disorders. Thus, other-directed passive-aggressive behavior might represent a reaction to general mental distress. This view also contributed to the removal of passive-aggressive personality disorder from DSM-5 (Wetzler and Jose, 2012).
By contrast, in addition to its association with global psychopathological symptom burden, self-directed passive-aggressive behavior exhibited specific unique associations with depressive and somatoform symptoms. In bivariate and multivariate analyses, depressive symptoms were the numerically strongest correlates for self-directed passive-aggressive behavior. The association of self-directed passive-aggressive behavior and depressive symptoms is in line with the self-control theory postulating that dysfunctional self-monitoring and self-evaluation processes in depressed patients lead to a lack of self-reinforcing behavior (i.e., self-harm by omission; Fuchs and Rehm, 1977; Rehm, 1977; Rozensky et al., 1977; Roth and Rehm, 1980). Furthermore, this association corresponds to previous research on active aggressive behavior indicating that both forms of self-directed aggressive behavior are strongly related to depression severity (Hawton et al., 2013; Plener et al., 2015; Harford et al., 2018).
Like depressive symptoms, somatoform symptoms explained an incremental proportion of variance in self-directed passive-aggressive behavior. Correspondingly, former research found high rates of comorbidity between somatoform disorders and passive-aggressive personality disorder (Bass and Murphy, 1995; Noyes et al., 2001). Since associations between somatization and self-directed passive-aggressive behavior have not yet been examined in previous research, our result needs to be replicated in further studies.
Limitations
The following limitations have to be taken into account: In contrast to internal consistency, methods of Study 1 did not allow a valid examination of retest-reliability. The analysis of retest-reliability would have required a time interval, in which the concept of interest is supposed to be relatively stable. However, patients of Study 1 received a multidisciplinary intervention, including psychotherapeutic and psychopharmacological treatment, and therefore interventions sufficient to change levels of aggressive behavior (Jones R. M. et al., 2011; Karakurt et al., 2016; Kothgassner et al., 2020). Thus, there is the need of another study to further examine the retest-reliability of the TPA in a non-clinical context.
Given that, an additional assessment of other constructs (e.g., active aggression, impulsivity) would have exceeded capacities of clinical staff, we were also not able to assess construct validity in Study 1.
Another limitation refers to the diagnostic process in Study 1. Whereas, symptom severity was assessed using standardized measures (Beck and Steer, 1993; Beck et al., 1996; Rabung et al., 2007), psychiatric diagnoses were based on unstructured clinical interviews known to be less accurate than structured interviews (Miller et al., 2001). Therefore, our main analyses regarding associations between self-reported passive-aggressive behavior and symptom clusters were based on regression models relying on standardized measures instead of group comparisons. Future studies in clinical samples should use structured clinical interviews to enable valid analyses of group differences of passive-aggressive behavior.
Study 2
Study 1 resulted in the final 24-item version of the TPA and demonstrated its factorial validity and internal consistency. However, data on test-retest reliability and construct validity were still missing. Therefore, Study 2 aimed at closing this gap.
Materials and Methods of Study 2
Participants and Procedure
Participants of Study 2 were adult (age ≥ 18 years) undergraduate students, recruited in psychology lectures at Saarland University. Participants received course credits for their participation. After given written informed consent in line with the Declaration of Helsinki (World Medical Association, 2013), data was collected using the online survey platform SoSci Survey (Leiner, 2014). To assess the test-retest-reliability of the TPA, participants received survey links at three 14-day intervals via email. Additionally, participants completed German versions of the Short Questionnaire for the Assessment of Components of Aggression [K-FAF, Heubrock and Petermann (2008)], the NEO Five Factor Inventory [NEO-FFI, Borkenau and Ostendorf (1994), Costa and McCrae (1989)], and the short version of the Barratt Impulsiveness Scale [BIS-15, Meule et al. (2011)] at the first point of assessment (M1). See Table 7 for sample characteristics. Study 2 was also preregistered at the German Clinical Trials Register (www.drks.de, ID: DRKS00014607).
Table 7
| M1 | M2 | M3 | |
|---|---|---|---|
| N | 180 | 140 | 133 |
| Women | 75.6% | 77.1% | 77.4% |
| Age meana | 21.55 years | 21.64 years | 21.53 years |
| Interval to M1 mean | – | 12.44 days | 26.90 days |
| Interval to M1 range | – | 7–20 days | 21–34 days |
Descriptive sample characteristics Study 2.
Age range for all measure points was 18–32 years.
Measures
Self-directed and other-directed passive-aggressive behavior were assessed using the 24-item version of the TPA (see Study 1).
The K-FAF includes 49 items assessing aggression on five dimensions (spontaneous aggression, reactive aggression, irritability, auto-aggression, aggression inhibition; Heubrock and Petermann, 2008). The K-FAF was chosen because its scales allow for an economic assessment of self- and other-directed aggression. However, the internal consistencies of the K-FAF scales are only poor (aggression inhibition; α = 0.55) to good (irritability; α = 0.84). We hypothesized that convergent validity of the TPA-OD should be reflected in at least medium-sized relationships between the TPA-OD and the active aggression scales of the K-FAF (i.e., spontaneous and reactive aggression). Self-directed passive-aggressive behavior is supposed to result from negative self-monitoring and self-evaluation processes in depression (Rehm, 1977). Therefore, it should be closely related to self-conscious emotions (Laye-Gindhu and Schonert-Reichl, 2005), self-reproach (Jinting and Hairong, 2019), and self-criticism (Gilbert et al., 2010). The auto-aggression scale of the K-FAF comprises these aspects. Thus, we expected the TPA-SD and the auto-aggression scale to show an at least medium-sized correlation.
The NEO-FFI is a short version of the Revised NEO Personality Inventory (Costa and Mac Crae, 1992) and assesses five personality traits (openness, conscientiousness, extraversion, agreeableness, neuroticism) using 60 items (Costa and McCrae, 1989; Borkenau and Ostendorf, 1994). The NEO-FFI is a well-established and widely used instrument in research on the relationship between personality traits and aggressive behavior (Burton et al., 2007; Grumm and von Collani, 2009; Carvalho and Nobre, 2019). The internal consistencies of its scales are questionable (openness; α = 0.61 to 0.71) to good (neuroticism, α =0.81 to 0.85). Given that other-directed passive-aggressive behavior has been shown to be associated with interpersonal conflicts (Laverdière et al., 2019), convergent validity of the TPA-OD would be reflected in an at least medium-sized negative correlation with agreeableness (Jones S. E. et al., 2011). Neuroticism is related to lower levels of internal control, self-esteem, and general self-efficacy (Judge et al., 2002). Thereby, it reflects one facet of self-evaluation (Chang et al., 2012). Thus, we expected an at least medium-sized relationship between neuroticism and TPA-SD to evidence convergent validity (Brown, 2009). Since conscientiousness is closely related to delayed gratification (a construct that needs to be distinguished from self-directed passive-aggression; Furnham and Cheng, 2019), an at the most small correlation between conscientiousness and TPA-SD should reflect its discriminant validity.
The BIS-15 is a short version of the Barratt Impulsiveness Scale−11 (Patton et al., 1995; Preuss et al., 2008), the standard assessment of impulsivity (Stanford et al., 2009). Its economic 15-item version showed good reliability (α = 0.81; Meule et al., 2011). Impulsivity, a predisposition for rash and spontaneous behavior, is a strong predictor for active other-directed (Bresin, 2019) and self-directed (Gvion and Apter, 2011; Hamza et al., 2015) aggressive behavior. By contrast, passive-aggressive behavior is supposed to harm by omission and should thus be explicitly characterized by a lack of impulsive action (Buss, 1961; Parrott and Giancola, 2007). However, given passive-aggressive behavior is also positively associated with active aggressive behavior, we expected passive-aggressive behavior to be independent from impulsiveness, reflected in an at the most small correlation between the TPA scales and the BIS-15 as further support of discriminant validity.
Data Analysis
All analyses were performed using IBM SPSS Statistics 25 (IBM Corp, 2017). For the evaluation of test-retest-reliability, Pearson correlations for both TPA scales were calculated for all points of assessment. Internal consistencies were analyzed for all measure points using α (Cronbach, 1951) and ω (McDonald, 1999). As in Study 1, internal consistencies were interpreted as follows: >0.90 = excellent; >0.80 = good; >0.70 = acceptable; >0.60 = questionable; >0.50 = poor; and <0.50 = inacceptable (Mallery and George, 2003). To evaluate construct validity Pearson correlations were calculated for both TPA scales with the BIS-15 and the subscales of the K-FAF and the NEO-FFI.
Results of Study 2
Reliability
For both TPA scales retest-reliabilities were good to excellent (see Table 8). The internal consistencies of TPA-OD were good and the TPA-SD showed good to excellent internal consistencies (see Table 9).
Table 8
Retest-reliability of the TPA scales.
Correlations above the diagonal are retest-reliabilities for the self-directed passive-aggressive behavior scale. Correlations beneath the diagonal are retest-reliabilities for the other-directed passive-aggressive behavior scale.
n = 140,
n = 139,
n = 133,
n = 120,
n = 119.
Table 9
Internal consistencies of the TPA scales.
Coefficients are internal consistencies for each measure point.
n = 180,
n = 139,
n = 133.
Validity
Bivariate correlations between the TPA scales, the BIS-15, the subscales of the NEO-FFI, and the K-FAF are presented in Table 10. Construct validity of the TPA-OD was supported by significant medium to large correlations with spontaneous aggression and reactive aggression as well as a negative medium correlation with agreeableness. Discriminant validity of the TPA-OD was confirmed by a non-significant association with impulsiveness. Furthermore, construct validity of the TPA-SD was supported by large significant correlations with auto-aggression and neuroticism. Moreover, discriminant validity of the TPA-SD was confirmed by non-significant associations with impulsiveness and conscientiousness.
Table 10
| Other-Directed | Self-Directed | |
|---|---|---|
| K-FAF | ||
| Spontaneous aggression | 0.42** | 0.22** |
| Reactive aggression | 0.54** | 0.21** |
| Irritability | 0.38** | 0.21** |
| Auto-Aggression | 0.27** | 0.66** |
| Aggression inhibition | −0.10 | 0.16* |
| NEO-FFI | ||
| Openness | −0.11 | 0.07 |
| Conscientiousness | 0.03 | 0.13 |
| Extraversion | −0.23** | −0.47** |
| Agreeableness | −0.43** | −0.14 |
| Neuroticism | 0.25** | 0.58** |
| BIS-15 | 0.13 | 0.03 |
Construct validity of the TPA scales.
K-FAF, Kurzfragebogen zur Erfassung von Aggressivitätsfaktoren (short questionnaire for the assessment of components of aggression); NEO-FFI, NEO Five Factor Inventory; BIS-15, Barratt Impulsiveness Scale–Short Version.
p < 0.05,
p < 0.01.
Discussion of Study 2
Study 2 revealed high correlations between passive-aggressive behavior and active aggression, neuroticism, and agreeableness (inverse) as well as small insignificant correlations between passive-aggressive behavior and impulsivity and consciousness, thereby demonstrating convergent and discriminant validity of both the TPA-OD and TPA-SD scale.
As aggression is supposed to represent a trait-like behavioral tendency, which should remain stable over time (Huesmann et al., 2009), substantial retest-reliability is of critical relevance for its assessment. Both the TPA-OD and the TPA-SD scale showed good to excellent retest-reliabilities over a period of ~4 weeks. Moreover, both TPA scales showed good to excellent internal consistencies. Compared to well-established scales assessing active aggressive behavior, the TPA exhibits comparable or even higher reliability (see Table 11).
Table 11
| rtt (interval) | α | |
|---|---|---|
| TPA other-directed | 0.86 (26.90 days) | 0.83–0.89 |
| TPA self-directed | 0.86 (26.90 days) | 0.84–0.90 |
| AQ (Herzberg, 2003) | 0.69–0.81 (31 days) | 0.65–0.88 |
| STAXI-2 AX-O (Rohrmann et al., 2013) | 0.81 (6 weeks) | 0.86 |
| STAXI-2 AX-I (Rohrmann et al., 2013) | 0.80 (6 weeks) | 0.81 |
| K-FAF spontaneous aggression (Heubrock and Petermann, 2008) | – | 0.77 |
| K-FAF reactive aggression (Heubrock and Petermann, 2008) | – | 0.77 |
| K-FAF auto-aggression (Heubrock and Petermann, 2008) | – | 0.82 |
| DSHI (Gratz, 2001) | 0.68a (3.3 weeks) | 0.82 |
| SIQ (Santa Mina et al., 2006) | 0.88 (2 weeks) | 0.83 |
Examples for retest-reliabilities and internal consistencies of aggression questionnaires.
AQ, Buss and Perry Aggression Questionnaire; STAXi-2, State-Trait-Anger-Expression Inventory-2; K-FAF, Kurzfragebogen zur Erfassung von Aggressivitätsfaktoren (short questionnaire for the assessment of components of aggression); DSHI, Deliberate Self-Harm Inventory; SIQ, Self-Injury Questionnaire;
Φ.
Convergent validity of the TPA was supported by medium to high correlations between the corresponding TPA and K-FAF scales, which are well-established assessments of aggressive behavior. These associations underline the notion that passive-aggressive behavior represents a form of aggressive behavior, even though it is characterized by the absence of active behavioral engagement. Furthermore, in contrast to active aggressive behavior (Bresin, 2019), the TPA scales were not significantly correlated with impulsivity. This result provides further evidence for an increment of the assessment of passive-aggressive behavior above the general assessment of aggressive behavior.
According to the DSM-IV, individuals with passive-aggressive personality disorder are supposed to let others down, provide less social support, and be not trustworthy (American Psychiatric Association, 1994). These behavioral tendencies are assumed to lay the foundation for high rates of interpersonal conflicts (McCann, 1988). Therefore, the negative association between TPA-OD and agreeableness is in line with theoretical considerations. The same applies to the relationship between TPA-SD and neuroticism that supports the notion that self-directed passive-aggressive behavior might be driven by dysfunctional self-evaluation (Rehm, 1977; Chang et al., 2012). A lack of self-reinforcement could not only represent a form of self-directed aggressive behavior but also the capability for delayed gratification, which is associated with consciousness (Furnham and Cheng, 2019). Therefore, given that it is essential to aggressive behavior that it is committed with intention (Allen and Anderson, 2017), our finding of a small and insignificant association between the TPA-SD and consciousness supports the discriminant validity of the scale.
Limitations
In contrast to Study 1, Study 2 allowed for the analysis of test-retest reliability and construct validity of the TPA by the use of a student sample. However, findings on the transferability of results from student samples to clinical samples or the general population are mixed (Henry, 2008; Boals et al., 2020). Therefore, future studies should examine the test-retest-reliability and construct validity of the TPA in a waiting list sample.
General Discussion
Study 1 and Study 2 showed that the TPA is a reliable and valid assessment of other-directed and self-directed passive-aggressive behavior. In contrast to previous scales for the assessment of other-directed passive-aggressive behavior that were mostly targeting broader nosological categories, e.g., passive-aggressive personality disorder, the TPA-OD scale does not assess personality traits (e.g., hostility) or emotions (e.g., feelings of anger) but passive-aggressive behavior directly. This is a major advantage for investigating precursors and consequences of other-directed passive-aggressive behavior because it helps to minimize confounders. For example, when investigating the association between psychopathological symptoms and aggressive behavior, emotional confounders like anger or sadness are particularly relevant. Therefore, future studies should make use of this advantage of the TPA and investigate which (internal or external) variables predict other-directed passive-aggressive behavior and to what extent other-directed passive-aggressive behavior has a predictive value for the development and course of mental disorders.
Moreover, in contrast to previous assessments of passive-aggressive behavior, the TPA is the first to include an assessment of self-directed passive-aggressive behavior, which may be of major relevance in the context of depressive disorders (Rehm, 1977). The unique association of self-directed passive-aggressive behavior with depressive symptoms in Study 1 provided first evidence for this notion. Future clinical studies should investigate the longitudinal relationship between self-directed passive-aggressive behavior and depressive symptoms. These studies should also use structured clinical interviews to examine if self-directed passive-aggressive behavior occurs more frequently in depressive disorders than in other mental disorders.
As outlined in the introduction, passive-aggressive behavior is one dimension of the broader construct of aggressive behavior. Therefore, one might expect that many of the general assumptions on aggression also apply to passive-aggressive behavior (e.g., its emotional and cognitive precursors or its stability over the life course). Nevertheless, future studies need to test this hypothesis by investigating which personal and/or situational factors contribute to different expressions of aggressive behavior. In this context, Study 2 provided first insight by demonstrating passive-aggressive behavior to be independent from impulsivity.
Conclusion
The TPA is a reliable and valid self-report instrument for the assessment of other-directed and self-directed passive-aggressive behavior. The current study indicates a substantial overlap between passive- and active-aggressive behavior, but it indicates that passive-aggressive behavior occurs independently from impulsiveness. Self-directed passive-aggressive behavior is significantly associated with depressive and somatoform symptoms. Future studies should assess both active- and passive-aggressive behavior in clinical samples to provide further insights into the relationships between aggressive behavior, intra- and interpersonal conflicts, and psychopathological symptoms.
Statements
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics statement
The studies involving human participants were reviewed and approved by the ethics comitee of the Saarland University. The patients/participants provided their written informed consent to participate in this study.
Author contributions
CS designed the study, organized sample recruitment, analyzed and interpreted the data, drafted the article, and prepared the final manuscript. MK helped to design the study and contributed to sample recruitment. TM, ME, SS, and HM contributed to conception and design of the study, supported the interpretation of the data, and commented on manuscript drafts. All authors read and approved the final manuscript.
Acknowledgments
We gratefully thank the staff of the Clinic for Psychosomatic Medicine of the MediClin Bliestal-Clinics, Blieskastel. We thank all therapists for their support in carrying out this study. We thank our students Lisa Ludwig and Sören Samadi for their support in the course of data collection.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2021.579183/full#supplementary-material
Data Sheet 1Supplementary Material A and B.
References
1
AllenJ. J.AndersonC. A. (2017). “Aggression and violence: definitions and distinctions,” in The Wiley Handbook of Violence and Aggression, 1–14. 10.1002/9781119057574.whbva001
2
American Psychiatric Association (1952). Diagnostic and Statistical Manual of Mental Disorders. Washington, DC: APA.
3
American Psychiatric Association (1994). Diagnostic and Statistical Manual of Mental Disorders. 4th Edn. Washington, DC: American Psychiatric Association.
4
American Psychiatric Association (2013). Diagnostic and Statistical Manual of Mental Disorders. 5th Edn. American Psychiatric Association. 10.1176/appi.books.9780890425596
5
AndrewsG.SinghM.BondM. (1993). The defense style questionnaire. J. Nerv. Ment. Dis. 181, 246–56. 10.1097/00005053-199304000-00006
6
AntonovskyA. (1987). Unraveling the Mystery of Health : How People Manage Stress and Stay Well. 1st Edn. San Francisco, CA: Jossey-Bass.
7
AugsburgerM.MaerckerA. (2020). Associations between trauma exposure, posttraumatic stress disorder, and aggression perpetrated by women. A meta-analysis. Clin. Psychol. Sci. Pract.27:e12322. 10.1037/h0101759
8
BaronR. A.NeumanJ. H. (1996). Workplace violence and workplace aggression: Evidence on their relative frequency and potential causes. Aggress. Behav.22, 161–173. 10.1002/(SICI)1098-2337(1996)22:3<161::AID-AB1>3.0.CO;2-Q
9
BaronR. A.RichardsonD. R. (2004). Human Aggression. New York, NY: Springer Science & Business Media.
10
BassC.MurphyM. (1995). Somatoform and personality disorders: syndromal comorbidity and overlapping developmental pathways. J. Psychosom. Res.39, 403–427. 10.1016/0022-3999(94)00157-Z
11
BaykaraS.AlbanK. (2018). The relationship between self-harming behavior, suicide attempt history and defense mechanisms in patients with opioid-use disorder. Dusunen Adam J. Psychiatry Neurol. Sci.31, 265–273. 10.5350/DAJPN2018310304
12
BeckA. T.SteerR. A. (1993). BAI: Beck Anxiety Inventory. San Antonio, TX: Psychological Corporation.
13
BeckA. T.SteerR. A.BrownG. K. (1996). Beck depression inventory-II. San Antonio78, 490–498. 10.1037/t00742-000
14
BoalsA.ContractorA. A.BlumenthalH. (2020). The utility of college student samples in research on trauma and posttraumatic stress disorder: a critical review. J. Anxiety Disord. 73:102235. 10.1016/j.janxdis.2020.102235
15
BondM. (2004). Empirical studies of defense style: Relationships with psychopathology and change. Harv. Rev. Psychiatry12, 263–278. 10.1080/10673220490886167
16
BorkenauP.OstendorfF. (1994). Das NEO Fünf-Faktoren Inventar (NEO-FFI). Handanweisung, Göttingen: Hogrefe.
17
BresinK. (2019). Impulsivity and aggression: a meta-analysis using the UPPS model of impulsivity. Aggress. Violent Behav. 48, 1–240. 10.1016/j.avb.2019.08.003
18
BriereJ.GilE. (1998). Self-mutilation in clinical and general population samples: prevalence, correlates, and functions. Am. J. Orthopsychiatry68, 609–620. 10.1037/h0080369
19
BrownS. A. (2009). Personality and non-suicidal deliberate self-harm: trait differences among a non-clinical population. Psychiatry Res.169, 28–32. 10.1016/j.psychres.2008.06.005
20
BurtonL. A.HafetzJ.HenningerD. (2007). Gender differences in relational and physical aggression. Soc. Behav. Personal. Int. J.35, 41–50. 10.2224/sbp.2007.35.1.41
21
BussA. H. (1961). The Psychology of Aggression. New York, NY: Wiley. 10.1037/11160-000
22
BussD. M.ShackelfordT. K. (1997). Human aggression in evolutionary psychological perspective. Clin. Psychol. Rev.17, 605–619. 10.1016/S0272-7358(97)00037-8
23
CafferkyB. M.MendezM.AndersonJ. R.StithS. M. (2018). Substance use and intimate partner violence: a meta-analytic review. Psychol. Viol.8, 110–131. 10.1037/vio0000074
24
CarvalhoJ.NobreP. J. (2019). Five-factor model of personality and sexual aggression. Int. J. Offender Ther. Comp. Criminol.63, 797–814. 10.1177/0306624X13481941
25
ChangC.FerrisD. L.JohnsonR. E.RosenC. C.TanJ. A. (2012). Core self-evaluations: a review and evaluation of the literature. J. Manage.38, 81–128. 10.1177/0149206311419661
26
CimineroA. R.SteingartenK. A. (1978). The effects of performance standards on self-evaluation and self-reinforcement in depressed and nondepressed individuals. Cognit. Ther. Res. 2, 179–182. 10.1007/BF01172731
27
CostaP. T.Mac CraeR. R. (1992). Neo Personality Inventory-Revised (NEO PI-R).Odessa, FL: Psychological Assessment Resources.
28
CostaP. T.McCraeR. R. (1989). NEO Five-Factor Inventory (NEO-FFI).Odessa, FL: Psychological Assessment Resources.
29
CramerP. (2015). Understanding defense mechanisms. Psychodyn. Psychiatry43, 523–552. 10.1521/pdps.2015.43.4.523
30
CronbachL. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika16, 297–334. 10.1007/BF02310555
31
De RaedtR.KosterE. H. W. (2010). Understanding vulnerability for depression from a cognitive neuroscience perspective: a reappraisal of attentional factors and a new conceptual framework. Cogn. Affect. Behav. Neurosci.10, 50–70. 10.3758/CABN.10.1.50
32
DuttonD. G.KarakantaC. (2013). Depression as a risk marker for aggression: a critical review. Aggress. Violent Behav.18, 310–319. 10.1016/j.avb.2012.12.002
33
EdmondsonA. J.BrennanC. A.HouseA. O. (2016). Non-suicidal reasons for self-harm: a systematic review of self-reported accounts. J. Affect. Disord.191, 109–117. 10.1016/j.jad.2015.11.043
34
ErikssonM.LindströmB. (2006). Antonovsky's sense of coherence scale and the relation with health: a systematic review. J. Epidemiology. Commun. Health60, 376–381. 10.1136/jech.2005.041616
35
FliegeH.LeeJ.GrimmA.KlappB. F. (2009). Risk factors and correlates of deliberate self-harm behavior: a systematic review. J. Psychosom. Res66, 477–493. 10.1016/j.jpsychores.2008.10.013
36
FoxK. R. F.JosephCRibeiroJ. D.KleimanE. M.BentleyK. H.NockM. K. (2015). Meta-analysis of risk factors for nonsuicidal self-injury. Clin. Psychol. Rev42, 156–167. 10.1016/j.cpr.2015.09.002
37
FreudA. (1936). The Ego and the Mechanisms of Defence. New York, NY: International University Press, 1946.
38
FuchsC. Z.RehmL. P. (1977). A self-control behavior therapy program for depression. J. Consult. Clin. Psychol.45:206. 10.1037/0022-006X.45.2.206
39
FurnhamA.ChengH. (2019). The Big-Five personality factors, mental health, and social-demographic indicators as independent predictors of gratification delay. Pers. Individ. Dif.150:109533. 10.1016/j.paid.2019.109533
40
FydrichT.RennebergB.SchmitzB.WittchenH. U. (1997). Strukturiertes Klinisches Interview für DSM-IV Achse II: Persönlichkeitsstörungen (SKID-II).Göttingen: Hogrefe.
41
GasconS.LeiterM. P.AndresE.SantedM. A.PereiraJ. P.CunhaM. J.et al. (2013). The role of aggressions suffered by healthcare workers as predictors of burnout. J. Clin. Nurs.22, 3120–3129. 10.1111/j.1365-2702.2012.04255.x
42
GeissnerE.HuetterothA. (2018). Beck Anxiety Inventory deutsch–Ein reliables, valides und praxisgeeignetes Instrument zur Messung klinischer Angst. Psychother. Psychoso. Med. Psychol.68, 118–125. 10.1055/s-0043-122941
43
GenoveseT.DalrympleK.ChelminskiI.ZimmermanM. (2017). Subjective anger and overt aggression in psychiatric outpatients. Compr. Psychiatry73, 23–30. 10.1016/j.comppsych.2016.10.008
44
GeorgievA. V.KlimczukA. C. E.TraficonteD. M.MaestripieriD. (2013). When violence pays: a cost-benefit analysis of aggressive behavior in animals and humans. Evol. Psychol.11:147470491301100313. 10.1177/147470491301100313
45
GhazwinM. Y.TavakoliS. A. H.LatifiS.SaberiH.DerakhshanradN.YekaninejadM. S.et al. (2017). Psychological defense mechanisms among individuals with SCI with adjustment disorder. J. Spinal Cord Med.40, 538–547. 10.1080/10790268.2016.1140389
46
GilbertP.McEwanK.IronsC.BhundiaR.ChristieR.BroomheadC.et al. (2010). Self-harm in a mixed clinical population: the roles of self-criticism, shame, and social rank. Br. J. Clin. Psychol.49, 563–576. 10.1348/014466509X479771
47
GratzK. L. (2001). Measurement of deliberate self-harm: preliminary data on the deliberate self-harm inventory. J. Psychopathol. Behav. Assess.23, 253–263. 10.1023/A:1012779403943
48
GrummM.von CollaniG. (2009). Personality types and self-reported aggressiveness. Pers. Individ. Dif.47, 845–850. 10.1016/j.paid.2009.07.001
49
GvionY.ApterA. (2011). Aggression, impulsivity, and suicide behavior: a review of the literature. Arch. Suic. Res.15, 93–112. 10.1080/13811118.2011.565265
50
HambletonR. K.JonesR. W. (1993). Comparison of classical test theory and item response theory and their applications to test development. Educ. Measure. Issues Pract.12, 38–47. 10.1111/j.1745-3992.1993.tb00543.x
51
HamzaC. A.WilloughbyT.HefferT. (2015). Impulsivity and nonsuicidal self-injury: a review and meta-analysis. Clin. Psychol. Rev.38, 13–24. 10.1016/j.cpr.2015.02.010
52
HarfordT. C.ChenC. M.KerridgeB. T.GrantB. F. (2018). Self- and other-directed forms of violence and their relationship with lifetime DSM-5 psychiatric disorders: results from the national epidemiologic survey on alcohol related conditions - III (NESARC - III). Psychiatry Res.262, 384–392. 10.1016/j.psychres.2017.09.012
53
HautzingerM.KellerF.KühnerC. (2009). BDI-II. Beck-Depressions-Inventar. Revision. 2, Auflage. Frankfurt: Pearson Assessment.
54
HawtonK.SaundersK.TopiwalaA.HawC. (2013). Psychiatric disorders in patients presenting to hospital following self-harm: a systematic review. J. Affect. Disord.151, 821–830. 10.1016/j.jad.2013.08.020
55
HeilbronN.PrinsteinM. J. (2008). A review and reconceptualization of social aggression: adaptive and maladaptive correlates. Clin. Child Fam. Psychol. Rev.11, 176–217. 10.1007/s10567-008-0037-9
56
HenryP. J. (2008). College sophomores in the laboratory redux: influences of a narrow data base on social psychology's view of the nature of prejudice. Psychol. Inq. 19, 49–71. 10.1080/10478400802049936
57
HerzbergP. Y. (2003). Der fragebogen zur erfassung aggressiver verhaltensweisen im Straßenverkehr (AViS). Zeitschrift Different. Diagnost. Psychol.24, 45–55. 10.1024//0170-1789.24.1.45
58
HeubrockD.PetermannF. (2008). Kurzfragebogen zur Erfassung von Aggressivitätsfaktoren:Göttingen: Hogrefe.
59
HopwoodC. J. (2018). Interpersonal dynamics in personality and personality disorders. Eur. J. Pers.32, 499–524. 10.1002/per.2155
60
HopwoodC. J.WrightA. G. C. (2012). A comparison of passive–aggressive and negativistic personality disorders. J. Pers. Assess.94, 296–303. 10.1080/00223891.2012.655819
61
HuL. T.BentlerP. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct. Equat. Model. Multidiscipl. J.6, 1–55. 10.1080/10705519909540118
62
HuT.ZhangD.YangZ. (2015). The relationship between attributional style for negative outcomes and depression: a meta-analysis. J. Soc. Clin. Psychol.34, 304–321. 10.1521/jscp.2015.34.4.304
63
HuesmannL. R.DubowE. F.BoxerP. (2009). Continuity of aggression from childhood to early adulthood as a predictor of life outcomes: Implications for the adolescent-limited and life-course-persistent models. Aggress. Behav. Off. J. Int. Soc. Res. Aggress.35, 136–149. 10.1002/ab.20300
64
IBM Corp (2017). IBM SPSS Statistics for Windows (Version 25.0). Armonk, NY: IBM Corp.
65
JintingW. U.HairongL. I. U. (2019). Features of nonsuicidal self-injury and relationships with coping methods among college students. Iran. J. Public Health48:270.
66
JonesR. M.ArlidgeJ.GillhamR.ReaguS.van den BreeM.TaylorP. J. (2011). Efficacy of mood stabilisers in the treatment of impulsive or repetitive aggression: systematic review and meta-analysis. Br. J. Psychiatry198, 93–98. 10.1192/bjp.bp.110.083030
67
JonesS. E.MillerJ. D.LynamD. R. (2011). Personality, antisocial behavior, and aggression: a meta-analytic review. J. Crim. Justice39, 329–337. 10.1016/j.jcrimjus.2011.03.004
68
JudgeT. A.ErezA.BonoJ. E.ThoresenC. J. (2002). Are measures of self-esteem, neuroticism, locus of control, and generalized self-efficacy indicators of a common core construct?J. Pers. Soc. Psychol.83:693. 10.1037/0022-3514.83.3.693
69
KanferF. H. (1971). “The maintenance of behavior by self-generated stimuli and reinforcement,” in The psychology of private events: Perspectives on covert response systems, eds JacobsA.SachsL. B. (New York, NY: Academic Press), 39–57. 10.1016/B978-0-12-379650-9.50009-5
70
KarakurtG.WhitingK.Van EschC.BolenS. D.CalabreseJ. R. (2016). Couples therapy for intimate partner violence: a systematic review and meta-analysis. J. Marital Fam. Ther. 42, 567–583. 10.1111/jmft.12178
71
KothgassnerO. D.RobinsonK.GoreisA.OugrinD.PlenerP. L. (2020). Does treatment method matter? A meta-analysis of the past 20 years of research on therapeutic interventions for self-harm and suicidal ideation in adolescents. Borderline Personal. Disord. Emot. Dysregul.7:9. 10.1186/s40479-020-00123-9
72
KuhlJ.KazénM. (1997). Persönlichkeits-Stil-und Störungs-Inventar:(PSSI).Göttingen: Hogrefe, Verlag für Psychologie.
73
LaingL.BobicN. (2002). Economic Costs of Domestic Violence. Sydney, NSW: Australian Domestic and Family Violence Clearinghouse.
74
LaverdièreO.OgrodniczukJ. S.KealyD. (2019). Interpersonal problems associated with passive-aggressive personality disorder. J. Nerv. Ment. Dis.207, 820–825. 10.1097/NMD.0000000000001044
75
Laye-GindhuA.Schonert-ReichlK. A. (2005). Nonsuicidal self-harm among community adolescents: understanding the “whats” and “whys” of self-harm. J. Youth Adolesc.34, 447–457. 10.1007/s10964-005-7262-z
76
LeinerD. J. (2014). SoSci Survey. Available online at: https://www.soscisurvey.de.
77
MalleryP.GeorgeD. (2003). SPSS for Windows Step by Step: A Simple Guide and Reference. Boston, MA: Allyn and Bacon.
78
MargrafJ.EhlersA. (2002). Das Beck-Angstinventar (BAI).Frankfurt: Springer.
79
MarshH. W.LüdtkeO.MuthénB.AsparouhovT.MorinA. J. S.TrautweinU.et al. (2010). A new look at the big five factor structure through exploratory structural equation modeling. Psychol. Assess.22:471. 10.1037/a0019227
80
MarshH. W.MorinA. J. S.ParkerP. D.KaurG. (2014). Exploratory structural equation modeling: an integration of the best features of exploratory and confirmatory factor analysis. Annu. Rev. Clin. Psychol.10, 85–110. 10.1146/annurev-clinpsy-032813-153700
81
McCannJ. T. (1988). Passive-aggressive personality disorder: a review. J. Pers. Disord.2, 170–179. 10.1521/pedi.1988.2.2.170
82
McDonaldR. P. (1999). Test Theory: A Unified Treatment. Mahwah, NJ: Lawrence Erlbaum.
83
MeuleA.VögeleC.KüblerA. (2011). Psychometrische evaluation der deutschen barratt impulsiveness scale–Kurzversion (BIS-15). Diagnostica57, 126–133. 10.1026/0012-1924/a000042
84
MezoP. G.ShortM. M. (2012). Construct validity and confirmatory factor analysis of the self-control and self-management scale. Can. J. Behav. Sci.44, 1–8. 10.1037/a0024414
85
MillerP. R.DasherR.CollinsR.GriffithsP.BrownF. (2001). Inpatient diagnostic assessments: 1. Accuracy of structured vs. unstructured interviews. Psychiatry Res.105, 255–264. 10.1016/S0165-1781(01)00317-1
86
MillonT. (1993). Negativistic (passive-aggressive) personality disorder. J. Pers. Disord. 7, 78–8510.1521/pedi.1993.7.1.78
87
NeumanJ. H.BaronR. A. (1998). Workplace violence and workplace aggression: evidence concerning specific forms, potential causes, and preferred targets. J. Manage.24, 391–419. 10.1177/014920639802400305
88
NeumanJ. H.BaronR. A. (2005). “Aggression in the Workplace: A Social-Psychological Perspective,” in Counterproductive work behavior: Investigations of actors and targets, eds FoxS.SpectorP. E. (Washington DC: American Psychological Association), 13–40. 10.1037/10893-001
89
Newton-HowesG.ClarkL. A.ChanenA. (2015). Personality disorder across the life course. Lancet385, 727–734. 10.1016/S0140-6736(14)61283-6
90
NickelR.EgleU. T. (2006). Psychological defense styles, childhood adversities and psychopathology in adulthood. Child Abuse Negl.30, 157–170. 10.1016/j.chiabu.2005.08.016
91
NoyesJ.RussellL.DouglasR.HappelR. L.StoutL. R.MullerB. A.et al. (2001). Personality dysfunction among somatizing patients. Psychosomatics42, 320–329. 10.1176/appi.psy.42.4.320
92
O'DonnellO.HouseA.WatermanM. (2015). The co-occurrence of aggression and self-harm: systematic literature review. J. Affect. Disord.175, 325–350. 10.1016/j.jad.2014.12.051
93
OrchardF.ReynoldsS. (2018). The combined influence of cognitions in adolescent depression: biases of interpretation, self-evaluation, and memory. Br. J. Clin. Psychol.57, 420–435. 10.1111/bjc.12184
94
ParrottD. J.GiancolaP. R. (2007). Addressing “The criterion problem” in the assessment of aggressive behavior: development of a new taxonomic system. Aggress. Violent Behav.12, 280–299. 10.1016/j.avb.2006.08.002
95
PattonJ. H.StanfordM. S.BarrattE. S. (1995). Factor structure of the barratt impulsiveness scale. J. Clin. Psychol.51, 768–774. 10.1002/1097-4679(199511)51:6<768::AID-JCLP2270510607>3.0.CO;2-1
96
PlenerP. L.SchumacherT. S.MunzL. M.GroschwitzR. C. (2015). The longitudinal course of non-suicidal self-injury and deliberate self-harm: a systematic review of the literature. Borderline Personal. Disord. Emot. Dysregul.2:2. 10.1186/s40479-014-0024-3
97
PreussU. W.RujescuD.GieglingI.WatzkeS.KollerG.ZetzscheT.et al. (2008). Psychometrische evaluation der deutschsprachigen version der barratt-impulsiveness-skala. Nervenarzt79, 305–319. 10.1007/s00115-007-2360-7
98
RabungS.HarfstT.KawskiS.KochU.WittchenH. U.SchulzH. (2009). Psychometrische überprüfung einer verkürzten version der≫ hamburger module zur erfassung allgemeiner aspekte psychosozialer gesundheit für die therapeutische praxis ≪(HEALTH-49). Zeitschrift für Psychoso. Med. Psychother.55, 162–179. 10.13109/zptm.2009.55.2.162
99
RabungS.HarfstT.KochU.WittchenH.-U.SchulzH. (2007). “Hamburger module zur erfassung allgemeiner aspekte psychosozialer gesundheit für die therapeutische praxis (HEALTH)”-psychometrische überprüfung eines neuen selbstbeurteilungsinstruments zur multidimensionalen erfassung psychosozialer gesundheit. Phys. Med. Rehabil. Kurortmed.17, 133–140. 10.1055/s-2007-940198
100
RehmL. P. (1977). A self-control model of depression. Behav. Ther.8, 787–804. 10.1016/S0005-7894(77)80150-0
101
RevelleW. (2015). Psych: Procedures for Personality and Psychological Research (Version 1.4. 5).Evanston, IL: Northwestern University.
102
RohrmannS.HodappV.SchnellK.TibubosA. N.SchwenkmezgerP.SpielbergerC. D. (2013). Das State-Trait-AErgerausdrucks-Inventar-2. Bern: Huber.
103
RomansS. E.MartinJ. L.MorrisE.HerbisonG. P. (1999). Psychological defense styles in women who report childhood sexual abuse: a controlled community study. Am. J. Psychiatry156, 1080–1085.
104
RothD.RehmL. P. (1980). Relationships among self-monitoring processes, memory, and depression. Cogn. Ther. Res.4, 149–157. 10.1007/BF01173646
105
RozenskyR. H.KravitzS.UngerR. (1981). Learned helplessness and the self-control model of depression. Psychol. Rep.48, 987–994. 10.2466/pr0.1981.48.3.987
106
RozenskyR. H.RehmL. P.PryG.RothD. (1977). Depression and self-reinforcement behavior in hospitalized patients. J. Behav. Ther. Exp. Psychiatry8, 35–38. 10.1016/0005-7916(77)90102-1
107
Santa MinaE. E.GallopR.LinksP.HeslegraveR.PringleD.WekerleC.et al. (2006). The self-injury questionnaire: evaluation of the psychometric properties in a clinical population. J. Psychiatr. Ment. Health Nurs.13, 221–227. 10.1111/j.1365-2850.2006.00944.x
108
SantanaM. R. M.ZattiC.SpaderM. L.MalgarimB. G.SalleE.PiltcherR.et al. (2017). Acute stress disorder and defense mechanisms: a study of physical trauma patients admitted to an emergency hospital. Trends Psychiatry Psychother.39, 247–256. 10.1590/2237-6089-2016-0071
109
SchauenburgH.WillenborgV.SammetI.EhrenthalJ. C. (2007). Self-reported defence mechanisms as an outcome measure in psychotherapy: a study on the german version of the defence style questionnaire DSQ 40. Psychol. Psychother. Theory Res. Pract.80, 355–366. 10.1348/147608306X146068
110
SchierholzA.KrügerA.BarenbrüggeJ.EhringT. (2016). What mediates the link between childhood maltreatment and depression? The role of emotion dysregulation, attachment, and attributional style. Euro. J. Psychotraumatol.7:32652. 10.3402/ejpt.v7.32652
111
SegalD. L.CoolidgeF. L.MizunoH. (2007). Defense mechanism differences between younger and older adults: a cross-sectional investigation. Aging Ment. Health11, 415–422. 10.1080/13607860600963588
112
StanfordM. S.MathiasC. W.DoughertyD. M.LakeS. L.AndersonN. E.PattonJ. H. (2009). Fifty years of the barratt impulsiveness scale: an update and review. Pers. Individ. Dif.47, 385–395. 10.1016/j.paid.2009.04.008
113
SwansonJ. W.McGintyE. E.FazelS.MaysV. M. (2015). Mental illness and reduction of gun violence and suicide: bringing epidemiologic research to policy. Ann. Epidemiol.25, 366–376. 10.1016/j.annepidem.2014.03.004
114
TaftC. T.CreechS. K.KachadourianL. (2012). Assessment and treatment of posttraumatic anger and aggression: a review. J. Rehabili. Res. Dev.49, 777−788. 10.1682/JRRD.2011.09.0156
115
TordjmanS.ZittounC.FerrariP.FlamentM.JeammetP. (1997). A comparative study of defense styles of bulimic, anorexic and normal females. Isr. J. Psychiatry Relat. Sci.34, 222–227.
116
TurpM. (2007). Self-harm by omission: a question of skin containment. Psychodynam. Pract.13, 229–244. 10.1080/14753630701455812
117
VarshneyM.MahapatraA.KrishnanV.GuptaR.DebK. S. (2016). Violence and mental illness: what is the true story?J. Epidemiol. Commun. Health70, 223–225. 10.1136/jech-2015-205546
118
WangC. E. A.HalvorsenM.EisemannM. (2010). Stability of dysfunctional attitudes and early maladaptive schemas: a 9-year follow-up study of clinically depressed subjects. J. Behav. Ther. Exp. Psychiatry41, 389–396. 10.1016/j.jbtep.2010.04.002
119
WangY.GorensteinC. (2013). Psychometric properties of the beck depression inventory-II: a comprehensive review. Braz. J. Psychiatry35, 416–431. 10.1590/1516-4446-2012-1048
120
WetzlerS.JoseA. (2012). “Passive-aggressive personality disorder: The demise of a syndrome,” in The Oxford handbook of personality disorders, ed WidigerT. A. (New York, NY: Oxford University Press) 674–693. 10.1093/oxfordhb/9780199735013.013.0031
121
WilliamsK. D.SommerK. L. (1997). Social ostracism by coworkers: does rejection lead to loafing or compensation?Personal. Soc. Psychol. Bull.23, 693–706. 10.1177/0146167297237003
122
World Medical Association (2013). World Medical Association Declaration of Helsinki ethical principles for medical research involving human subjects. JAMA, 310, 2191–2194. 10.1001/jama.2013.281053
123
ZanariniM. C.FrankenburgF. R.FitzmauriceG. (2013). Defense mechanisms reported by patients with borderline personality disorder and axis ii comparison subjects over 16 years of prospective follow-up: description and prediction of recovery. Am. J. Psychiatry170, 111–120. 10.1176/appi.ajp.2012.12020173
Summary
Keywords
aggressive behavior, passive aggression, self-directed aggression, depression, test development
Citation
Schanz CG, Equit M, Schäfer SK, Käfer M, Mattheus HK and Michael T (2021) Development and Psychometric Properties of the Test of Passive Aggression. Front. Psychol. 12:579183. doi: 10.3389/fpsyg.2021.579183
Received
02 July 2020
Accepted
15 March 2021
Published
26 April 2021
Volume
12 - 2021
Edited by
Xavier Noel, Université libre de Bruxelles, Belgium
Reviewed by
Snezana Smederevac, University of Novi Sad, Serbia; Marco Tommasi, University of Studies G. d'Annunzio Chieti and Pescara, Italy
Updates
Copyright
© 2021 Schanz, Equit, Schäfer, Käfer, Mattheus and Michael.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Tanja Michael t.michael@mx.uni-saarland.de
This article was submitted to Psychopathology, a section of the journal Frontiers in Psychology
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.