<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Archiving and Interchange DTD v2.3 20070202//EN" "archivearticle.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="systematic-review">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Psychiatry</journal-id>
<journal-title>Frontiers in Psychiatry</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Psychiatry</abbrev-journal-title>
<issn pub-type="epub">1664-0640</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fpsyt.2020.573488</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Psychiatry</subject>
<subj-group>
<subject>Systematic Review</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>A Systematic Review of Instruments to Assess Guilt in Children and Adolescents</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Zaccari</surname> <given-names>Vittoria</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/989425/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Aceto</surname> <given-names>Marianna</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/1134355/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Mancini</surname> <given-names>Francesco</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/640720/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Associazione Scuola di Psicoterapia Cognitiva (APC &#x02013; SPC)</institution>, <addr-line>Rome</addr-line>, <country>Italy</country></aff>
<aff id="aff2"><sup>2</sup><institution>Department of Human Sciences, Marconi University</institution>, <addr-line>Rome</addr-line>, <country>Italy</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Michaela Pascoe, Victoria University, Australia</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Tyler Colasante, Queen&#x00027;s University, Canada; Rose Donohue, Washington University School of Medicine in St. Louis, United States</p></fn>
<corresp id="c001">&#x0002A;Correspondence: Vittoria Zaccari <email>v.zaccari&#x00040;unimarconi.it</email></corresp>
<fn fn-type="other" id="fn001"><p>This article was submitted to Child and Adolescent Psychiatry, a section of the journal Frontiers in Psychiatry</p></fn></author-notes>
<pub-date pub-type="epub">
<day>09</day>
<month>12</month>
<year>2020</year>
</pub-date>
<pub-date pub-type="collection">
<year>2020</year>
</pub-date>
<volume>11</volume>
<elocation-id>573488</elocation-id>
<history>
<date date-type="received">
<day>09</day>
<month>07</month>
<year>2020</year>
</date>
<date date-type="accepted">
<day>27</day>
<month>10</month>
<year>2020</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2020 Zaccari, Aceto and Mancini.</copyright-statement>
<copyright-year>2020</copyright-year>
<copyright-holder>Zaccari, Aceto and Mancini</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract><p><bold>Background:</bold> Guilt feelings have received considerable attention in past psychological theory and research. Several studies have been conducted that represent a range of views and propose various implications of guilt in children and adolescents. Variations in theoretical definitions of guilt, emphasizing a lack of measurement convergence, make it difficult to derive a comprehensive definition of the construct in childhood and adolescence. Research shows substantial variability in instruments used to measure guilt in children and adolescents.</p>
<p><bold>Purpose:</bold> The aim is to discuss existing contributions, illustrating the empirical validity of the available instruments used to measure guilt and identifying the nature of their theoretical backgrounds among children and adolescents.</p>
<p><bold>Methods:</bold> A systematic search was conducted using the following databases: PsycINFO, PsycARTICLES, MEDLINE, Scopus, Web of Science, and PubMed (all years up to February 19, 2020). Search terms were compiled into three concepts for all databases: &#x0201C;measure,&#x0201D; &#x0201C;guilt,&#x0201D; and &#x0201C;childhood/adolescence.&#x0201D; In addition, a search was conducted to detect the gray literature.</p>
<p><bold>Results:</bold> After removing the duplicates, a total of 1,408 records were screened, resulting in the identification of 166 full-text articles to be further scrutinized. Upon closer examination, there was consensus that 148 of those studies met the study inclusion criteria or were not retrieved. Twenty-five studies were included in the quality assessment. The data were organized on three main categories: (1) interpersonal or prosocial guilt; (2) intrapunitive guilt or that referring to an excessive sense of responsibility; (3) not specifying a theoretical construct. A great heterogeneity in psychometric evaluations and substantial variability in guilt construct emerged. The construct most represented and supported by valid instruments was interpersonal or prosocial guilt. Analysis of the gray literature showed that some instruments were not immediately available to the clinical and scientific communities.</p>
<p><bold>Conclusions:</bold> The studies analyzed and selected for qualitative review employed various instruments to measure guilt. Results confirmed what is widely documented in the literature about substantial variability in instruments used to measure guilt. We argue the need to develop measures that assess currently overlooked dimensions of guilt and to provide further additional information about the psychometric proprieties of the available developed instruments.</p></abstract>
<kwd-group>
<kwd>guilt</kwd>
<kwd>development</kwd>
<kwd>measure</kwd>
<kwd>instrument</kwd>
<kwd>children</kwd>
<kwd>adolescents</kwd>
<kwd>systematic review</kwd>
</kwd-group>
<counts>
<fig-count count="1"/>
<table-count count="3"/>
<equation-count count="0"/>
<ref-count count="108"/>
<page-count count="14"/>
<word-count count="10479"/>
</counts>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="s1">
<title>Introduction</title>
<sec>
<title>Guilt Feelings: Theoretical Approaches</title>
<p>Guilt feelings have received considerable attention in past psychological theory and research. This is not surprising, since they have been considered to be a key element within the human moral and social experience. Given its role in mediating the relationship between moral internalized intentions and moral behavior, guilt has been defined as a moral or self-conscious emotion (<xref ref-type="bibr" rid="B1">1</xref>&#x02013;<xref ref-type="bibr" rid="B4">4</xref>). An often cited definition of guilt considers it as a painful emotion that arises when an individual causes or believes he/she has caused harm to another; in other instances, there may be a violation of moral or social norms or personal internalized values (<xref ref-type="bibr" rid="B3">3</xref>, <xref ref-type="bibr" rid="B5">5</xref>, <xref ref-type="bibr" rid="B6">6</xref>). Experience of guilt would inherently involve a sense of responsibility for a transgression&#x00027;s outcome (<xref ref-type="bibr" rid="B7">7</xref>) and is considered to promote an other-oriented reparative attitude that is motivating individuals to accept responsibility and take reparative action in the wake of the occasional failure or transgression (<xref ref-type="bibr" rid="B4">4</xref>).</p>
<p>However, across the literature one finds a range of approaches to the whole notion of guilt, highlighting some contradictory premises about its nature and genesis. Historically, psychoanalytic theorizing played a pivotal role in the psychological study of guilt, describing it as a self-punitive process that takes place within the individual by sanctioning or censuring violations of moral standards (<xref ref-type="bibr" rid="B2">2</xref>). This process disposes the individual to actions aimed at reducing his/her personal discomfort&#x02014;regardless of the potential to repair the damage producing the internal suffering (<xref ref-type="bibr" rid="B2">2</xref>). The psychodynamic approach (<xref ref-type="bibr" rid="B8">8</xref>&#x02013;<xref ref-type="bibr" rid="B17">17</xref>) developed within an intrapsychic perspective has focused on the negative characteristics of guilt, emphasizing its involvement in the development and maintenance of psychopathology. This approach describes guilt by characterizing it as not necessarily related to others. Guilt feeling is an internal conflict associated with a violation of internalized norms, and not necessarily related to another&#x00027;s suffering (<xref ref-type="bibr" rid="B3">3</xref>).</p>
<p>Other psychological approaches (<xref ref-type="bibr" rid="B2">2</xref>&#x02013;<xref ref-type="bibr" rid="B4">4</xref>, <xref ref-type="bibr" rid="B18">18</xref>, <xref ref-type="bibr" rid="B19">19</xref>), developed within an interpersonal perspective, have assigned an adaptive role to guilt, showing its motivational drive toward prosocial, altruistic behaviors and the development of an empathic preoccupation for the well-being of others. This approach argues that feelings of guilt derive from the perception of having harmed or not given help to another person, and therefore the guilt is felt not toward an internalized authority but toward another person. This perspective attributes an influential role to empathy (<xref ref-type="bibr" rid="B20">20</xref>).</p>
<p>In recent years, Mancini and Gangemi (<xref ref-type="bibr" rid="B21">21</xref>) have suggested a dualistic model of guilt in adulthood [see also (<xref ref-type="bibr" rid="B22">22</xref>)] that considers its multidimensional nature. In this dualistic model, two distinct senses of guilt, such as altruistic guilt and deontological guilt, can occur simultaneously, and they derive, respectively, from damage to others or from a violation of a moral norm (with no necessary involvement of a victim). As such, this model begins to reconcile the various perspectives on this emotion (<xref ref-type="bibr" rid="B3">3</xref>, <xref ref-type="bibr" rid="B23">23</xref>). In this evidence-based construct, intrapsychic and interpersonal models are not mutually exclusionary; rather, they are oriented toward two distinct emotions, such as deontological guilt and altruistic guilt, which differs in relation to the appraisal of an event in the context of individual goals, desires, and beliefs. The two senses of guilt are not activated by different types of event but differ only by virtue of the interpretation of an event in the context of individual goals, beliefs, or desires. In altruistic guilt there is always a victim suffering harm and the belief of not having been altruistic. This emotional state is strictly connected to empathy and the goal of altruism, soliciting altruistic attitudes in the attempt to expiate errors or deficits. In deontological guilt there could be no victim at all (e.g., incest between consenting siblings), but there is the assumption of having violated the &#x0201C;Do not play God&#x0201D; principle (<xref ref-type="bibr" rid="B23">23</xref>).</p>
<p>These main conceptualizations contain fundamental and substantial differences. Guilt is conceptualized as other-focused and self-focused emotion. The first is focused on the other and related to the empathic care for suffering inflicted on the other. The second is focused toward itself with respect to the transgression of an internal norm.</p>
<p>These conceptualizations emphasize an involvement of morality in defining guilt, and they broadly diverge in considering guilt either inherently adaptive or maladaptive (<xref ref-type="bibr" rid="B6">6</xref>).</p>
</sec>
<sec>
<title>Clarifying the Nature of Guilt: A Central Clinical Issue</title>
<p>Thus far, most research on guilt and psychopathology has been conducted with adult populations. It was found that various clinical manifestations are linked to different types of guilt.</p>
<p>This is evident from the description in the Diagnostic and Statistical Manual of Mental Disorders [DSM-5; (<xref ref-type="bibr" rid="B24">24</xref>)] that emphasizes the role of excessive or abnormal guilty feelings in some mental disorders, such as major depressive episodes, post-traumatic stress disorder, and depression (<xref ref-type="bibr" rid="B25">25</xref>, <xref ref-type="bibr" rid="B26">26</xref>), as well as in obsessive-compulsive disorder [OCD; (<xref ref-type="bibr" rid="B27">27</xref>)]; and a lack of guilt or remorse in conduct disorder and antisocial disorder (<xref ref-type="bibr" rid="B28">28</xref>). Some studies (<xref ref-type="bibr" rid="B29">29</xref>&#x02013;<xref ref-type="bibr" rid="B31">31</xref>) have supported a connection between proneness to guilt and eating disorders.</p>
<p>The literature documents that some types of guilt are characteristic of some clinical phenotypes. For example, a review by Gangemi and Mancini (<xref ref-type="bibr" rid="B32">32</xref>) suggested that guilt in OCD is predominantly deontological. In particular, research on OCD has found that abnormal feelings of guilt and responsibility are the typical cognitive features of this clinical profile. A strong sensitivity to guilt is considered a basic element in the pathology of OCD, particularly in cognitive-behavioral models (<xref ref-type="bibr" rid="B27">27</xref>, <xref ref-type="bibr" rid="B33">33</xref>&#x02013;<xref ref-type="bibr" rid="B36">36</xref>). Also, a positive and significant association was found between depressive symptoms and altruistic guilt or high levels of empathy (<xref ref-type="bibr" rid="B37">37</xref>, <xref ref-type="bibr" rid="B38">38</xref>). These results suggest that some psychopathological disorders are characterized by specific guilt feelings.</p>
</sec>
<sec>
<title>Guilt: Maladaptive Behaviors and Clinical Manifestations in Children and Adolescents</title>
<p>Several studies on children and adolescents have showed that guilt feelings play a role in adaptive and maladaptive behaviors, highlighting significant correlations with different symptomatologic manifestations. Malti and Krettenauer (<xref ref-type="bibr" rid="B39">39</xref>) reported a positive link between guilt feelings and prosocial behavior. There is also some support for a positive association between guilt and reparative behavior, both in early childhood (<xref ref-type="bibr" rid="B40">40</xref>) and in mid-childhood and adolescence (<xref ref-type="bibr" rid="B41">41</xref>, <xref ref-type="bibr" rid="B42">42</xref>). Also, in a recent study, Vaish et al. (<xref ref-type="bibr" rid="B43">43</xref>) showed that from early in childhood, at least 3 years of age, guilt promotes prosocial reparative behavior.</p>
<p>Despite empirical support for the potential link between guilt and prosocial adaptive behavior [and thus a guilt-engendered positive outcome; see (<xref ref-type="bibr" rid="B44">44</xref>)], several studies have pointed toward a relationship between guilt and a range of psychological disorders (<xref ref-type="bibr" rid="B45">45</xref>, <xref ref-type="bibr" rid="B46">46</xref>). In fact, some authors [e.g., (<xref ref-type="bibr" rid="B39">39</xref>)] have suggested that guilt feelings have implications for both psychopathology and healthy outcomes in children and adolescents. Two reviews (<xref ref-type="bibr" rid="B39">39</xref>, <xref ref-type="bibr" rid="B47">47</xref>) highlighted a negative relation between guilt and aggression in childhood and adolescence, regardless of age reporting; in contrast, a positive link was found between guilt feelings and prosocial behavior. Other studies (<xref ref-type="bibr" rid="B39">39</xref>, <xref ref-type="bibr" rid="B48">48</xref>) have suggested that very low levels of moral guilt and disregard for others are positively associated with aggressive and antisocial conduct in early childhood (<xref ref-type="bibr" rid="B49">49</xref>), middle childhood (<xref ref-type="bibr" rid="B50">50</xref>), and adolescence (<xref ref-type="bibr" rid="B51">51</xref>). A study by Colasante et al. (<xref ref-type="bibr" rid="B52">52</xref>) tested guilty feelings as potential moderators of the daily anger deviations aggression link, highlighting how aggravating the link between daily anger deviations and aggression was weaker for children with relatively high levels of guilt.</p>
<p>Importantly, researchers have argued that there is a close link between the absence of moral guilt and aggression, violence, and antisocial conduct, both in the normative and clinical range (underscoring the importance of guilt in predicting aggressive conduct in normative samples throughout development). This finding is reflected in the inclusion of guilt in the diagnostic classification of externalizing disorders, such as conduct disorder (CD), in the DSM-5 (<xref ref-type="bibr" rid="B24">24</xref>). Similarly, excessively high levels of neurotic guilt, representing an inappropriate context for guilt, may be directly or indirectly related to internalizing symptoms across childhood and adolescence, such as feelings of hopelessness, low self-efficacy, and self-depreciation (<xref ref-type="bibr" rid="B53">53</xref>).</p>
<p>Furthermore, Reeves et al. (<xref ref-type="bibr" rid="B54">54</xref>) documented in children preliminary results that provide support for a link between inflated responsibility (an excessive obligatory sense in which the individual evaluates his/her own thoughts in terms of the harm they could cause to themselves or others) and increased checking behaviors; this view is in line with the inflated responsibility model of OCD (<xref ref-type="bibr" rid="B33">33</xref>), as may be applied to children.</p>
<p>However, although some recent clinical-developmental perspectives (<xref ref-type="bibr" rid="B4">4</xref>, <xref ref-type="bibr" rid="B5">5</xref>, <xref ref-type="bibr" rid="B7">7</xref>) have pointed out potential maladaptive outcomes of excessive or inappropriate feelings of guilt, there are few studies exploring the specific implications of abnormal guilt feelings in evolutive psychopathology. There appears to be greater confusion for children and adolescents about the different dimensions of guilt involved in individual disorders.</p>
<p>These results highlight a lack of conceptual convergence on a common underlying construct of guilt in the present literature. Understanding the role of guilt seems to be complicated by the heterogeneity of the construct and the way it is operationalized (<xref ref-type="bibr" rid="B6">6</xref>). Probably this is due to the apparent lack of guilt assessment tools that clearly define the nature of the construct they are intended to measure. This represents an important limitation for childhood and adolescence psychopathology, as it is not noted in the literature what is suggested by high or low levels of guilt, in their specific dimensions, with respect to the different clinical phenotypes.</p>
<p>These results reveal a variability in the definition of guilt, and the divergent views on its relation to problematic outcomes (<xref ref-type="bibr" rid="B6">6</xref>) brings into question its direct link to psychopathology [see also (<xref ref-type="bibr" rid="B18">18</xref>&#x02013;<xref ref-type="bibr" rid="B20">20</xref>, <xref ref-type="bibr" rid="B55">55</xref>&#x02013;<xref ref-type="bibr" rid="B58">58</xref>)].</p>
</sec>
<sec>
<title>Guilt Assessment</title>
<p>Given the implication of guilt in psychopathological disease, various instruments have been devised to detect the presence and extent of this condition, especially in adult populations.</p>
<p>Instruments display a broad heterogeneity in the conceptualization and validation of measures of guilt in adults, especially for the variability in the definition and measure of guilt as a state or trait-like component, an involvement in blaming toward the self or the behavior, and the relation with other overlapping constructs. For example, the Guilt Inventory [GI; (<xref ref-type="bibr" rid="B59">59</xref>)] is an evaluation scale that separately measures trait guilt, state guilt, and moral standards. It is based on the concept that guilt is an emotion that does not coincide with moral standards and therefore requires separate measurement instruments. The Interpersonal Guilt Questionnaire-67 [IGQ-67; (<xref ref-type="bibr" rid="B60">60</xref>)] evaluates four different types of guilt and measures them separately: survivor guilt, separation guilt, omnipotent responsibility guilt, and self-hatred guilt. The Guilt and Shame Proneness (GASP) scale measures individual differences in the proneness to experience guilt and shame across a range of personal transgressions (<xref ref-type="bibr" rid="B61">61</xref>). Global adjective checklists such as the Personnel Feelings Questionnaire-2 [PFQ-2; (<xref ref-type="bibr" rid="B62">62</xref>)] assess trait guilt by asking respondents to rate the frequency with which they experience guilt-related adjectives. The Test of Self-Conscious Affect [TOSCA&#x02212;3; (<xref ref-type="bibr" rid="B63">63</xref>)] yields indices of shame-proneness, guilt-proneness, externalization, detachment/unconcern, Alpha pride, and Beta pride.</p>
<p>Several studies have been conducted to identify and measure guilt in childhood and adolescence. However, a narrative review by Tilghman-Osborne (<xref ref-type="bibr" rid="B7">7</xref>) showed that, in children and adolescents, measures of guilt have mostly been focused on the adaptive aspect of the construct, attitudes toward reparation, and feelings of responsibility. Such positive aspects of guilt are less evident in theories and measures developed for older populations. Specifically, it was detected that within existing measures, behavioral coding and guilt induction strategies are most widely used in children younger than 5 years of age, whereas questionnaires or interviews are more commonly used for children older than 5 years. Within the most widely used instruments, there are the scenario-based self-report measures of characteristics of shame and guilt-proneness, e.g., the Test of Self-Conscious Affect for Children (for 8- to 12-year-olds) and the Test of Self-Conscious Affect&#x02013;Adolescent [TOSCA-C/A; (<xref ref-type="bibr" rid="B64">64</xref>, <xref ref-type="bibr" rid="B65">65</xref>)] (for 12- to 20-year-olds). Other instruments include semi-projective measures such as Hoffmann&#x00027;s Stories (<xref ref-type="bibr" rid="B66">66</xref>) or behavioral measures such as the Doll Paradigm (<xref ref-type="bibr" rid="B67">67</xref>).</p>
<p>In the overview of instruments to identify and measure guilt, self-report measures predominate in older children and adults and self-report measures are more used than interviews and questionnaires (<xref ref-type="bibr" rid="B6">6</xref>). These instruments highlight how often the construct of guilt is not always defined and homogeneous. Heterogeneity is found above all in developmental psychology research in children and adolescents, which has been focused in particular on the adaptive aspect of the guilt construct and shame (<xref ref-type="bibr" rid="B4">4</xref>, <xref ref-type="bibr" rid="B68">68</xref>). Historically, the distinction between shame and guilt, two self-conscious emotions, has not been emphasized, and numerous researchers have used these terms interchangeably (<xref ref-type="bibr" rid="B69">69</xref>). Guilt and shame are hardly to measure as separate constructs, probably since they share, in certain conditions, similar features, and because they frequently co-occur. However, research has noted theoretical differences between the two emotions, and guilt and shame are now consistently discussed as separate constructs (<xref ref-type="bibr" rid="B2">2</xref>, <xref ref-type="bibr" rid="B4">4</xref>, <xref ref-type="bibr" rid="B5">5</xref>). Specifically, guilt reflects a more negative appraisal of one&#x00027;s particular behavior, decentering from the self and focusing attribution on the wrongness of a specific behavior (<xref ref-type="bibr" rid="B4">4</xref>, <xref ref-type="bibr" rid="B70">70</xref>).</p>
<p>Therefore, clinical research and practice show substantial variability in instruments used to measure guilt, particularly in children and adolescents. This heterogeneity is likely due to the variant theoretical models on which they are constructed and/or the specific features of guilt emphasized by a given set of researchers (<xref ref-type="bibr" rid="B6">6</xref>, <xref ref-type="bibr" rid="B71">71</xref>).</p>
</sec>
<sec>
<title>Rationale</title>
<p>The different theoretical approaches and the different types of guilt detected by instruments highlight that guilt is a multidimensional construct (<xref ref-type="bibr" rid="B3">3</xref>, <xref ref-type="bibr" rid="B21">21</xref>). Currently, these substantial variations in theoretical definitions of guilt, emphasizing a lack of measurement convergence, make it difficult to derive a comprehensive definition of the construct in childhood and adolescence (<xref ref-type="bibr" rid="B6">6</xref>). This underlines the importance of differentiating the type of guilt in children and adolescents, and given the theoretical heterogeneity of the construct of guilt, it is important for researchers and clinicians to know which evaluation instruments are described in the literature and on which aspects of the construct they are based. However, the theoretical distinctions of guilt have a clinical importance, as demonstrated in particular by studies on adults. Even in childhood and adolescence it is necessary to have tools that are able to distinguish different types of guilt. At present, the assessment of guilt in children and adolescents appears scattered and unclear, as suggested by the narrative review of Tilghman-Osborne et al. (<xref ref-type="bibr" rid="B6">6</xref>). A systematic analysis of how guilt is detected with specific validated psychometric instruments in children and adolescents is lacking. These reflections indicate the need to fill this gap in the literature. Our systematic review allows us to offer a complete overview of the state of the art and to outline future developments of this line of research. It is essential to know which instruments were validated or developed, and to verify if they are based on a reference theory and if information is available to evaluate the instrument.</p>
</sec>
<sec>
<title>Research Question</title>
<p>The aim of this review is two-fold: (1) to review the existing contributions illustrating the empirical validity of the available instruments, for both researchers and clinicians, used to measure guilt among children and adolescents; (2) to identify the nature of these instruments&#x00027; theoretical backgrounds and especially to determine whether some types of guilt are overrepresented in the assessment literature and, conversely, if other guilt subtypes are overlooked and need further attention by psychometric researchers. Of note, this study does not aim to draw conclusions about the psychometric proprieties of available instruments. Rather, we were interested in providing a systematic view on the existing lines of research in the field, in order to draw epistemologically grounded conclusions and recommendations for future research. It is important, even during an individual&#x00027;s childhood and adolescence, to identify and delineate the nature and degree of regulatory processes that undergird both adaptive guilt and that which is atypical and maladaptive. This can lead to a more comprehensive understanding of the condition that can arise during the most formative period of a person&#x00027;s life. Such an understanding can also contribute to more appropriate interventions and, further, help determine the degree to which guilt may be present in and help drive a range of psychopathologies that can afflict children and adolescents.</p>
</sec>
</sec>
<sec id="s2">
<title>Method</title>
<p>A systematic search was conducted according to the PRISMA guidelines (<xref ref-type="bibr" rid="B72">72</xref>). The flow diagram depicted in <xref ref-type="fig" rid="F1">Figure 1</xref> illustrates the entire process of study identification and selection (based on the inclusion criteria used; see below).</p>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p>Flow diagram describing the processes of identification, screening and inclusion of the studies.</p></caption>
<graphic xlink:href="fpsyt-11-573488-g0001.tif"/>
</fig>
<sec>
<title>Eligibility Criteria</title>
<p>The inclusion of studies in the systematic review was decided according to the following criteria: (1) The first aim of the study was to illustrate and/or validate an instrument assessing guilt; (2) the instrument was a self-report questionnaire or an interview; (3) the instrument was used to measure guilt in a population of children and/or adolescents; (4) the instrument measured generalized guilt; and (5) the design of studies was cross-sectional or longitudinal. Exclusion criteria were: (1) not providing original contributions (e.g., review, comment, or letter to the editor); (2) providing exclusively qualitative data; (3) studies having been conducted on a population 18 years of age or older; (4) studies examining exclusively contextual guilt. Published status and language of the contribution were not exclusion criteria, nor were gender composition, ethnicity, nationality, and clinical status of the sample.</p>
</sec>
<sec>
<title>Search Strategy</title>
<p>The literature search was conducted using the following databases: PsycINFO, PsycARTICLES, MEDLINE, Scopus, Web of Science, and PubMed (all years up to and including February 19, 2020). Search terms were aggregated into three concepts for all databases: &#x0201C;measure,&#x0201D; &#x0201C;guilt,&#x0201D; and &#x0201C;childhood/adolescence&#x0201D; (see <xref ref-type="supplementary-material" rid="SM1">Appendix A</xref> in <xref ref-type="supplementary-material" rid="SM1">Supplementary Material</xref>).</p>
<p>Regarding the &#x0201C;guilt&#x0201D; concept, to elaborate the search syntax, several methods have been used, with the aim of being as exhaustive as possible. First, we searched for relevant systematic reviews and meta-analyses published on the topic of guilt and examined the search terms used by the authors in some primary studies. Then, a search in the thesaurus of the mesh terms database was performed. Finally, authoritative narrative reviews shedding light on the heterogenous nature of the concept of guilt [e.g., (<xref ref-type="bibr" rid="B6">6</xref>)] were examined, and guilt-related terms were extracted and added to the list of our search terms. Too broadly related terms, including a wider array of emotional states (e.g., &#x0201C;negative emotionality,&#x0201D; &#x0201C;self-conscious emotions&#x0201D;) were excluded. Similarly, terms related to psychopathological conditions that are thought to be related to guilt (e.g., callous-unemotional, alexithymia) but are not directly expressing the concept of guilt were excluded. In relation to the &#x0201C;measure&#x0201D; concept, as we were interested in collecting contributions that offer empirically validated instruments to both the scientific and the clinical community, we included terms related to common procedures to measure psychological variables in the field, such as questionnaires and interviews. Despite the insightful nature and utility of the experimental procedures used to assess guilt, we decided to exclude this type of assessment because they are too remotely related to a potential clinical application. Finally, the concept of &#x0201C;childhood and adolescence&#x0201D; was added to ensure that the search would have been restricted to our field of interest, namely, developmental psychology.</p>
<p>In addition, we performed a search of the gray literature following three strategies. First, we carried out a search on Google Scholar on 01/09/2020 using search terms related to our three concepts (see <xref ref-type="supplementary-material" rid="SM1">Appendix A</xref> in <xref ref-type="supplementary-material" rid="SM1">Supplementary Material</xref> for the detailed search syntax). As suggested by Haddaway et al. (<xref ref-type="bibr" rid="B73">73</xref>), we screened the first 200 results for pertinent studies. Moreover, all the reference lists of included studies as well as authoritative narrative reviews on the topic [e.g., (<xref ref-type="bibr" rid="B6">6</xref>)] were screened for additional studies. When the gray literature was unavailable, we contacted the authors by sending an e-mail, asking for the full text of the contribution. Finally, we wrote 18 e-mails to the main authors of the field, asking for unpublished data on the topic.</p>
</sec>
<sec>
<title>Selection of Studies</title>
<p>We screened every title and abstract to determine the eligibility of the study for inclusion. Two reviewers (VZ and MA) independently conducted the electronic searches using the aforementioned databases. Together, independent review of these electronic databases identified a total of 2,551 articles with the initial search terms, which were then examined by each reviewer for eligibility. After removing the duplicates, a total of 1,408 records were screened, resulting in the identification of 166 full-text articles to be further scrutinized. Of these, 16 were retained for inclusion in the present study. In addition, another 28 full-text articles from Google Scholar and 71 from the cross-checking procedure were examined, leading to the inclusion of nine additional papers. A total of nine unpublished contributions were not retrieved despite having sent an e-mail to the authors. The list of this gray literature can be found in <xref ref-type="supplementary-material" rid="SM1">Appendix A</xref> (<xref ref-type="supplementary-material" rid="SM1">Supplementary Material</xref>).</p>
<p>Then, a coding protocol was developed that allowed for the extraction of the following information: (1) metadata (i.e., authors, year of publication, publication status of the contribution); (2) information related to the sample used in the studies (i.e., mean age or age range, sample size, gender composition, and clinical status); (3) methodological information of the studies (the nature of the instrument used and the research design); and (4) contents information provided by the studies (theoretical guilt-related framework, type of psychometric information provided).</p>
</sec>
</sec>
<sec sec-type="results" id="s3">
<title>Results</title>
<p>A total of 25 studies were selected for qualitative review. As the main goal of our study was to illuminate the theoretical background underlying the development of instruments measuring guilt in a population of children or adolescents, we classified each study according to three main categories based on the type of conceptualization of guilt used by the author(s): interpersonal or prosocial guilt; intrapunitive guilt (i.e., an excessive sense of responsibility); and studies not specifying any underlying theoretical construct or, alternatively, using a conceptualization not classifiable within the two former categories. The decision to classify the studies within these categories arose from a general examination of the studies and from reflection among all authors about the most frequent redundancies in the theoretical background cited by the studies.</p>
<sec>
<title>Studies Adopting the Construct of Interpersonal or Prosocial Guilt</title>
<p>As illustrated in <xref ref-type="table" rid="T1">Table 1</xref>, a total of seven studies adopted the construct of interpersonal or prosocial guilt as the theoretical framework underlying the instrument. All articles had been published within the last two decades, and most of the studies had been conducted on a non-clinical population. Sample sizes were adequate, with the number of participants ranging from 50 (<xref ref-type="bibr" rid="B74">74</xref>) to 699 (<xref ref-type="bibr" rid="B70">70</xref>). Also, the gender composition of the sample was almost balanced. Regarding age, it should be noted that most of studies had been conducted on a sample of adolescents, or in any case not on participants younger than 7 years of age. Regarding the instrument&#x00027;s characteristics, all studies used a self-report questionnaire. In addition, the TOSCA (or adapted versions) was used in the majority of these studies. Finally, all studies provided some kind of psychometric information, but only studies using the TOSCA ran factorial analyses to test the underlying structure of the instrument.</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p>Studies using measures of interpersonal or prosocial guilt among sample of children or adolescents.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th valign="top" align="left"><bold>References</bold></th>
<th valign="top" align="left"><bold>Country</bold></th>
<th valign="top" align="center" style="border-bottom: thin solid #000000;" colspan="3"><bold>Sample</bold></th>
<th valign="top" align="left"><bold>Instrument</bold></th>
<th valign="top" align="left"><bold>Type of instrument</bold></th>
<th valign="top" align="left"><bold>Design of research</bold></th>
<th valign="top" align="left"><bold>Psychometric analyses performed</bold></th>
</tr>
<tr>
<th/>
<th/>
<th valign="top" align="left"><bold><italic>N</italic> and nature</bold></th>
<th valign="top" align="left"><bold>Age (years)</bold></th>
<th valign="top" align="left"><bold>% males</bold></th>
<th/>
<th/>
<th/>
<th/>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Kronm&#x000FC;ller et al. (<xref ref-type="bibr" rid="B74">74</xref>)</td>
<td valign="top" align="left">Germany</td>
<td valign="top" align="left">505 NC <break/> 50 C</td>
<td valign="top" align="left">8&#x02013;18</td>
<td valign="top" align="left">46.2</td>
<td valign="top" align="left">German TOSCA-C/A</td>
<td valign="top" align="left">Self-report</td>
<td valign="top" align="left">Cross-sectional</td>
<td valign="top" align="left">&#x02022;Internal consistency <break/>&#x02022;Reliability <break/>&#x02022;Intercorrelation between scale</td>
</tr>
<tr>
<td valign="top" align="left">Laskoski et al. (<xref ref-type="bibr" rid="B75">75</xref>)</td>
<td valign="top" align="left">Brazil</td>
<td valign="top" align="left">580 NC</td>
<td valign="top" align="left">16<break/> (1.19)</td>
<td valign="top" align="left">44.4</td>
<td valign="top" align="left">ESCA</td>
<td valign="top" align="left">Self-report</td>
<td valign="top" align="left">Cross-sectional</td>
<td valign="top" align="left">&#x02022;Internal consistency <break/>&#x02022;Convergent/discriminant validity</td>
</tr>
<tr>
<td valign="top" align="left">Benesch et al. (<xref ref-type="bibr" rid="B76">76</xref>)</td>
<td valign="top" align="left">Germany</td>
<td valign="top" align="left">131 C</td>
<td valign="top" align="left">8.9<break/> (1.9)</td>
<td valign="top" align="left">ns</td>
<td valign="top" align="left">ICU</td>
<td valign="top" align="left">Self-report</td>
<td valign="top" align="left">Cross-sectional</td>
<td valign="top" align="left">&#x02022;Internal consistency <break/>&#x02022;Convergent/discriminant validity</td>
</tr>
<tr>
<td valign="top" align="left">Watson et al. (<xref ref-type="bibr" rid="B77">77</xref>)</td>
<td valign="top" align="left">Australia</td>
<td valign="top" align="left">562 NC</td>
<td valign="top" align="left">13.4<break/> (0.92)</td>
<td valign="top" align="left">43.06</td>
<td valign="top" align="left">TOSCA-A</td>
<td valign="top" align="left">Self-report</td>
<td valign="top" align="left">Cross-sectional</td>
<td valign="top" align="left">&#x02022;Factorial structure and its invariance across gender <break/>&#x02022;Internal consistency <break/>&#x02022;Convergent/discriminant validity</td>
</tr>
<tr>
<td valign="top" align="left">Watson et al. (<xref ref-type="bibr" rid="B70">70</xref>)</td>
<td valign="top" align="left">Australia</td>
<td valign="top" align="left">699 NC 562 NC</td>
<td valign="top" align="left">13.41 (0.92)</td>
<td valign="top" align="left">47.5<break/> 43.1</td>
<td valign="top" align="left">TOSCA-A</td>
<td valign="top" align="left">Self-report</td>
<td valign="top" align="left">Cross-sectional</td>
<td valign="top" align="left">&#x02022;Factorial structure <break/>&#x02022;Internal consistency <break/>&#x02022;Convergent/Discriminant validity</td>
</tr>
<tr>
<td valign="top" align="left">Shahnawaz and Malik (<xref ref-type="bibr" rid="B68">68</xref>)</td>
<td valign="top" align="left">Pakistan</td>
<td valign="top" align="left">459 NC</td>
<td valign="top" align="left">16.4<break/> (1.3)</td>
<td valign="top" align="left">22.2</td>
<td valign="top" align="left">TOSCA-A</td>
<td valign="top" align="left">Self-report</td>
<td valign="top" align="left">Cross-sectional</td>
<td valign="top" align="left">&#x02022;Factorial structure <break/>&#x02022;Internal consistency <break/>&#x02022;Predictive validity</td>
</tr>
<tr>
<td valign="top" align="left">Broekhof et al. (<xref ref-type="bibr" rid="B78">78</xref>)</td>
<td valign="top" align="left">Netherlands</td>
<td valign="top" align="left">225 NC <break/> 108 C</td>
<td valign="top" align="left">11.62 (1.37)</td>
<td valign="top" align="left">42.2</td>
<td valign="top" align="left">BSGQ</td>
<td valign="top" align="left">Self-report</td>
<td valign="top" align="left">Cross-sectional</td>
<td valign="top" align="left">&#x02022;Internal consistency <break/>&#x02022;Convergent/Discriminant validity</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p><italic>NC, non-clinical sample; C, clinical sample; TOSCA-C/A, Test of Self-Conscious Affect for Adolescents/Children; ESCA, Guilt Scale for Adolescents; ICU, Inventory of Callous-Unemotional Traits; BSGQ, Brief Shame and Guilt Questionnaire</italic>.</p>
</table-wrap-foot>
</table-wrap>
</sec>
<sec>
<title>Studies Adopting the Construct of Intrapunitive Guilt or Guilt Conceptualized as an Excessive Sense of Responsibility</title>
<p>Ten studies were framed within the conceptualization of guilt as an intrapunitive process or as an excessive sense of responsibility. Their main characteristics are displayed in <xref ref-type="table" rid="T2">Table 2</xref>. The date range in this category is wide, extending from 1977 to 2019. The majority of these studies were conducted in the US or in Europe. Except for the study of Bacow et al. (<xref ref-type="bibr" rid="B83">83</xref>), all studies were conducted on wide sample sizes, ranging from 121 to 6,709 participants. Of note, only one of the investigations included a clinical group in the sample (<xref ref-type="bibr" rid="B83">83</xref>), and none of the examined studies was conducted with participants below 7 years of age. Despite the general heterogeneity of the results, it should be noted that each of them used a self-report questionnaire. Four studies examined the validity of the self-blame subscale of the CERQ, and two focused on the same SRP subscale. Regarding the type of psychometric evaluations provided by the studies, a great heterogeneity emerged, with some authors only providing data related to the internal reliability of the instrument (<xref ref-type="bibr" rid="B79">79</xref>) and others performing a wide range of statistical analyses to test the internal consistency, factorial structure, test&#x02013;retest reliability, and construct validity of the instrument [e.g., (<xref ref-type="bibr" rid="B84">84</xref>)].</p>
<table-wrap position="float" id="T2">
<label>Table 2</label>
<caption><p>Studies measuring excessive sense of responsibility and culpability among adolescents or children population.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th valign="top" align="left"><bold>References</bold></th>
<th valign="top" align="left"><bold>Country</bold></th>
<th valign="top" align="center" style="border-bottom: thin solid #000000;" colspan="3"><bold>Sample</bold></th>
<th valign="top" align="left"><bold>Instrument</bold></th>
<th valign="top" align="left"><bold>Type of instrument</bold></th>
<th valign="top" align="left"><bold>Design of research</bold></th>
<th valign="top" align="left"><bold>Psychometric analyses performed</bold></th>
</tr>
<tr>
<th/>
<th/>
<th valign="top" align="left"><bold><italic>N</italic> and nature</bold></th>
<th valign="top" align="left"><bold>Age (years)</bold></th>
<th valign="top" align="left"><bold>% males</bold></th>
<th/>
<th/>
<th/>
<th/>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Henderson (<xref ref-type="bibr" rid="B79">79</xref>)</td>
<td valign="top" align="left">Australia</td>
<td valign="top" align="left">6,709 NC</td>
<td valign="top" align="left">13&#x02013;18</td>
<td valign="top" align="left">47.53</td>
<td valign="top" align="left">Subscales of the HDHQ</td>
<td valign="top" align="left">Self-report</td>
<td valign="top" align="left">Cross-sectional</td>
<td valign="top" align="left">&#x02022;Internal reliability</td>
</tr>
<tr>
<td valign="top" align="left">Cole et al. (<xref ref-type="bibr" rid="B80">80</xref>)</td>
<td valign="top" align="left">USA</td>
<td valign="top" align="left">121 NC</td>
<td valign="top" align="left">9&#x02013;14</td>
<td valign="top" align="left">49</td>
<td valign="top" align="left">WIH questionnaire</td>
<td valign="top" align="left">Self-report</td>
<td valign="top" align="left">Cross-sectional</td>
<td valign="top" align="left">&#x02022;Internal consistency <break/>&#x02022;Convergent validity</td>
</tr>
<tr>
<td valign="top" align="left">Cartwright Hatton (<xref ref-type="bibr" rid="B81">81</xref>)</td>
<td valign="top" align="left">UK</td>
<td valign="top" align="left">177 NC</td>
<td valign="top" align="left">13&#x02013;17</td>
<td valign="top" align="left">43</td>
<td valign="top" align="left">SPR subscale</td>
<td valign="top" align="left">Self-report</td>
<td valign="top" align="left">Cross-sectional</td>
<td valign="top" align="left">&#x02022;Internal consistency <break/>&#x02022;Internal reliability <break/>&#x02022;Predictive validity</td>
</tr>
<tr>
<td valign="top" align="left">Garnefski et al. (<xref ref-type="bibr" rid="B82">82</xref>)</td>
<td valign="top" align="left">UK</td>
<td valign="top" align="left">717 NC</td>
<td valign="top" align="left">9&#x02013;11</td>
<td valign="top" align="left">39.4</td>
<td valign="top" align="left">Self-Blame subscale of the CERQ</td>
<td valign="top" align="left">Self- report</td>
<td valign="top" align="left">Cross-sectional</td>
<td valign="top" align="left">&#x02022;Internal consistency <break/>&#x02022;Convergent/Discriminant validity</td>
</tr>
<tr>
<td valign="top" align="left">Bacow et al. (<xref ref-type="bibr" rid="B83">83</xref>)</td>
<td valign="top" align="left">USA</td>
<td valign="top" align="left">78 C<break/> 20 NC</td>
<td valign="top" align="left">11.86 (3.11) 12.41 (3.02)</td>
<td valign="top" align="left">29 <break/>7</td>
<td valign="top" align="left">SPR subscale</td>
<td valign="top" align="left">Self-report</td>
<td valign="top" align="left">Cross-sectional</td>
<td valign="top" align="left">&#x02022;Internal consistency <break/>&#x02022;Convergent validity <break/>&#x02022;Predictive validity</td>
</tr>
<tr>
<td valign="top" align="left">Tilghman-Osborne et al. (<xref ref-type="bibr" rid="B7">7</xref>)</td>
<td valign="top" align="left">USA</td>
<td valign="top" align="left">370 NC</td>
<td valign="top" align="left">10.3<break/> (2.0)</td>
<td valign="top" align="left">42</td>
<td valign="top" align="left">IEGS</td>
<td valign="top" align="left">Self-report</td>
<td valign="top" align="left">Cross-sectional</td>
<td valign="top" align="left">&#x02022;Factorial structure <break/>&#x02022;Internal consistency <break/>&#x02022;Predictive validity</td>
</tr>
<tr>
<td valign="top" align="left">Liu et al. (<xref ref-type="bibr" rid="B84">84</xref>)</td>
<td valign="top" align="left">China</td>
<td valign="top" align="left">1,403 NC</td>
<td valign="top" align="left">9&#x02013;11<break/> (0.87)</td>
<td valign="top" align="left">52.5</td>
<td valign="top" align="left">Self-Blame subscale of the CERQ</td>
<td valign="top" align="left">Self- report</td>
<td valign="top" align="left">Cross-sectional and longitudinal</td>
<td valign="top" align="left">&#x02022;Internal consistency <break/>&#x02022;Reliability <break/>&#x02022;Factorial structure <break/>&#x02022;Test&#x02013;retest reliability <break/>&#x02022;Predictive validity</td>
</tr>
<tr>
<td valign="top" align="left">Garc&#x000ED;a-V&#x000E1;zqeuz et al. (<xref ref-type="bibr" rid="B85">85</xref>)</td>
<td valign="top" align="left">Mexico</td>
<td valign="top" align="left">661 NC</td>
<td valign="top" align="left">10.51<break/> (0.64)<break/> Girls<break/> 10.60<break/> (0.68)<break/> Boys</td>
<td valign="top" align="left">52</td>
<td valign="top" align="left">DMAE</td>
<td valign="top" align="left">Self-report</td>
<td valign="top" align="left">Cross-sectional</td>
<td valign="top" align="left">&#x02022;Internal validity <break/>&#x02022;Factorial structure and its invariance across gender <break/>&#x02022;Convergent validity</td>
</tr>
<tr>
<td valign="top" align="left">Orgil&#x000E9;s et al. (<xref ref-type="bibr" rid="B86">86</xref>)</td>
<td valign="top" align="left">Spain</td>
<td valign="top" align="left">582 NC</td>
<td valign="top" align="left">7&#x02013;12<break/> (1.2)</td>
<td valign="top" align="left">51.4</td>
<td valign="top" align="left">Self-Blame subscale of the CERQ</td>
<td valign="top" align="left">Self-report</td>
<td valign="top" align="left">Cross-sectional</td>
<td valign="top" align="left">&#x02022;Internal consistency <break/>&#x02022;Test-retest reliability <break/>&#x02022;Predictive validity</td>
</tr>
<tr>
<td valign="top" align="left">Orgil&#x000E9;s et al. (<xref ref-type="bibr" rid="B87">87</xref>)</td>
<td valign="top" align="left">Spain</td>
<td valign="top" align="left">654 NC</td>
<td valign="top" align="left">9.49<break/> (1.2)</td>
<td valign="top" align="left">52.1</td>
<td valign="top" align="left">Self-Blame subscale of the CERQ</td>
<td valign="top" align="left">Self-report</td>
<td valign="top" align="left">Cross-sectional and longitudinal</td>
<td valign="top" align="left">&#x02022;Internal consistency <break/>&#x02022;Test-retest reliability <break/>&#x02022;Divergent validity <break/>&#x02022;Predictive validity</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p><italic>C, clinical sample; NC, non-clinical sample; HDHQ, Hostility and Direction of Hostility Questionnaire; WIH, Why It Happened Questionnaire; SPR subscale: Superstitious, Punishment, and Responsibility beliefs subscale of the Metacognitions Questionnaire for Children; CERQ, Cognitive Emotion Regulation Questionnaire; IEGS, Inappropriate and Excessive Guilt Scale; DMAE, Moral Disengagement Scale for Children in Bullying Situations</italic>.</p>
</table-wrap-foot>
</table-wrap>
</sec>
<sec>
<title>Studies Not Classified in the Two Former Categories</title>
<p>The main characteristics of the eight studies classified in this category can be found in <xref ref-type="table" rid="T3">Table 3</xref>. Of note, nearly half of these studies had been published more than 25 years ago. The oldest study in this category was also the only one to use a projective measure (<xref ref-type="bibr" rid="B88">88</xref>). Sample sizes were likely to vary, but all were adequate. In addition, the gender composition of the samples was balanced except in the study of Saklofske and Schulz (<xref ref-type="bibr" rid="B91">91</xref>), which exclusively recruited males. Each study examined a different instrument. Importantly, the nature of the feelings of guilt was likely to be vague and remained unexplained in almost all studies. Finally, these studies generally provided little psychometric information toward the instrument with, for instance, only two studies testing the factorial structure of the instrument used (<xref ref-type="bibr" rid="B89">89</xref>, <xref ref-type="bibr" rid="B95">95</xref>).</p>
<table-wrap position="float" id="T3">
<label>Table 3</label>
<caption><p>Studies examining guilt among children and adolescent population without referring to interpersonal and intrapunitive guilt.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th valign="top" align="left"><bold>References</bold></th>
<th valign="top" align="left"><bold>Country</bold></th>
<th valign="top" align="center" style="border-bottom: thin solid #000000;" colspan="3"><bold>Sample</bold></th>
<th valign="top" align="left"><bold>Dimension of guilt</bold></th>
<th valign="top" align="left"><bold>Instrument</bold></th>
<th valign="top" align="left"><bold>Type of instrument</bold></th>
<th valign="top" align="left"><bold>Design of research</bold></th>
<th valign="top" align="left"><bold>Psychometric analyses performed</bold></th>
</tr>
<tr>
<th/>
<th/>
<th valign="top" align="left"><bold><italic>N</italic> and nature</bold></th>
<th valign="top" align="left"><bold>Age<break/> (years)</bold></th>
<th valign="top" align="left"><bold>% males</bold></th>
<th/>
<th/>
<th/>
<th/>
<th/>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Johnson and Kalafat (<xref ref-type="bibr" rid="B88">88</xref>)</td>
<td valign="top" align="left">USA</td>
<td valign="top" align="left">40 C (hospitalized)</td>
<td valign="top" align="left">ns</td>
<td valign="top" align="left">57.5</td>
<td valign="top" align="left">ns</td>
<td valign="top" align="left">TAT-type pictures</td>
<td valign="top" align="left">Projective</td>
<td valign="top" align="left">Cross-sectional</td>
<td valign="top" align="left">&#x02022;Convergent validity</td>
</tr>
<tr>
<td valign="top" align="left">Cattel et al. (<xref ref-type="bibr" rid="B89">89</xref>)</td>
<td valign="top" align="left">UK</td>
<td valign="top" align="left">800 NC</td>
<td valign="top" align="left">13.6<break/> (ns)<break/> Girls<break/> 14.3<break/> (ns)<break/> Boys</td>
<td valign="top" align="left">50</td>
<td valign="top" align="left">ns</td>
<td valign="top" align="left">HSPQ</td>
<td valign="top" align="left">Self-report</td>
<td valign="top" align="left">Cross-sectional</td>
<td valign="top" align="left">&#x02022;Factorial structure</td>
</tr>
<tr>
<td valign="top" align="left">Schuck et al. (<xref ref-type="bibr" rid="B90">90</xref>)</td>
<td valign="top" align="left">USA</td>
<td valign="top" align="left">85 C</td>
<td valign="top" align="left">15.7<break/> (ns)</td>
<td valign="top" align="left">ns</td>
<td valign="top" align="left">Hostile, sexual and Morality-conscience guilt</td>
<td valign="top" align="left">FCGI</td>
<td valign="top" align="left">Self-report</td>
<td valign="top" align="left">Cross-sectional</td>
<td valign="top" align="left">&#x02022;Convergent/discriminant validity</td>
</tr>
<tr>
<td valign="top" align="left">Saklofske and Schulz (<xref ref-type="bibr" rid="B91">91</xref>)</td>
<td valign="top" align="left">USA</td>
<td valign="top" align="left">77 NC</td>
<td valign="top" align="left">16.0<break/> (0.94)</td>
<td valign="top" align="left">100</td>
<td valign="top" align="left">Guilt state<break/> ns</td>
<td valign="top" align="left">9 guilt adjectives adapted from Haefner</td>
<td valign="top" align="left">Self-report</td>
<td valign="top" align="left">Cross-sectional and longitudinal</td>
<td valign="top" align="left">&#x02022;Test-retest reliability<break/>&#x02022;Factorial structure</td>
</tr>
<tr>
<td valign="top" align="left">Mathiesen et al. (<xref ref-type="bibr" rid="B92">92</xref>)</td>
<td valign="top" align="left">USA</td>
<td valign="top" align="left">239 NC</td>
<td valign="top" align="left">18.75<break/> (2.61)</td>
<td valign="top" align="left">33</td>
<td valign="top" align="left">ns</td>
<td valign="top" align="left">MAAS</td>
<td valign="top" align="left">Self-report</td>
<td valign="top" align="left">Cross-sectional</td>
<td valign="top" align="left">&#x02022;Internal consistency<break/>&#x02022;Inter-scales correlations</td>
</tr>
<tr>
<td valign="top" align="left">Chung et al. (<xref ref-type="bibr" rid="B93">93</xref>)</td>
<td valign="top" align="left">China</td>
<td valign="top" align="left">662 NC</td>
<td valign="top" align="left">14.45<break/> (0.90)</td>
<td valign="top" align="left">48.2</td>
<td valign="top" align="left">Self-criticism</td>
<td valign="top" align="left">4 items of the RSTD</td>
<td valign="top" align="left">Self-report</td>
<td valign="top" align="left">Cross-sectional</td>
<td valign="top" align="left">&#x02022;Predictive validity</td>
</tr>
<tr>
<td valign="top" align="left">Novin and Rieffe (<xref ref-type="bibr" rid="B94">94</xref>)</td>
<td valign="top" align="left">UK</td>
<td valign="top" align="left">219 NC</td>
<td valign="top" align="left">9&#x02013;14</td>
<td valign="top" align="left">53</td>
<td valign="top" align="left">ns</td>
<td valign="top" align="left">BSGQ-C</td>
<td valign="top" align="left">Self-report</td>
<td valign="top" align="left">Cross-sectional</td>
<td valign="top" align="left">&#x02022;Internal consistency<break/>&#x02022;Convergent validity</td>
</tr>
<tr>
<td valign="top" align="left">Tani et al. (<xref ref-type="bibr" rid="B95">95</xref>)</td>
<td valign="top" align="left">Italy</td>
<td valign="top" align="left">242 NC</td>
<td valign="top" align="left">8&#x02013;11</td>
<td valign="top" align="left">54.54</td>
<td valign="top" align="left">ns</td>
<td valign="top" align="left">GFS-C</td>
<td valign="top" align="left">Self-report</td>
<td valign="top" align="left">Cross-sectional</td>
<td valign="top" align="left">&#x02022;Factorial structure</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p><italic>C, clinical sample; ns, not specified; NC, non-clinical sample; NS, not significant; TAT, Thematic Apperception Test; HSPQ, High School Personality Questionnaire; FCGI, Forced Choice Guilt Inventory; RSTD, Rapid Screening Test for Depression; MAAS, Multidimensional Adolescent Assessment Scale; BSGQ-C, Brief Shame and Guilt Questionnaire for Children; GFS-C, Guilt Feeling Scale for Children</italic>.</p>
</table-wrap-foot>
</table-wrap>
</sec>
</sec>
<sec sec-type="discussion" id="s4">
<title>Discussion</title>
<sec>
<title>Main Findings</title>
<p>Over the years, numerous investigations have endeavored to identify and measure guilt as it may manifest during the stages of development. However, a systematic analysis of how guilt in children and adolescents has been conceptualized, and the specific instruments applied to determine its presence and extent, has thus far been lacking. The aim of this study was to review the existing contributions, illustrating the empirical validity of the available instruments used to measure guilt among children and adolescents and identifying the nature of their theoretical backgrounds.</p>
<p>Across 25 studies selected for qualitative review, it was found that researchers had applied a broad range of tools. Of the 19 relevant tools detected, all were validated and available in the literature, and two of them had a cultural adaptation. Relatedly, instruments focused on diverse dimensions of the construct of guilt in stages of development, underpinning a heterogeneous theoretical background. For this reason, we classified each study according to three broad categories that captured the dimensions of the construct of guilt, represented in the evaluative instrument(s) for a given study: interpersonal or prosocial guilt (see <xref ref-type="table" rid="T1">Table 1</xref>); intrapunitive or guilt as excessive sense of responsibility (see <xref ref-type="table" rid="T2">Table 2</xref>); and other studies that had not specified a theoretical construct or that used a conceptualization not classifiable within the two former categories (see <xref ref-type="table" rid="T3">Table 3</xref>). Results led us to three observations.</p>
</sec>
<sec>
<title>Measurement Features</title>
<p>First, the tools detected were validated and developed over a long period. The most recent tools, relating to the last two decades, concern those studies that used measures of two main categories of guilt: interpersonal or prosocial guilt and excessive sense of responsibility and culpability (see <xref ref-type="table" rid="T1">Tables 1</xref>, <xref ref-type="table" rid="T2">2</xref>). However, within these two categories, most of the studies had been conducted on a non-clinical population, aged 8&#x02013;16 years, and had no participants below 7 years of age. All studies used a self-report questionnaire and a cross-sectional design.</p>
</sec>
<sec>
<title>Information on Empirical Validity of Available Instruments</title>
<p>Second, regarding the type of psychometric evaluations provided by the studies, a great heterogeneity emerged. Some authors provided data only related to the internal reliability of the instrument, while others performed a wide range of statistical analyses to test the internal consistency, factorial structure, test&#x02013;retest reliability, and construct validity of the instrument.</p>
<p>Specifically, concerning interpersonal or prosocial guilt, only studies that used the TOSCA (or adapted versions) ran factorial analyses to test the underlying structure of the instrument. Results evidenced the use of the TOSCA-A (<xref ref-type="bibr" rid="B65">65</xref>) or an adapted version in four of the studies that provided information about a wide range of psychometric aspects such as the factorial structure and its invariance across gender and internal consistencies. This may explain why the TOSCA-A is one of the most widely used instruments in studies investigating interpersonal guilt. Relative to the construct of intrapunitive guilt or guilt conceptualized as an excessive sense of responsibility, again, most of the studies showed a great heterogeneity regarding the typology of psychometric evaluations performed. Generally, it appears that most instruments lack replicated information drawn by psychometric evaluations, suggesting the need to further investigate this issue in future studies. Indeed, poor literature related to the topic may lead to overlooking the role played by the intrapunitive guilt construct in children and adolescents psychopathology. To date, the most investigated instruments related to this dimension appear to be the CERQ and the SRP. In particular, four studies examined the validity of the self-blame subscale of the CERQ, referring to thoughts of putting the blame on what an individual has experienced on the self (<xref ref-type="bibr" rid="B82">82</xref>, <xref ref-type="bibr" rid="B84">84</xref>, <xref ref-type="bibr" rid="B86">86</xref>, <xref ref-type="bibr" rid="B87">87</xref>), and two focused on the SRP subscale (<xref ref-type="bibr" rid="B81">81</xref>, <xref ref-type="bibr" rid="B83">83</xref>), which measures superstitious, punishment, and responsibility beliefs. This instrument has been adapted to different languages and contexts for adolescents and children, and studies have assessed its psychometric properties across countries and different populations.</p>
<p>Regarding instruments with poor theoretical grounding (i.e., our third, &#x0201C;aspecific&#x0201D; category), the studies generally provided little psychometric information, with, for instance, only two studies testing the factorial structure of the instrument used [HSPQ&#x02014;(<xref ref-type="bibr" rid="B89">89</xref>); GFS-C&#x02014;(<xref ref-type="bibr" rid="B95">95</xref>)].</p>
<p>As a whole, psychometric evaluations of some tools were not well-investigated. This indicates the importance of providing information on the psychometric quality of the instruments in children and adolescents. Moreover, the analysis of the gray literature showed that there are several instruments cited in the literature that are not available and do not enjoy empirical validation. This represents a further limitation for the scientific community. This highlighted the need to develop sensitive and reliable measures of guilt among children and adolescents. The availability allows clinicians and researchers to replicate the results obtained from empirical research.</p>
</sec>
<sec>
<title>Instruments&#x00027; Theoretical Backgrounds</title>
<p>Third, with respect to the nature of instruments&#x00027; theoretical backgrounds, results confirmed what is widely documented in the adult-related literature about the substantial variability in the guilt construct. This heterogeneity could well be due to the multiple theoretical models on which instruments are built and/or specific features of guilt emphasized by different sets of researchers (<xref ref-type="bibr" rid="B6">6</xref>, <xref ref-type="bibr" rid="B7">7</xref>, <xref ref-type="bibr" rid="B71">71</xref>).</p>
<p>In particular, in the third category, there was more evident heterogeneity of the construct. All the studies were based on a poorly defined guilt construct and related to other constructs.</p>
<p>Nevertheless, the results showed which types of guilt are overrepresented in the assessment literature and, conversely, what other guilt subtypes are overlooked. The construct most represented and supported by valid instruments is interpersonal or prosocial guilt detected by TOSCA-A and TOSCA-C. Guilt, in this view, involves a negative evaluation of a specific behavior or action, where the focus is on the wrongness of a particular controllable action. In these instruments, guilt is hypothesized to involve a negative evaluation of the transgressing behavior and to be associated with adaptive and approach responses aimed at repairing (reparation and apology) the consequences of the transgressing behavior (<xref ref-type="bibr" rid="B96">96</xref>, <xref ref-type="bibr" rid="B97">97</xref>). An interpersonal perspective assigned an adaptive role to the emotion of guilt by showing its motivational drive toward prosocial behaviors and the development of an empathic preoccupation for the well-being of others (<xref ref-type="bibr" rid="B3">3</xref>, <xref ref-type="bibr" rid="B4">4</xref>). Following this, guilt appears to be moderately represented in an intrapunitive dimension according to the intrapsychic perspective.</p>
<p>Although an intrapunitive dimension of guilt was considered in various instruments, there was no specific conceptualization, and guilt appears to be characterized by different definitions. Some instruments detect self-blame (HDHQ subscales) or specifically measure characterological and behavioral self-blame, the former consisting of the attribution of negative events to stable traits or personological dispositions, the latter as an attribution of negative events to specific situational action or inaction (WIH questionnaire). Indeed, intrapunitive behavior has been observed and assessed in various contexts, such as school (<xref ref-type="bibr" rid="B80">80</xref>, <xref ref-type="bibr" rid="B98">98</xref>) and in relation to levels of hostility toward the self [(<xref ref-type="bibr" rid="B79">79</xref>); HDHQ subscales] and moral disengagement (<xref ref-type="bibr" rid="B85">85</xref>). Intrapunitive guilt, though, is not always a factor of the instruments used; often, it only appears as a single subscale (HDHQ, SPR, CERQ subscales).</p>
<p>Indeed, there seems to be no agreement on a definition of intrapunitive guilt, and this dimension could be more challenging to detect than guilt conceptualized on an interpersonal and prosocial level.</p>
<p>Furthermore, results show that guilt conceptualized as an excessive sense of responsibility, due to negative affects and cognitions linked to an erroneous attribution of responsibility, is overlooked. Few instruments detect this dimension.</p>
<p>In the third category, we included all the studies that used an instrument based on a poorly defined guilt construct and related to other constructs. The guilt construct often underlay instruments that evaluate different dimensions and unspecified constructs of hostility guilt, sexual guilt, morality-conscience guilt, and depression. All measures revealed a heterogeneous construct of guilt as their basis.</p>
<p>To identify and measure guilt in children and adolescents, researchers have used various questionnaires and evaluative instruments. Many measures have revealed a heterogeneous construct of guilt as their basis; there also has been a lack of agreement regarding how to identify the condition in children and adolescents. Even within the same categories, the guilt construct was found to be multifaceted. These results suggest that it would be helpful to have, primarily, specific and defined categories of guilt and, as well, instruments capable of distinguishing different types of guilt (and therefore having validity at the construct level). This would help clinicians and researchers verify what high or low levels of guilt suggest in their specific dimensions relative to different clinical phenotypes.</p>
<p>The substantial variations in theoretical definitions of guilt make it difficult to derive a comprehensive definition of the condition in children and adolescents. It is important, even during these years, to understand and identify the amount of developmentally regulatory, adaptive guilt, and atypical, maladaptive guilt. A more complete understanding of the functional and dysfunctional amounts of guilt present at a given time in childhood and adolescence could help clinicians to plan appropriate intervention strategies. One could also determine whether the fault is present specifically in some psychopathologies in children and adolescents. Some research [e.g., (<xref ref-type="bibr" rid="B39">39</xref>)] has suggested that guilt feelings have implications for psychopathology and healthy outcomes in children and adolescents. In addition, from the first category, it is underscored that guilt has an adaptive and prosocial nature, while, in the second category, guilt seems to be more related to psychopathological aspects and therefore to a maladaptive aspect of this emotion. This is a limitation, as the lack of clarity of the construct does not allow a clear understanding of which aspect of guilt is actually linked to clinical manifestations in children and adolescents.</p>
<p>Studies that might help to clarify these issues are few; further, the use of instruments is little generalized in other empirical studies. Some studies are quite old and do not clearly specify the construct under investigation. Among the most used instruments currently is the TOSCA (<xref ref-type="bibr" rid="B99">99</xref>). Although there is considerable support for Tangney&#x00027;s theory [(<xref ref-type="bibr" rid="B18">18</xref>, <xref ref-type="bibr" rid="B96">96</xref>, <xref ref-type="bibr" rid="B97">97</xref>, <xref ref-type="bibr" rid="B100">100</xref>); for reviews, see (<xref ref-type="bibr" rid="B101">101</xref>, <xref ref-type="bibr" rid="B102">102</xref>)], alternative models of guilt exist. For example, there are constructs of the emotion that define it in terms of the typology of situations that invoke such responses, often referred to as a public&#x02013;private distinction (<xref ref-type="bibr" rid="B103">103</xref>), wherein guilt is viewed as the result of a private commission of moral transgressions (<xref ref-type="bibr" rid="B104">104</xref>, <xref ref-type="bibr" rid="B105">105</xref>).</p>
</sec>
<sec>
<title>Future Directions</title>
<p>However, from the analysis of the construct of guilt among the various instruments collected, the most significant result is a recognition of the heterogeneity of the construct of guilt, which appears confused and various. Guilt can be mainly ascribed to intrapsychic-intrapunitive guilt, interpersonal guilt with a social-adaptive role, and guilt related to other dimensions (<xref ref-type="bibr" rid="B3">3</xref>). The heterogeneity of theories regarding the guilt construct appears to be a central and useful issue for future research prospects. Moreover, it constitutes a limit for the development of <italic>ad hoc</italic> validated instruments on specific dimensions of guilt. Mancini&#x00027;s dualistic thesis of guilt (<xref ref-type="bibr" rid="B23">23</xref>), focusing on the appraisal process in emotion, could represent an alternative model for conceptualizing guilt. It is supported by research data (<xref ref-type="bibr" rid="B22">22</xref>, <xref ref-type="bibr" rid="B106">106</xref>), and it could offer a valid theoretical framework to develop an innovative psychometric instrument for assessing guilt.</p>
<p>These results underline some gaps in the current assessment of guilt in children and adolescents that would benefit from further research. It would be helpful to develop instruments with a psychometric validation and to validate the currently available tools across cultures. It could also be useful to develop behavioral assessment procedures that are more usable and validated for clinical use. Similarly, it would be beneficial to develop instruments able to detect and explore specific typologies of guilt.</p>
</sec>
<sec>
<title>Limitations</title>
<p>This review has some limitations. First, we excluded qualitative measures because we looked for validated instruments and considered only empirical studies. This could be a limitation in that non-empirical studies could be informative. Second, some full texts could not be found, and thus, some instruments may not have been taken into consideration. Third, our literature search did not include unvalidated instruments to assess guilt. Finally, indirect measures such as questionnaires or interviews with parents were not included, nor were physiological measures (sympathetic and parasympathetic activity: SC, skin conductance; RSA, respiratory sinus arrhythmia; HR, heart rate). Studies by Colasante et al. (<xref ref-type="bibr" rid="B107">107</xref>, <xref ref-type="bibr" rid="B108">108</xref>) have showed that changes in RSA leading up to and during transgressions were uniquely associated with the intensity of guilt feelings after transgressions in children.</p>
<p>Notwithstanding these limitations, the collective findings in the current study support the conclusion of the heterogeneity of instruments and theoretical underpinnings to detect the guilt construct (<xref ref-type="bibr" rid="B6">6</xref>) in the developmental stages. This documents the need to develop instruments to detect other types of guilt and to ensure the availability of studies in the literature.</p>
</sec>
</sec>
<sec sec-type="conclusions" id="s5">
<title>Conclusions</title>
<p>Our paper aimed to provide a complete review of instruments investigating guilt in children and adolescents. Importantly, a great number of studies do not use the same theoretical criteria to discriminate the guilt construct. The evaluative instruments described in the literature are variant and are based on different characteristics of the construct and psychometrics. Therefore, using instruments to evaluate guilt could lead to incorrect conclusions, because they are often slanted toward the theoretical model on which they are based. Our results allowing researchers and clinicians interested to the topic to critically appreciate an assessment measure and underline the prospective directions for future research that should aim to make available methodologically sound and theoretically grounded instrument measuring guilt in children and adolescents in order to foster the development of this line of research. This highlights the importance of developing instruments that detect specific features of guilt in terms of both statistical power and goodness of fit, in order to use reliable and valid instruments in the clinic and in research. To improve our knowledge, we need instruments that are reliable in detecting guilt, available for replicating the results obtained from empirical research, and useful for clinicians in order to give clear clinical indications.</p>
</sec>
<sec id="s6">
<title>Author Contributions</title>
<p>VZ took overall responsibility for the conceptualization and design of the review and revised it critically for important intellectual content. VZ and MA searched for the articles in the review and assessed them for relevance. VZ, MA, and FM were involved in the interpretation of data, in writing and editing the final article, in approving the final version to be published, in agreeing to be accountable for all aspects of the work, and in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. All authors contributed to the article and approved the submitted version.</p>
</sec>
<sec sec-type="COI-statement" id="conf1">
<title>Conflict of Interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
</body>
<back>
<ack><p>This review was supported by the School of Cognitive Psychotherapy, Rome, Italy.</p>
</ack>
<sec sec-type="supplementary-material" id="s7">
<title>Supplementary Material</title>
<p>The Supplementary Material for this article can be found online at: <ext-link ext-link-type="uri" xlink:href="https://www.frontiersin.org/articles/10.3389/fpsyt.2020.573488/full#supplementary-material">https://www.frontiersin.org/articles/10.3389/fpsyt.2020.573488/full#supplementary-material</ext-link></p>
<supplementary-material xlink:href="Data_Sheet_1.docx" id="SM1" mimetype="application/vnd.openxmlformats-officedocument.wordprocessingml.document" xmlns:xlink="http://www.w3.org/1999/xlink"/>
</sec>
 <ref-list>
<title>References</title>
<ref id="B1">
<label>1.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Haidt</surname> <given-names>J</given-names></name></person-group>. <article-title>The moral emotions</article-title>. In: <person-group person-group-type="editor"><name><surname>Davidson</surname> <given-names>RJ</given-names></name> <name><surname>Scherer</surname> <given-names>KR</given-names></name> <name><surname>Goldsmith</surname> <given-names>HH</given-names></name></person-group>, editors. <source>Handbook of Affective Sciences</source>. <publisher-loc>Oxford</publisher-loc>: <publisher-name>Oxford University Press</publisher-name> (<year>2003</year>). p. <fpage>852</fpage>&#x02013;<lpage>70</lpage>.</citation></ref>
<ref id="B2">
<label>2.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lewis</surname> <given-names>HB</given-names></name></person-group>. <article-title>Shame and guilt in neurosis</article-title>. <source>Psychoanal Rev</source>. (<year>1971</year>) <volume>58</volume>:<fpage>419</fpage>&#x02013;<lpage>38</lpage>.<pub-id pub-id-type="pmid">5150685</pub-id></citation></ref>
<ref id="B3">
<label>3.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Carn&#x000EC;</surname> <given-names>S</given-names></name> <name><surname>Petrocchi</surname> <given-names>N</given-names></name> <name><surname>Del Miglio</surname> <given-names>C</given-names></name> <name><surname>Mancini</surname> <given-names>F</given-names></name> <name><surname>Couyoumdjian</surname> <given-names>A</given-names></name></person-group>. <article-title>Intrapsychic and interpersonal guilt: a critical review of the recent literature</article-title>. <source>Cogn Process.</source> (<year>2013</year>) <volume>14</volume>:<fpage>333</fpage>&#x02013;<lpage>46</lpage>. <pub-id pub-id-type="doi">10.1007/s10339-013-0570-4</pub-id><pub-id pub-id-type="pmid">23732818</pub-id></citation></ref>
<ref id="B4">
<label>4.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tangney</surname> <given-names>JP</given-names></name> <name><surname>Stuewig</surname> <given-names>J</given-names></name> <name><surname>Mashek</surname> <given-names>DJ</given-names></name></person-group>. <article-title>Moral emotions and moral behavior</article-title>. <source>Annu Rev Psychol</source>. (<year>2007</year>) <volume>58</volume>:<fpage>345</fpage>&#x02013;<lpage>72</lpage>. <pub-id pub-id-type="doi">10.1146/annurev.psych.56.091103.070145</pub-id><pub-id pub-id-type="pmid">16953797</pub-id></citation></ref>
<ref id="B5">
<label>5.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Malti</surname> <given-names>T</given-names></name></person-group>. <article-title>Toward an integrated clinical-developmental model of guilt</article-title>. <source>Dev Rev</source>. (<year>2016</year>) <volume>39</volume>:<fpage>16</fpage>&#x02013;<lpage>36</lpage>. <pub-id pub-id-type="doi">10.1016/j.dr.2015.11.001</pub-id></citation></ref>
<ref id="B6">
<label>6.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tilghman-Osborne</surname> <given-names>C</given-names></name> <name><surname>Cole</surname> <given-names>DA</given-names></name> <name><surname>Felton</surname> <given-names>JW</given-names></name></person-group>. <article-title>Definition and measurement of guilt: implications for clinical research and practice <italic>Clin Psychol Rev</italic></article-title>. (<year>2010</year>) <volume>30</volume>:<fpage>536</fpage>&#x02013;<lpage>46</lpage>. <pub-id pub-id-type="doi">10.1016/j.cpr.2010.03.007</pub-id><pub-id pub-id-type="pmid">20451312</pub-id></citation></ref>
<ref id="B7">
<label>7.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tilghman-Osborne</surname> <given-names>C</given-names></name> <name><surname>Cole</surname> <given-names>DA</given-names></name> <name><surname>Felton</surname> <given-names>JW</given-names></name></person-group>. <article-title>Inappropriate and excessive guilt: instrument validation and developmental differences in relation to depression</article-title>. <source>J Abnorm Child Psychol.</source> (<year>2012</year>) <volume>40</volume>:<fpage>607</fpage>&#x02013;<lpage>20</lpage>. <pub-id pub-id-type="doi">10.1007/s10802-011-9591-6</pub-id><pub-id pub-id-type="pmid">22086497</pub-id></citation></ref>
<ref id="B8">
<label>8.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Piers</surname> <given-names>G</given-names></name> <name><surname>Singer</surname> <given-names>M</given-names></name></person-group>. <source>Shame and Guilt: A Psychoanalytic and a Cultural study</source>. <publisher-loc>Springfield, IL</publisher-loc>: <publisher-name>Charles C. Thomas</publisher-name> (<year>1953</year>).</citation></ref>
<ref id="B9">
<label>9.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Freud</surname> <given-names>S</given-names></name></person-group>. <article-title>The ego and the Id</article-title>. In: <person-group person-group-type="editor"><name><surname>Strachey</surname> <given-names>J</given-names></name></person-group>, editor. <source>The Complete Pschological Works of Sigmund Freud.</source> <publisher-loc>London</publisher-loc>: <publisher-name>Hogarth Press</publisher-name> (<year>1959</year>). p. <fpage>3</fpage>&#x02013;<lpage>66</lpage>.<pub-id pub-id-type="pmid">4115729</pub-id></citation></ref>
<ref id="B10">
<label>10.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Freud</surname> <given-names>S</given-names></name></person-group>. <article-title>The dissolution of the oedipus complex</article-title>. In: <person-group person-group-type="editor"><name><surname>Strachey</surname> <given-names>J</given-names></name></person-group>, editor. <source>The Standard Edition of the Complete Psychological Works of Sigmund Freud</source>. <publisher-loc>London</publisher-loc>: <publisher-name>Hogarth</publisher-name> (<year>1961</year>). p. <fpage>173</fpage>&#x02013;<lpage>82</lpage>.</citation></ref>
<ref id="B11">
<label>11.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Freud</surname> <given-names>S</given-names></name></person-group>. <source>Civilization and its Discontents</source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Norton</publisher-name> (<year>1961</year>).</citation></ref>
<ref id="B12">
<label>12.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Menninger</surname> <given-names>K</given-names></name></person-group>. <source>Man Against Himself.</source> <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Harcourt, Brace and World</publisher-name> (<year>1966</year>).</citation></ref>
<ref id="B13">
<label>13.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Piers</surname> <given-names>G</given-names></name> <name><surname>Singer</surname> <given-names>M</given-names></name></person-group>. <source>Shame and Guilt: A Psychoanalytic and Cultural Study</source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Norton</publisher-name> (<year>1971</year>).</citation></ref>
<ref id="B14">
<label>14.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Blatt</surname> <given-names>S</given-names></name></person-group>. <article-title>Levels of object representation inanaclitic and introjective depression</article-title>. <source>Psychoanal Stud Child.</source> (<year>1974</year>) <volume>29</volume>:<fpage>107</fpage>&#x02013;<lpage>57</lpage>. <pub-id pub-id-type="doi">10.1080/00797308.1974.11822616</pub-id><pub-id pub-id-type="pmid">4445397</pub-id></citation></ref>
<ref id="B15">
<label>15.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Panken</surname> <given-names>S</given-names></name></person-group>. <source>The Joy of Suffering: Psychoanalytic Theory and Therapy of Masochism</source>. <publisher-loc>Northvale</publisher-loc>: <publisher-name>Jason Aronson</publisher-name> (<year>1983</year>).</citation></ref>
<ref id="B16">
<label>16.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hartmann</surname> <given-names>H</given-names></name> <name><surname>Loewenstein</surname> <given-names>RM</given-names></name></person-group>. <article-title>Notes on the superego</article-title>. <source>The Psychoanalytic Study of the Child</source>. (<year>1962</year>) <volume>17</volume>:<fpage>42</fpage>&#x02013;<lpage>81</lpage>. <pub-id pub-id-type="doi">10.1080/00797308.1962.11822838</pub-id></citation></ref>
<ref id="B17">
<label>17.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jones</surname> <given-names>WH</given-names></name> <name><surname>Kugler</surname> <given-names>K</given-names></name></person-group>. <article-title>Interpersonal correlates of the guilt inventory</article-title>. <source>J Pers Assess</source>. (<year>1993</year>) <volume>61</volume>:<fpage>246</fpage>&#x02013;<lpage>58</lpage>. <pub-id pub-id-type="doi">10.1207/s15327752jpa6102_6</pub-id><pub-id pub-id-type="pmid">16370822</pub-id></citation></ref>
<ref id="B18">
<label>18.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Baumeister</surname> <given-names>RF</given-names></name> <name><surname>Stillwell</surname> <given-names>AM</given-names></name> <name><surname>Heatherton</surname> <given-names>TF</given-names></name></person-group>. <article-title>Guilt: an interpersonal approach</article-title>. <source>Psychol Bull.</source> (<year>1994</year>) <volume>115</volume>:<fpage>243</fpage>&#x02013;<lpage>67</lpage>. <pub-id pub-id-type="doi">10.1037/0033-2909.115.2.243</pub-id><pub-id pub-id-type="pmid">8165271</pub-id></citation></ref>
<ref id="B19">
<label>19.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Hoffman</surname> <given-names>ML</given-names></name></person-group>. <article-title>Varieties of empathy-based guilt</article-title>. In: <person-group person-group-type="editor"><name><surname>Bybee</surname> <given-names>J</given-names></name></person-group>, editor. <source>Guilt and Children</source>. <publisher-loc>San Diego, CA</publisher-loc>: <publisher-name>Academic Press</publisher-name>. (<year>1998</year>). p. <fpage>91</fpage>&#x02013;<lpage>112</lpage>. <pub-id pub-id-type="doi">10.1016/B978-012148610-5/50005-9</pub-id></citation></ref>
<ref id="B20">
<label>20.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kubany</surname> <given-names>ES</given-names></name> <name><surname>Watson</surname> <given-names>SB</given-names></name></person-group>. <article-title>Guilt: elaboration of a multidimensional model</article-title>. <source>Psychol Rec</source>. (<year>2003</year>) <volume>53</volume>:<fpage>51</fpage>&#x02013;<lpage>90</lpage>.</citation></ref>
<ref id="B21">
<label>21.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mancini</surname> <given-names>F</given-names></name> <name><surname>Gangemi</surname> <given-names>A</given-names></name></person-group>. <article-title>Senso di colpa deontologico e senso di colpa altruistico: una tesi dualista</article-title>. <source>G Ital Psicol</source>. (<year>2018</year>) <volume>45</volume>:<fpage>483</fpage>&#x02013;<lpage>510</lpage>. <pub-id pub-id-type="doi">10.1421/92800</pub-id></citation></ref>
<ref id="B22">
<label>22.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Basile</surname> <given-names>B</given-names></name> <name><surname>Mancini</surname> <given-names>F</given-names></name></person-group>. <article-title>Eliciting guilty feelings: a preliminary study differentiating deontological and altruistic guilt</article-title>. <source>Psych.</source> (<year>2011</year>) <volume>2</volume>:<fpage>98</fpage>. <pub-id pub-id-type="doi">10.4236/psych.2011.22016</pub-id><pub-id pub-id-type="pmid">20842749</pub-id></citation></ref>
<ref id="B23">
<label>23.</label>
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Mancini</surname> <given-names>F</given-names></name></person-group>. <article-title>I sensi di colpa altruistico e deontologico</article-title>. <source>Cogn Clin.</source> (<year>2008</year>) <volume>5</volume>:<fpage>123</fpage>&#x02013;<lpage>44</lpage>. Available online at: <ext-link ext-link-type="uri" xlink:href="http://www.apc.it/wp-content/uploads/2013/06/2008-i-sensi-di-colpa-altruistico-e-deontologico-Mancini.pdf">http://www.apc.it/wp-content/uploads/2013/06/2008-i-sensi-di-colpa-altruistico-e-deontologico-Mancini.pdf</ext-link></citation></ref>
<ref id="B24">
<label>24.</label>
<citation citation-type="book"><person-group person-group-type="author"><collab>American Psychiatric Association</collab></person-group>. <article-title>Dsm-5 Task Force</article-title>. <source>Diagnostic and Statistical Manual of Mental Disorders DSM-5.</source> <publisher-loc>Washington, DC</publisher-loc>: <publisher-name>American Psychiatric Association</publisher-name> (<year>2013</year>). <pub-id pub-id-type="doi">10.1176/appi.books.9780890425596</pub-id></citation></ref>
<ref id="B25">
<label>25.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Gilbert</surname> <given-names>P</given-names></name></person-group>. <source>Depression: The Evolution of Powerlessness</source>. <publisher-loc>Hove</publisher-loc>: <publisher-name>Lawrence Erlbaum Associates</publisher-name> (<year>1992</year>).</citation></ref>
<ref id="B26">
<label>26.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>O&#x00027;Connor</surname> <given-names>LE</given-names></name> <name><surname>Berry</surname> <given-names>JW</given-names></name> <name><surname>Weiss</surname> <given-names>J</given-names></name></person-group>. <article-title>Interpersonal guilt, shame and psychological problems</article-title>. <source>J Social Clin Psychol</source>. (<year>1999</year>) <volume>18</volume>:<fpage>356</fpage>&#x02013;<lpage>61</lpage>. <pub-id pub-id-type="doi">10.1521/jscp.1999.18.2.181</pub-id></citation></ref>
<ref id="B27">
<label>27.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shafran</surname> <given-names>R</given-names></name> <name><surname>Watkins</surname> <given-names>E</given-names></name> <name><surname>Charman</surname> <given-names>T</given-names></name></person-group>. <article-title>Guilt in obsessive- compulsive disorder</article-title>. <source>J Anxiety Disord.</source> (<year>1996</year>) <volume>10</volume>:<fpage>509</fpage>&#x02013;<lpage>16</lpage>. <pub-id pub-id-type="doi">10.1016/S0887-6185(96)00026-6</pub-id></citation></ref>
<ref id="B28">
<label>28.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pardini</surname> <given-names>DA</given-names></name> <name><surname>Lochman</surname> <given-names>JE</given-names></name> <name><surname>Frick</surname> <given-names>PJ</given-names></name></person-group>. <article-title>Callous/unemotional traits and social-cognitive processes in adjudicated youths</article-title>. <source>J Am Acad Child Adol Psychiatry.</source> (<year>2003</year>) <volume>42</volume>:<fpage>364</fpage>&#x02013;<lpage>71</lpage>. <pub-id pub-id-type="doi">10.1097/00004583-200303000-00018</pub-id><pub-id pub-id-type="pmid">12595791</pub-id></citation></ref>
<ref id="B29">
<label>29.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dunn</surname> <given-names>PK</given-names></name> <name><surname>Ondercin</surname> <given-names>P</given-names></name></person-group>. <article-title>Personality variables related to compulsive eating in college women</article-title>. <source>J Clin Psychol.</source> (<year>1981</year>) <volume>37</volume>:<fpage>43</fpage>&#x02013;<lpage>49</lpage>.<pub-id pub-id-type="pmid">7204607</pub-id></citation></ref>
<ref id="B30">
<label>30.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Rodin</surname> <given-names>J</given-names></name> <name><surname>Silberstein</surname> <given-names>L</given-names></name> <name><surname>Striegel-Moore</surname> <given-names>R</given-names></name></person-group>. <article-title>Women and weight: a normative discontent</article-title>. In: <person-group person-group-type="editor"><name><surname>Sonderegger</surname> <given-names>TB</given-names></name></person-group>, editor. <source>Nebraska Symposium on Motivation</source>. <publisher-loc>Lincoln, NE</publisher-loc>: <publisher-name>University of Nebraska Press</publisher-name> (<year>1984</year>). p. <fpage>267</fpage>&#x02013;<lpage>307</lpage>.<pub-id pub-id-type="pmid">6398857</pub-id></citation></ref>
<ref id="B31">
<label>31.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fairburn</surname> <given-names>CG</given-names></name> <name><surname>Cooper</surname> <given-names>PJ</given-names></name></person-group>. <article-title>Binge-eating, self-induced vomiting and laxative abuse: a community study</article-title>. <source>Psychol Med</source>. (<year>1984</year>) <volume>14</volume>:<fpage>40</fpage>&#x02013;<lpage>410</lpage>. <pub-id pub-id-type="doi">10.1017/S0033291700003640</pub-id><pub-id pub-id-type="pmid">6588399</pub-id></citation></ref>
<ref id="B32">
<label>32.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gangemi</surname> <given-names>A</given-names></name> <name><surname>Mancini</surname> <given-names>F</given-names></name></person-group>. <article-title>Obsessive patients and deontological guilt: a review</article-title>. <source>J Exp Psychopathol</source>. (<year>2017</year>) <volume>4</volume>:<fpage>155</fpage>&#x02013;<lpage>68</lpage>. <pub-id pub-id-type="doi">10.5127/pr.045916</pub-id></citation></ref>
<ref id="B33">
<label>33.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Salkovskis</surname> <given-names>PM</given-names></name></person-group>. <article-title>Obsessional-compulsive problems: a cognitive-behavioral analysis</article-title>. <source>Behav Res Ther.</source> (<year>1985</year>) <volume>16</volume>:<fpage>233</fpage>&#x02013;<lpage>48</lpage>. <pub-id pub-id-type="doi">10.1016/0005-7967(85)90105-6</pub-id><pub-id pub-id-type="pmid">4051930</pub-id></citation></ref>
<ref id="B34">
<label>34.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rachman</surname> <given-names>S</given-names></name></person-group>. <article-title>Obsessions, responsibility and guilt</article-title>. <source>Behav Res Ther</source>. (<year>1993</year>) <volume>31</volume>:<fpage>149</fpage>&#x02013;<lpage>54</lpage>. <pub-id pub-id-type="doi">10.1016/0005-7967(93)90066-4</pub-id><pub-id pub-id-type="pmid">8442740</pub-id></citation></ref>
<ref id="B35">
<label>35.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mancini</surname> <given-names>F</given-names></name> <name><surname>Gangemi</surname> <given-names>A</given-names></name></person-group>. <article-title>Fear of guilt from behaving irresponsibly in obsessive-compulsive disorder</article-title>. <source>J Behav Ther Exp Psychiatry.</source> (<year>2004</year>) <volume>35</volume>:<fpage>109</fpage>&#x02013;<lpage>20</lpage>. <pub-id pub-id-type="doi">10.1016/j.jbtep.2004.04.003</pub-id><pub-id pub-id-type="pmid">15210373</pub-id></citation></ref>
<ref id="B36">
<label>36.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mancini</surname> <given-names>F</given-names></name> <name><surname>D&#x00027;Olimpio</surname> <given-names>F</given-names></name> <name><surname>Cieri</surname> <given-names>L</given-names></name></person-group>. <article-title>Manipulation of responsibility in non- clinical subjects: does expectations of failure exacerbate obsessive-compulsive behaviours?</article-title> <source>Behav Res Ther</source>. (<year>2004</year>) <volume>42</volume>:<fpage>449</fpage>&#x02013;<lpage>57</lpage>. <pub-id pub-id-type="doi">10.1016/S0005-7967(03)00153-0</pub-id><pub-id pub-id-type="pmid">14998738</pub-id></citation></ref>
<ref id="B37">
<label>37.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gambin</surname> <given-names>M</given-names></name> <name><surname>Sharp</surname> <given-names>C</given-names></name></person-group>. <article-title>The relations between empathy, guilt, shame and depression in inpatient adolescents</article-title>. <source>J Affect Disord</source>. (<year>2018</year>) <volume>241</volume>:<fpage>381</fpage>&#x02013;<lpage>7</lpage>. <pub-id pub-id-type="doi">10.1016/j.jad.2018.08.068</pub-id><pub-id pub-id-type="pmid">30145508</pub-id></citation></ref>
<ref id="B38">
<label>38.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Guhn</surname> <given-names>A</given-names></name> <name><surname>Merkel</surname> <given-names>L</given-names></name> <name><surname>H&#x000FC;bner</surname> <given-names>L</given-names></name> <name><surname>Dziobek</surname> <given-names>I</given-names></name> <name><surname>Sterzer</surname> <given-names>P</given-names></name> <name><surname>K&#x000F6;hler</surname> <given-names>S</given-names></name></person-group>. <article-title><italic>Understanding versus feeling the emotions of</italic> others: how persistent and recurrent depression affect empathy</article-title>. <source>J Psychiatr Res</source>. (<year>2020</year>) <volume>130</volume>:<fpage>120</fpage>&#x02013;<lpage>7</lpage>. <pub-id pub-id-type="doi">10.1016/j.jpsychires.2020.06.023</pub-id><pub-id pub-id-type="pmid">32805521</pub-id></citation></ref>
<ref id="B39">
<label>39.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Malti</surname> <given-names>T</given-names></name> <name><surname>Krettenauer</surname> <given-names>T</given-names></name></person-group>. <article-title>The relation of moral emotion attributions to prosocial and antisocial behavior: a meta-analysis</article-title>. <source>Child Dev.</source> (<year>2013</year>) <volume>84</volume>:<fpage>397</fpage>&#x02013;<lpage>412</lpage>. <pub-id pub-id-type="doi">10.1111/j.1467-8624.2012.01851.x</pub-id><pub-id pub-id-type="pmid">23005580</pub-id></citation></ref>
<ref id="B40">
<label>40.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kochanska</surname> <given-names>G</given-names></name> <name><surname>Casey</surname> <given-names>RJ</given-names></name> <name><surname>Fukumoto</surname> <given-names>A</given-names></name></person-group>. <article-title>Toddlers&#x00027; sensitivity to standard violations</article-title>. <source>Child Dev.</source> (<year>1995</year>) <volume>66</volume>:<fpage>643</fpage>&#x02013;<lpage>56</lpage>. <pub-id pub-id-type="doi">10.1111/j.1467-8624.1995.tb00895.x</pub-id></citation></ref>
<ref id="B41">
<label>41.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Olthof</surname> <given-names>T</given-names></name></person-group>. <article-title>Anticipated feelings of guilt and shame as predictors of early adolescents&#x00027; antisocial and prosocial interpersonal behaviour</article-title>. <source>Eur J Dev Psychol.</source> (<year>2012</year>) <volume>9</volume>:<fpage>371</fpage>&#x02013;<lpage>88</lpage>. <pub-id pub-id-type="doi">10.1080/17405629.2012.680300</pub-id></citation></ref>
<ref id="B42">
<label>42.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Donohue</surname> <given-names>MR</given-names></name> <name><surname>Tully</surname> <given-names>EC</given-names></name></person-group>. <article-title>Reparative prosocial behaviors alleviate children&#x00027;s guilt</article-title>. <source>Dev Psychol.</source> (<year>2019</year>) <volume>55</volume>:<fpage>2102</fpage>&#x02013;<lpage>113</lpage>. <pub-id pub-id-type="doi">10.1037/dev0000788</pub-id><pub-id pub-id-type="pmid">31343231</pub-id></citation></ref>
<ref id="B43">
<label>43.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Vaish</surname> <given-names>A</given-names></name> <name><surname>Carpenter</surname> <given-names>M</given-names></name> <name><surname>Tomasello</surname> <given-names>M</given-names></name></person-group>. <article-title>The early emergence of guilt-motivated prosocial behavior</article-title>. <source>Child Dev.</source> (<year>2016</year>) <volume>87</volume>:<fpage>1772</fpage>&#x02013;<lpage>82</lpage>. <pub-id pub-id-type="doi">10.1111/cdev.12628</pub-id><pub-id pub-id-type="pmid">28262936</pub-id></citation></ref>
<ref id="B44">
<label>44.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tangney</surname> <given-names>JP</given-names></name> <name><surname>Wagner</surname> <given-names>P</given-names></name> <name><surname>Gramzow</surname> <given-names>R</given-names></name></person-group>. <article-title>Proneness to shame, proneness to guilt, and psychopathology</article-title>. <source>J Abnorm Psychol</source>. (<year>1992</year>) <volume>101</volume>:<fpage>469</fpage>. <pub-id pub-id-type="doi">10.1037/0021-843X.101.3.469</pub-id><pub-id pub-id-type="pmid">1500604</pub-id></citation></ref>
<ref id="B45">
<label>45.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bybee</surname> <given-names>J</given-names></name> <name><surname>Zigler</surname> <given-names>E</given-names></name> <name><surname>Berliner</surname> <given-names>D</given-names></name> <name><surname>Merisca</surname> <given-names>R</given-names></name></person-group>. <article-title>Guilt, guilt-evoking events, depression, and eating disorders</article-title>. <source>Curr Psychol.</source> (<year>1996</year>) <volume>15</volume>:<fpage>113</fpage>&#x02013;<lpage>27</lpage>. <pub-id pub-id-type="doi">10.1007/BF02686944</pub-id></citation></ref>
<ref id="B46">
<label>46.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ghatavi</surname> <given-names>K</given-names></name> <name><surname>Nicolson</surname> <given-names>R</given-names></name> <name><surname>MacDonald</surname> <given-names>C</given-names></name> <name><surname>Osher</surname> <given-names>S</given-names></name> <name><surname>Levitt</surname> <given-names>A</given-names></name></person-group>. <article-title>Defining guilt in depression: a comparison of subjects with major depression, chronic medical illness and healthy controls</article-title>. <source>J Affect Disord</source>. (<year>2002</year>) <volume>68</volume>:<fpage>307</fpage>&#x02013;<lpage>15</lpage>. <pub-id pub-id-type="doi">10.1016/S0165-0327(01)00335-4</pub-id><pub-id pub-id-type="pmid">12063158</pub-id></citation></ref>
<ref id="B47">
<label>47.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tangney</surname> <given-names>JP</given-names></name> <name><surname>Wagner</surname> <given-names>PE</given-names></name> <name><surname>Hill-Barlow</surname> <given-names>D</given-names></name> <name><surname>Marshall</surname> <given-names>DE</given-names></name> <name><surname>Gramzow</surname> <given-names>R</given-names></name></person-group>. <article-title>Relation of shame and guilt to constructive versus destructive responses to anger across the lifespan</article-title>. <source>J Pers Soc Psychol</source>. (<year>1996</year>) <volume>70</volume>:<fpage>797</fpage>&#x02013;<lpage>809</lpage>. <pub-id pub-id-type="doi">10.1037/0022-3514.70.4.797</pub-id><pub-id pub-id-type="pmid">8636899</pub-id></citation></ref>
<ref id="B48">
<label>48.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hyun Rhee</surname> <given-names>S</given-names></name> <name><surname>Friedman</surname> <given-names>NP</given-names></name> <name><surname>Boeldt</surname> <given-names>DL</given-names></name> <name><surname>Corley</surname> <given-names>RP</given-names></name> <name><surname>Hewitt</surname> <given-names>JK</given-names></name> <name><surname>Knafo</surname> <given-names>A</given-names></name> <etal/></person-group>. <article-title>Early concern and disregard for others as predictors of antisocial behavior</article-title>. <source>J Child Psychol. Psychiatry.</source> (<year>2013</year>) <volume>54</volume>:<fpage>157</fpage>&#x02013;<lpage>66</lpage>. <pub-id pub-id-type="doi">10.1111/j.1469-7610.2012.02574.x</pub-id><pub-id pub-id-type="pmid">23320806</pub-id></citation></ref>
<ref id="B49">
<label>49.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dinolfo</surname> <given-names>C</given-names></name> <name><surname>Malti</surname> <given-names>T</given-names></name></person-group>. <article-title>Interpretive understanding, sympathy, and moral emotion attribution in oppositional defiant disorder symptomatology</article-title>. <source>Child Psychiatry Hum Dev.</source> (<year>2013</year>) <volume>44</volume>:<fpage>633</fpage>&#x02013;<lpage>45</lpage>. <pub-id pub-id-type="doi">10.1007/s10578-013-0357-y</pub-id><pub-id pub-id-type="pmid">23322355</pub-id></citation></ref>
<ref id="B50">
<label>50.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Malti</surname> <given-names>T</given-names></name></person-group>. <article-title>Moral emotions and aggressive behavior in childhood</article-title>. In: <person-group person-group-type="editor"><name><surname>Steffgen</surname> <given-names>G</given-names></name> <name><surname>Gollwitzer</surname> <given-names>M</given-names></name></person-group>, editors. <source>Emotions and Aggressive Behavior.</source> <publisher-loc>G&#x000F6;ttingen</publisher-loc>: <publisher-name>Hogrefe</publisher-name> (<year>2007</year>) <fpage>185</fpage>&#x02013;<lpage>200</lpage>.</citation></ref>
<ref id="B51">
<label>51.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Krettenauer</surname> <given-names>T</given-names></name> <name><surname>Eichler</surname> <given-names>D</given-names></name></person-group>. <article-title>Adolescents&#x00027; self-attributed moral emotions following a moral transgression: relations with delinquency, confidence in moral judgment and age</article-title>. <source>Br J Dev Psychol.</source> (<year>2006</year>) <volume>24</volume>:<fpage>489</fpage>&#x02013;<lpage>506</lpage>. <pub-id pub-id-type="doi">10.1348/026151005X50825</pub-id></citation></ref>
<ref id="B52">
<label>52.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Colasante</surname> <given-names>T</given-names></name> <name><surname>Zuffian&#x000F2;</surname> <given-names>A</given-names></name> <name><surname>Malti</surname> <given-names>T</given-names></name></person-group>. <article-title>Daily deviations in anger, guilt, and sympathy: a developmental diary study of aggression</article-title>. <source>J Abnorm Child Psychol.</source> (<year>2016</year>) <volume>44</volume>:<fpage>1515</fpage>&#x02013;<lpage>26</lpage>. <pub-id pub-id-type="doi">10.1007/s10802-016-0143-y</pub-id><pub-id pub-id-type="pmid">27000823</pub-id></citation></ref>
<ref id="B53">
<label>53.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Oakley</surname> <given-names>B</given-names></name> <name><surname>Knafo</surname> <given-names>A</given-names></name> <name><surname>Madhavan</surname> <given-names>G</given-names></name> <name><surname>Wilson</surname> <given-names>DS</given-names></name></person-group>. <source>Pathological Altruism</source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Oxford University Press</publisher-name> (<year>2012</year>).<pub-id pub-id-type="pmid">23754434</pub-id></citation></ref>
<ref id="B54">
<label>54.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Reeves</surname> <given-names>J</given-names></name> <name><surname>Reynolds</surname> <given-names>S</given-names></name> <name><surname>Coker</surname> <given-names>S</given-names></name> <name><surname>Wilson</surname> <given-names>C</given-names></name></person-group>. <article-title>An experimental manipulation of responsibility in children: a test of the inflated responsibility model of obsessive-compulsive disorder</article-title>. <source>J Behav Ther Exp Psychiatry.</source> (<year>2010</year>) <volume>41</volume>:<fpage>228</fpage>&#x02013;<lpage>33</lpage>. <pub-id pub-id-type="doi">10.1016/j.jbtep.2010.01.007</pub-id><pub-id pub-id-type="pmid">20153459</pub-id></citation></ref>
<ref id="B55">
<label>55.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tangney</surname> <given-names>JP</given-names></name></person-group>. <article-title>Situational determinants of shame and guilt in young adulthood</article-title>. <source>Pers Soc Psychol Bull.</source> (<year>1992</year>) <volume>18</volume>:<fpage>199</fpage>&#x02013;<lpage>206</lpage>. <pub-id pub-id-type="doi">10.1177/0146167292182011</pub-id></citation></ref>
<ref id="B56">
<label>56.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Baumeister</surname> <given-names>RF</given-names></name> <name><surname>Stillwell</surname> <given-names>AM</given-names></name> <name><surname>Heatherton</surname> <given-names>TF</given-names></name></person-group>. <article-title>Interpersonal aspects of guilt: evidence from narrative studies</article-title>. In: <person-group person-group-type="editor"><name><surname>Tangney</surname> <given-names>JP</given-names></name> <name><surname>Fisher</surname> <given-names>KW</given-names></name></person-group>, editors. <source>Self-Conscious Emotions: the Psychology of Shame, Guilt, Embarrassment and Pride</source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Guilford Press</publisher-name> (<year>1995</year>). p. <fpage>295</fpage>&#x02013;<lpage>305</lpage>.</citation></ref>
<ref id="B57">
<label>57.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Barrett</surname> <given-names>KC</given-names></name></person-group>. <article-title>A functionalist approach to shame and guilt</article-title>. In: <person-group person-group-type="editor"><name><surname>Tangney</surname> <given-names>JP</given-names></name> <name><surname>Fischer</surname> <given-names>KW</given-names></name></person-group>, editors. <source>Self-Conscious Emotions: The Psychology of Shame, in Guilt, Embarrassment, and Pride</source>, <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Guilford Press</publisher-name> (<year>1995</year>) <fpage>25</fpage>&#x02013;<lpage>63</lpage>.</citation></ref>
<ref id="B58">
<label>58.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Leith</surname> <given-names>KP</given-names></name> <name><surname>Baumeister</surname> <given-names>RF</given-names></name></person-group>. <article-title>Empathy, shame, guilt and narratives of interpersonal conflicts: guilt&#x02013;prone people are better at perspective taking</article-title>. <source>J Pers</source>. (<year>1998</year>) <volume>66</volume>:<fpage>1</fpage>&#x02013;<lpage>37</lpage>. <pub-id pub-id-type="doi">10.1111/1467-6494.00001</pub-id></citation></ref>
<ref id="B59">
<label>59.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jones</surname> <given-names>WH</given-names></name> <name><surname>Schratter</surname> <given-names>AK</given-names></name> <name><surname>Kugler</surname> <given-names>K</given-names></name></person-group>. <article-title>The guilt inventory</article-title>. <source>Psychol Rep.</source> (<year>2000</year>) <volume>87</volume>:<fpage>1039</fpage>&#x02013;<lpage>42</lpage>. <pub-id pub-id-type="doi">10.2466/pr0.2000.87.3f.1039</pub-id><pub-id pub-id-type="pmid">11272739</pub-id></citation></ref>
<ref id="B60">
<label>60.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>O&#x00027;Connor</surname> <given-names>LE</given-names></name></person-group>. <article-title>Survivor guilt and depression</article-title>. <source>Paper Presented at the meeting of the American Psychological Association Division 39 Meeting.</source> San Francisco, CA (<year>1995</year>).</citation></ref>
<ref id="B61">
<label>61.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cohen</surname> <given-names>TR</given-names></name> <name><surname>Wolf</surname> <given-names>ST</given-names></name> <name><surname>Panter</surname> <given-names>AT</given-names></name> <name><surname>Insko</surname> <given-names>CA</given-names></name></person-group>. <article-title>Introducing the GASP scale: a new measure of guilt and shame proneness</article-title>. <source>J Pers Soc Psychol.</source> (<year>2011</year>) <volume>100</volume>:<fpage>947</fpage>&#x02013;<lpage>66</lpage>. <pub-id pub-id-type="doi">10.1037/a0022641</pub-id><pub-id pub-id-type="pmid">21517196</pub-id></citation></ref>
<ref id="B62">
<label>62.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Harder</surname> <given-names>DH</given-names></name> <name><surname>Zalma</surname> <given-names>A</given-names></name></person-group>. <article-title>Two promising shame and guilt scales:a construct validity comparison</article-title>. <source>J Pers Assess.</source> (<year>1990</year>) <volume>55</volume>:<fpage>729</fpage>&#x02013;<lpage>45</lpage>.<pub-id pub-id-type="pmid">2280336</pub-id></citation></ref>
<ref id="B63">
<label>63.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Tangney</surname> <given-names>JP</given-names></name> <name><surname>Dearing</surname> <given-names>RL</given-names></name> <name><surname>Wagner</surname> <given-names>PE</given-names></name> <name><surname>Gramzow</surname> <given-names>R</given-names></name></person-group>. <source>The Test of Self Conscious Affect-3 (TOSCA-3)</source> <publisher-loc>Fairfax, VA</publisher-loc>: <publisher-name>George Mason University</publisher-name> (<year>2000</year>).</citation></ref>
<ref id="B64">
<label>64.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Tangney</surname> <given-names>J. P</given-names></name> <name><surname>Wagner</surname> <given-names>P. E.</given-names></name> <name><surname>Burggraf</surname> <given-names>S. A.</given-names></name> <name><surname>Gramzow</surname> <given-names>R.</given-names></name> <name><surname>Fletcher</surname> <given-names>C.</given-names></name></person-group> <source>The Test of Self-Conscious Affect for Children (TOSCA-C).</source> <publisher-loc>Fairfax, VA</publisher-loc>: <publisher-name>George Mason University</publisher-name> (<year>1990</year>).</citation></ref>
<ref id="B65">
<label>65.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Tangney</surname> <given-names>JP</given-names></name> <name><surname>Wagner</surname> <given-names>PE</given-names></name> <name><surname>Gavlas</surname> <given-names>J</given-names></name> <name><surname>Gramzow</surname> <given-names>R</given-names></name></person-group>. <source>The Test of Self-Conscious Affect for Adolescents (TOSCA-A).</source> <publisher-loc>Fairfax, VA</publisher-loc>: <publisher-name>George Mason University</publisher-name> (<year>1991</year>).</citation></ref>
<ref id="B66">
<label>66.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hoffman</surname> <given-names>ML</given-names></name></person-group>. <article-title>Sex differences in moral internalization and values</article-title>. <source>J Pers Soc Psychol</source>. (<year>1975</year>) <volume>32</volume>:<fpage>720</fpage>. <pub-id pub-id-type="doi">10.1037/0022-3514.32.4.720</pub-id><pub-id pub-id-type="pmid">1185510</pub-id></citation></ref>
<ref id="B67">
<label>67.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Barrett</surname> <given-names>KC</given-names></name> <name><surname>Zahn-Waxler</surname> <given-names>C</given-names></name> <name><surname>Cole</surname> <given-names>PM</given-names></name></person-group>. <article-title>Avoiders vs</article-title>. <source>amenders: Implications for the investigation of guilt and shame during toddlerhood? Cogn Emot.</source> (<year>1993</year>) <volume>7</volume>:<fpage>481</fpage>&#x02013;<lpage>505</lpage>. <pub-id pub-id-type="doi">10.1080/02699939308409201</pub-id></citation></ref>
<ref id="B68">
<label>68.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shahnawaz</surname> <given-names>S</given-names></name> <name><surname>Malik</surname> <given-names>JA</given-names></name></person-group>. <article-title>Assessing shame and guilt in adolescents: translation and adaptation of test of self-conscious affect for adolescents (TOSCA-A)</article-title>. <source>Pak J Psychol Res.</source> (<year>2017</year>) <volume>32</volume>:<fpage>97</fpage>&#x02013;<lpage>116</lpage>.</citation></ref>
<ref id="B69">
<label>69.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tangney</surname> <given-names>JP</given-names></name></person-group>. <article-title>Conceptual and methodological issues in the assessment of shame and guilt</article-title>. <source>Behaviour Research and Therapy.</source> (<year>1996</year>) <volume>34</volume>:<fpage>741</fpage>&#x02013;<lpage>54</lpage>. <pub-id pub-id-type="doi">10.1016/0005-7967(96)00034-4</pub-id><pub-id pub-id-type="pmid">8936757</pub-id></citation></ref>
<ref id="B70">
<label>70.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Watson</surname> <given-names>SD</given-names></name> <name><surname>Gomez</surname> <given-names>R</given-names></name> <name><surname>Gullone</surname> <given-names>E</given-names></name></person-group>. <article-title>The shame and guilt scales of the test of self-conscious affect-adolescent (TOSCA-A): psychometric properties for responses from children, and measurement invariance across children and adolescents</article-title>. <source>Front Psychol</source>. (<year>2016</year>) <volume>7</volume>:<fpage>635</fpage>. <pub-id pub-id-type="doi">10.3389/fpsyg.2016.00635</pub-id><pub-id pub-id-type="pmid">27242573</pub-id></citation></ref>
<ref id="B71">
<label>71.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Silfver</surname> <given-names>M</given-names></name> <name><surname>Helkama</surname> <given-names>K</given-names></name></person-group>. <article-title>Empathy, guilt, and gender: a comparison of two measures of guilt</article-title>. <source>Scand J Psychol</source>. (<year>2007</year>) <volume>48</volume>:<fpage>239</fpage>&#x02013;<lpage>46</lpage>. <pub-id pub-id-type="doi">10.1111/j.1467-9450.2007.00578.x</pub-id><pub-id pub-id-type="pmid">17518916</pub-id></citation></ref>
<ref id="B72">
<label>72.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Moher</surname> <given-names>D</given-names></name> <name><surname>Liberati</surname> <given-names>A</given-names></name> <name><surname>Tetzlaff</surname> <given-names>J</given-names></name> <name><surname>Altman</surname> <given-names>DG</given-names></name> <name><surname>Prisma</surname> <given-names>Group</given-names></name></person-group>. <article-title>Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement</article-title>. <source>PLoS Med.</source> (<year>2009</year>) <volume>6</volume>:<fpage>e1000097</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pmed.1000097</pub-id></citation></ref>
<ref id="B73">
<label>73.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Haddaway</surname> <given-names>NR</given-names></name> <name><surname>Collins</surname> <given-names>AM</given-names></name> <name><surname>Coughlin</surname> <given-names>D</given-names></name> <name><surname>Kirk</surname> <given-names>S</given-names></name></person-group>. <article-title>The role of google scholar in evidence reviews and its applicability to grey literature searching</article-title>. <source>PLoS ONE.</source> (<year>2015</year>) <volume>10</volume>:<fpage>e0138237</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0138237</pub-id><pub-id pub-id-type="pmid">26379270</pub-id></citation></ref>
<ref id="B74">
<label>74.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kronm&#x000FC;ller</surname> <given-names>KT</given-names></name> <name><surname>von Maltzahn</surname> <given-names>H</given-names></name> <name><surname>Horn</surname> <given-names>H</given-names></name> <name><surname>Hartmann</surname> <given-names>M</given-names></name> <name><surname>Victor</surname> <given-names>D</given-names></name> <name><surname>Reck</surname> <given-names>C</given-names></name> <etal/></person-group>. <article-title>Zur erfassung von schuld und scham bei kindern und jugendlichen</article-title>. <source>PPmP Psychother Psychosom Med Psychol</source>. (<year>2008</year>) <volume>58</volume>:<fpage>313</fpage>&#x02013;<lpage>20</lpage>. <pub-id pub-id-type="doi">10.1055/s-2007-986359</pub-id><pub-id pub-id-type="pmid">18642405</pub-id></citation></ref>
<ref id="B75">
<label>75.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Laskoski</surname> <given-names>LM</given-names></name> <name><surname>Natividade</surname> <given-names>JC</given-names></name> <name><surname>Hutz</surname> <given-names>CS</given-names></name></person-group>. <article-title>Development of instruments to assess shame and guilt in adolescents: empirical differences between the constructs</article-title>. <source>Paid&#x000E9;ia.</source> (<year>2013</year>) <volume>23</volume>:<fpage>171</fpage>&#x02013;<lpage>8</lpage>. <pub-id pub-id-type="doi">10.1590/1982-43272355201304</pub-id></citation></ref>
<ref id="B76">
<label>76.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Benesch</surname> <given-names>C</given-names></name> <name><surname>G&#x000F6;rtz-Dorten</surname> <given-names>A</given-names></name> <name><surname>Breuer</surname> <given-names>D</given-names></name> <name><surname>D&#x000F6;pfner</surname> <given-names>M</given-names></name></person-group>. <article-title>Assessment of callous-unemotional traits in 6 to 12 year-old children with oppositional defiant disorder/conduct disorder by parent ratings</article-title>. <source>J Psychopathol Behav Assess.</source> (<year>2014</year>) <volume>36</volume>:<fpage>519</fpage>&#x02013;<lpage>29</lpage>. <pub-id pub-id-type="doi">10.1007/s10862-014-9420-7</pub-id></citation></ref>
<ref id="B77">
<label>77.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Watson</surname> <given-names>SD</given-names></name> <name><surname>Gomez</surname> <given-names>R</given-names></name> <name><surname>Gullone</surname> <given-names>E</given-names></name></person-group>. <article-title>The shame and guilt scales of the test of self-conscious affect-adolescent (TOSCA-A): psychometric properties for responses from children, and measurement invariance across children and adolescents</article-title>. <source>Front Psychol.</source> (<year>2015</year>) <volume>7</volume>:<fpage>635</fpage>. <pub-id pub-id-type="doi">10.1117/1073191115608942</pub-id><pub-id pub-id-type="pmid">27242573</pub-id></citation></ref>
<ref id="B78">
<label>78.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Broekhof</surname> <given-names>E</given-names></name> <name><surname>Kouwenberg</surname> <given-names>M</given-names></name> <name><surname>Oosterveld</surname> <given-names>P</given-names></name> <name><surname>Frijns</surname> <given-names>JH</given-names></name> <name><surname>Rieffe</surname> <given-names>C</given-names></name></person-group>. <article-title>Use of the brief shame and guilt questionnaire in deaf and hard of hearing children and adolescents</article-title>. <source>Assess.</source> (<year>2020</year>) <volume>27</volume>:<fpage>194</fpage>&#x02013;<lpage>205</lpage>. <pub-id pub-id-type="doi">10.1177/1073191117725169</pub-id><pub-id pub-id-type="pmid">28799409</pub-id></citation></ref>
<ref id="B79">
<label>79.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Henderson</surname> <given-names>S</given-names></name> <name><surname>Davidson</surname> <given-names>JA</given-names></name> <name><surname>Lewis</surname> <given-names>IC</given-names></name> <name><surname>Gillard</surname> <given-names>HN</given-names></name> <name><surname>Baikie</surname> <given-names>AG</given-names></name></person-group>. <article-title>An assessment of hostility in a population of adolescents</article-title>. <source>Arch Gen Psychiatry.</source> (<year>1977</year>) <volume>34</volume>:<fpage>706</fpage>&#x02013;<lpage>11</lpage>. <pub-id pub-id-type="doi">10.1001/archpsyc.1977.01770180092008</pub-id><pub-id pub-id-type="pmid">869666</pub-id></citation></ref>
<ref id="B80">
<label>80.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cole</surname> <given-names>DA</given-names></name> <name><surname>Peeke</surname> <given-names>LG</given-names></name> <name><surname>Ingold</surname> <given-names>C</given-names></name></person-group>. <article-title>Characterological and behavioral self-blame in children: assessment and development considerations</article-title>. <source>Dev Psychopathol</source>. (<year>1996</year>) <volume>8</volume>:<fpage>381</fpage>&#x02013;<lpage>97</lpage>. <pub-id pub-id-type="doi">10.1017/S095457940000715X</pub-id></citation></ref>
<ref id="B81">
<label>81.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cartwright-Hatton</surname> <given-names>S</given-names></name> <name><surname>Mather</surname> <given-names>A</given-names></name> <name><surname>Illingworth</surname> <given-names>V</given-names></name> <name><surname>Brocki</surname> <given-names>J</given-names></name> <name><surname>Harrington</surname> <given-names>R</given-names></name> <name><surname>Wells</surname> <given-names>A</given-names></name></person-group>. <article-title>Development and preliminary validation of the meta-cognitions questionnaire-adolescent version</article-title>. <source>J Anxiety Disord.</source> (<year>2004</year>) <volume>18</volume>:<fpage>411</fpage>&#x02013;<lpage>22</lpage>. <pub-id pub-id-type="doi">10.1016/S0887-6185(02)00294-3</pub-id><pub-id pub-id-type="pmid">15125986</pub-id></citation></ref>
<ref id="B82">
<label>82.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Garnefski</surname> <given-names>N</given-names></name> <name><surname>Rieffe</surname> <given-names>C</given-names></name> <name><surname>Jellesma</surname> <given-names>F</given-names></name> <name><surname>Terwogt</surname> <given-names>MM</given-names></name> <name><surname>Kraaij</surname> <given-names>V</given-names></name></person-group>. <article-title>Cognitive emotion regulation strategies and emotional problems in 9&#x02013;11-year-old children</article-title>. <source>Eur Child Adolesc Psychiatry</source>. (<year>2007</year>) <volume>16</volume>:<fpage>1</fpage>. <pub-id pub-id-type="doi">10.1016/S0191-8869(03)00083-7</pub-id><pub-id pub-id-type="pmid">16791542</pub-id></citation></ref>
<ref id="B83">
<label>83.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bacow</surname> <given-names>TL</given-names></name> <name><surname>Pincus</surname> <given-names>DB</given-names></name> <name><surname>Ehrenreich</surname> <given-names>JT</given-names></name> <name><surname>Brody</surname> <given-names>LR</given-names></name></person-group>. <article-title>The metacognitions questionnaire for children: development and validation in a clinical sample of children and adolescents with anxiety disorders</article-title>. <source>J Anxiety Disord.</source> (<year>2009</year>) <volume>23</volume>:<fpage>727</fpage>&#x02013;<lpage>36</lpage>. <pub-id pub-id-type="doi">10.1016/j.janxdis.2009.02.013</pub-id><pub-id pub-id-type="pmid">19362445</pub-id></citation></ref>
<ref id="B84">
<label>84.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Liu</surname> <given-names>W</given-names></name> <name><surname>Chen</surname> <given-names>L</given-names></name> <name><surname>Blue</surname> <given-names>PR</given-names></name></person-group>. <article-title>Chinese adaptation and psychometric properties of the child version of the cognitive emotion regulation questionnaire</article-title>. <source>PLoS ONE.</source> (<year>2016</year>) <volume>11</volume>:<fpage>e0150206</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0150206</pub-id><pub-id pub-id-type="pmid">26925586</pub-id></citation></ref>
<ref id="B85">
<label>85.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Garc&#x000ED;a-V&#x000E1;zqeuz</surname> <given-names>FI</given-names></name> <name><surname>Vald&#x000E9;s-Cuervo</surname> <given-names>AA</given-names></name> <name><surname>Carlos-Mart&#x000ED;nez</surname> <given-names>EA</given-names></name> <name><surname>Alc&#x000E1;ntar-Nieblas</surname> <given-names>C</given-names></name></person-group>. <article-title>Psychometric properties of a scale measuring moral disengagement in mexican children</article-title>. <source>Act Colom Psicol.</source> (<year>2019</year>) <volume>22</volume>:<fpage>107</fpage>&#x02013;<lpage>17</lpage>. <pub-id pub-id-type="doi">10.14718/acp.2019.22.1.6</pub-id></citation></ref>
<ref id="B86">
<label>86.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Orgil&#x000E9;s</surname> <given-names>M</given-names></name> <name><surname>Morales</surname> <given-names>A</given-names></name> <name><surname>Fern&#x000E1;ndez-Mart&#x000ED;nez</surname> <given-names>I</given-names></name> <name><surname>Ortigosa-Quiles</surname> <given-names>JM</given-names></name> <name><surname>Espada</surname> <given-names>JP</given-names></name></person-group>. <article-title>Spanish adaptation and psychometric properties of the child version of the cognitive emotion regulation questionnaire</article-title>. <source>PLoS ONE.</source> (<year>2018</year>) <volume>13</volume>:<fpage>e0201656</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0201656</pub-id><pub-id pub-id-type="pmid">30071082</pub-id></citation></ref>
<ref id="B87">
<label>87.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Orgil&#x000E9;s</surname> <given-names>M</given-names></name> <name><surname>Morales</surname> <given-names>A</given-names></name> <name><surname>Fern&#x000E1;ndez-Mart&#x000ED;nez</surname> <given-names>I</given-names></name> <name><surname>Melero</surname> <given-names>S</given-names></name> <name><surname>Espada</surname> <given-names>JP</given-names></name></person-group>. <article-title>Validation of the short version of the cognitive emotion regulation questionnaire for Spanish children</article-title>. <source>J Child Health Care.</source> (<year>2019</year>) <volume>23</volume>:<fpage>87</fpage>&#x02013;<lpage>101</lpage>. <pub-id pub-id-type="doi">10.1177/1367493518777306</pub-id><pub-id pub-id-type="pmid">29788778</pub-id></citation></ref>
<ref id="B88">
<label>88.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Johnson</surname> <given-names>RC</given-names></name> <name><surname>Kalafat</surname> <given-names>JD</given-names></name></person-group>. <article-title>Projective and sociometric measures of conscience development</article-title>. <source>Child Dev.</source> (<year>1969</year>) <volume>40</volume>:<fpage>651</fpage>&#x02013;<lpage>5</lpage>. <pub-id pub-id-type="doi">10.2307/1127433</pub-id></citation></ref>
<ref id="B89">
<label>89.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cattell</surname> <given-names>RB</given-names></name> <name><surname>Wagner</surname> <given-names>A</given-names></name> <name><surname>Cattell</surname> <given-names>MD</given-names></name></person-group>. <article-title>Adolescent personality structure, in Q-data, checked in the high school personality questionnaire</article-title>. <source>Br J Psychol.</source> (<year>1970</year>) <volume>61</volume>:<fpage>39</fpage>&#x02013;<lpage>54</lpage>. <pub-id pub-id-type="doi">10.1111/j.2044-8295.1970.tb02800.x</pub-id><pub-id pub-id-type="pmid">5414909</pub-id></citation></ref>
<ref id="B90">
<label>90.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schuck</surname> <given-names>SZ</given-names></name> <name><surname>Dubeck</surname> <given-names>JA</given-names></name> <name><surname>Cymbalisty</surname> <given-names>BY</given-names></name> <name><surname>Green</surname> <given-names>C</given-names></name></person-group>. <article-title>Delinquency, personality tests and relationships to measures of guilt and adjustment</article-title>. <source>Psychol Rep.</source> (<year>1972</year>) <volume>31</volume>:<fpage>219</fpage>&#x02013;<lpage>26</lpage>.<pub-id pub-id-type="doi">10.2466/pr0.1972.31.1.219</pub-id><pub-id pub-id-type="pmid">5061614</pub-id></citation></ref>
<ref id="B91">
<label>91.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Saklofske</surname> <given-names>DH</given-names></name> <name><surname>Schulz</surname> <given-names>HW</given-names></name></person-group>. <article-title>Factor analysis of repeated state hostility and guilt measures: males</article-title>. <source>Psychol Rep.</source> (<year>1975</year>) <volume>37</volume>:<fpage>756</fpage>&#x02013;<lpage>8</lpage>. <pub-id pub-id-type="doi">10.2466/pr0.1975.37.3.756</pub-id><pub-id pub-id-type="pmid">1197553</pub-id></citation></ref>
<ref id="B92">
<label>92.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mathiesen</surname> <given-names>SG</given-names></name> <name><surname>Cash</surname> <given-names>SJ</given-names></name> <name><surname>Hudson</surname> <given-names>WW</given-names></name></person-group>. <article-title>The multidimensional adolescent assessment scale: a validation study</article-title>. <source>Res Soc Work Pract.</source> (<year>2002</year>) <volume>12</volume>:<fpage>9</fpage>&#x02013;<lpage>28</lpage>. <pub-id pub-id-type="doi">10.1177/104973150201200103</pub-id></citation></ref>
<ref id="B93">
<label>93.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chung</surname> <given-names>MS</given-names></name> <name><surname>Chiu</surname> <given-names>HJ</given-names></name> <name><surname>Sun</surname> <given-names>WJ</given-names></name> <name><surname>Lin</surname> <given-names>CN</given-names></name> <name><surname>Kuo</surname> <given-names>CC</given-names></name> <name><surname>Huang</surname> <given-names>WC</given-names></name> <etal/></person-group>. <article-title>A rapid screening test for depression in junior high school children</article-title>. <source>Chin Med J.</source> (<year>2011</year>) <volume>74</volume>:<fpage>363</fpage>&#x02013;<lpage>8</lpage>. <pub-id pub-id-type="doi">10.1016/j.jcma.2011.06.007</pub-id><pub-id pub-id-type="pmid">21872817</pub-id></citation></ref>
<ref id="B94">
<label>94.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Novin</surname> <given-names>S</given-names></name> <name><surname>Rieffe</surname> <given-names>C</given-names></name></person-group>. <article-title>Validation of the brief shame and guilt questionnaire for children</article-title>. <source>Pers Individ Differ.</source> (<year>2015</year>) <volume>85</volume>:<fpage>56</fpage>&#x02013;<lpage>9</lpage>. <pub-id pub-id-type="doi">10.1016/j.paid.2015.04.028</pub-id></citation></ref>
<ref id="B95">
<label>95.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tani</surname> <given-names>F</given-names></name> <name><surname>Grotto</surname> <given-names>RL</given-names></name> <name><surname>Ponti</surname> <given-names>L</given-names></name></person-group>. <article-title>A bidimensional instrument to assess the sense of guilt in childhood: the guilt feelings scale for children (GFS_C)</article-title>. <source>TPM.</source> (<year>2015</year>) <volume>22</volume>:<fpage>461</fpage>&#x02013;<lpage>76</lpage>. <pub-id pub-id-type="doi">10.4473/TPM22.4.2</pub-id></citation></ref>
<ref id="B96">
<label>96.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Tangney</surname> <given-names>JP</given-names></name></person-group>. <article-title>Shame and guilt</article-title>. In: <person-group person-group-type="editor"><name><surname>Costello</surname> <given-names>CG</given-names></name></person-group>, editor. <source>Symptoms of Depression</source> (<publisher-loc>Oxford</publisher-loc>: <publisher-name>John Wiley and Sons</publisher-name>. (<year>1993</year>). p. <fpage>161</fpage>&#x02013;<lpage>180</lpage>.</citation></ref>
<ref id="B97">
<label>97.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Niedenthal</surname> <given-names>PM</given-names></name> <name><surname>Tangney</surname> <given-names>JP</given-names></name> <name><surname>Gavanski</surname> <given-names>I</given-names></name></person-group>. <article-title>&#x0201C;If only I weren&#x00027;t&#x0201D; versus &#x0201C;If only I hadn&#x00027;t&#x0201D;: distinguishing shame and guilt in counterfactual thinking</article-title>. <source>J Pers Soc Psychol</source>. (<year>1994</year>) <volume>67</volume>:<fpage>585</fpage>. <pub-id pub-id-type="doi">10.1037/0022-3514.67.4.585</pub-id><pub-id pub-id-type="pmid">7965606</pub-id></citation></ref>
<ref id="B98">
<label>98.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Doris</surname> <given-names>J</given-names></name></person-group>. <article-title>Test-anxiety and blame-assignment in grade school children</article-title>. <source>J Abnorm Soc Psychol.</source> (<year>1957</year>) <volume>58</volume>:<fpage>181</fpage>.<pub-id pub-id-type="pmid">13640821</pub-id></citation></ref>
<ref id="B99">
<label>99.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Tangney</surname> <given-names>JP</given-names></name> <name><surname>Wagner</surname> <given-names>P</given-names></name> <name><surname>Gramzow</surname> <given-names>R</given-names></name></person-group>. <source>The Test of Self-Conscious Affect (TOSCA).</source> <publisher-loc>Fairfax, VA</publisher-loc>: <publisher-name>George Mason University</publisher-name> (<year>1989</year>).<pub-id pub-id-type="pmid">21743757</pub-id></citation></ref>
<ref id="B100">
<label>100.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tangney</surname> <given-names>JP</given-names></name></person-group>. <article-title>Moral affect: the good, the bad, and the ugly</article-title>. <source>J Pers Soc Psychol.</source> (<year>1991</year>) <volume>61</volume>:<fpage>598</fpage>&#x02013;<lpage>607</lpage>. <pub-id pub-id-type="doi">10.1037/0022-3514.61.4.598</pub-id><pub-id pub-id-type="pmid">1960652</pub-id></citation></ref>
<ref id="B101">
<label>101.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Tangney</surname> <given-names>JP</given-names></name> <name><surname>Dearing</surname> <given-names>RL</given-names></name></person-group>. <source>Shame and Guilt.</source> <publisher-loc>New York, NY</publisher-loc>: <publisher-name>The Guilford Press</publisher-name> (<year>2002</year>).</citation></ref>
<ref id="B102">
<label>102.</label>
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Tangney</surname> <given-names>JP</given-names></name> <name><surname>Stuewig</surname> <given-names>J</given-names></name> <name><surname>Mashek</surname> <given-names>DJ</given-names></name></person-group>. <article-title>What&#x00027;s moral about the self-conscious emotions?</article-title> In: <person-group person-group-type="editor"><name><surname>Tracy</surname> <given-names>JL</given-names></name> <name><surname>Robins</surname> <given-names>RW</given-names></name> <name><surname>Tangney</surname> <given-names>JP</given-names></name></person-group>, editors. <source>The Self-Conscious Emotions: Theory and Research</source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Guilford Press</publisher-name> (<year>2007</year>). p. <fpage>21</fpage>&#x02013;<lpage>37</lpage>.</citation></ref>
<ref id="B103">
<label>103.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wolf</surname> <given-names>ST</given-names></name> <name><surname>Cohen</surname> <given-names>TR</given-names></name> <name><surname>Panter</surname> <given-names>AT</given-names></name> <name><surname>Insko</surname> <given-names>CA</given-names></name></person-group>. <article-title>Shame proneness and guilt proneness: toward the further understanding of reactions to public and private transgressions</article-title>. <source>Self Identity.</source> (<year>2010</year>) <volume>9</volume>:<fpage>337</fpage>&#x02013;<lpage>62</lpage>. <pub-id pub-id-type="doi">10.1080/15298860903106843</pub-id></citation></ref>
<ref id="B104">
<label>104.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ausubel</surname> <given-names>DP</given-names></name></person-group>. <article-title>Relationships between shame and guilt in the socializing process</article-title>. <source>Psychol Rev.</source> (<year>1955</year>) <volume>62</volume>:<fpage>378</fpage>&#x02013;<lpage>90</lpage>. <pub-id pub-id-type="doi">10.1037/h0042534</pub-id><pub-id pub-id-type="pmid">13254977</pub-id></citation></ref>
<ref id="B105">
<label>105.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Smith</surname> <given-names>RH</given-names></name> <name><surname>Webster</surname> <given-names>JM</given-names></name> <name><surname>Parrott</surname> <given-names>WG</given-names></name> <name><surname>Eyre</surname> <given-names>HL</given-names></name></person-group>. <article-title>The role of public exposure in moral and nonmoral shame and guilt</article-title>. <source>J Pers Soc Psychol</source>. (<year>2002</year>) <volume>83</volume>:<fpage>138</fpage>&#x02013;<lpage>59</lpage>. <pub-id pub-id-type="doi">10.1037/0022-3514.83.1.138</pub-id><pub-id pub-id-type="pmid">12088123</pub-id></citation></ref>
<ref id="B106">
<label>106.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Basile</surname> <given-names>B</given-names></name> <name><surname>Mancini</surname> <given-names>F</given-names></name> <name><surname>Macaluso</surname> <given-names>E</given-names></name> <name><surname>Caltagirone</surname> <given-names>C</given-names></name> <name><surname>Frackowiak</surname> <given-names>RS</given-names></name> <name><surname>Bozzali</surname> <given-names>M</given-names></name></person-group>. <article-title>Deontological and altruistic guilt: evidence for distinct neurobiological substrates</article-title>. <source>Hum Brain Mapp.</source> (<year>2011</year>) <volume>32</volume>:<fpage>229</fpage>&#x02013;<lpage>39</lpage>. <pub-id pub-id-type="doi">10.1002/hbm.21009</pub-id><pub-id pub-id-type="pmid">20842749</pub-id></citation></ref>
<ref id="B107">
<label>107.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Colasante</surname> <given-names>T</given-names></name> <name><surname>Zuffian&#x000F2;</surname> <given-names>A</given-names></name> <name><surname>Haley</surname> <given-names>DW</given-names></name> <name><surname>Malti</surname> <given-names>T</given-names></name></person-group>. <article-title>Children&#x00027;s autonomic nervous system activity while transgressing: relations to guilt feelings and aggression</article-title>. <source>Dev Psychol</source>. (<year>2018</year>) <volume>54</volume>:<fpage>1621</fpage>&#x02013;<lpage>33</lpage>. <pub-id pub-id-type="doi">10.1037/dev0000500</pub-id><pub-id pub-id-type="pmid">30148391</pub-id></citation></ref>
<ref id="B108">
<label>108.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Colasante</surname> <given-names>T</given-names></name> <name><surname>Malti</surname> <given-names>T</given-names></name></person-group>. <article-title>Resting heart rate, guilt, and sympathy: a developmental psychophysiological study of physical aggression</article-title>. <source>Psychophysiol.</source> (<year>2017</year>) <volume>54</volume>:<fpage>1770</fpage>&#x02013;<lpage>81</lpage>. <pub-id pub-id-type="doi">10.1111/psyp.12915</pub-id><pub-id pub-id-type="pmid">28667677</pub-id></citation></ref>
</ref-list>
</back>
</article>