Skip to main content

ORIGINAL RESEARCH article

Front. Psychol., 05 January 2022
Sec. Positive Psychology
This article is part of the Research Topic Positive Psychological Assessments: Modern Approaches, Methodologies, Models and Guidelines View all 13 articles

The Work Gratitude Scale: Development and Evaluation of a Multidimensional Measure

  • 1College of Business, Bellevue University, Bellevue, NE, United States
  • 2Department of Industrial Engineering and Innovation Sciences, University of Eindhoven, Eindhoven, Netherlands
  • 3Optentia Research Unit, North-West University, Vanderbijlpark, South Africa
  • 4Department of Human Resource Management, University of Twente, Enschede, Netherlands
  • 5Department of Social Psychology, Institut für Psychologie, Goethe University, Frankfurt am Main, Germany
  • 6Waukee Community School District, Waukee, IA, United States

This study explores gratitude as a multidimensional and work-specific construct. Utilizing a sample of 625 employees from a variety of positions in a medium-sized school district in the United States, we developed and evaluated a new measure, namely the Work Gratitude Scale (WGS), which encompasses recognized conative (intentional), cognitive, affective, and social aspects of gratitude. A systematic, six-phased approach through structural equation modeling (SEM) was used to explore and confirm the factorial structure, internal consistency, measurement invariance, concurrent, convergent, and discriminant validity of the WGS. The results supported a 10-item measure with three dimensions: “grateful appraisals” (three items), “gratitude toward others” (four items), and “intentional attitude of gratitude” (three items). Thereafter, first-order, second-order, and bifactor confirmatory models were estimated and compared. Work gratitude was found to be best described by a second-order construct with three underlying first-order dimensions. Measurement invariance was supported in relation to gender. Concurrent validity was supported in relation to two existing dispositional gratitude scales, namely the Gratitude Questionnaire and the Gratitude, Resentment, and Appreciation Scale (GRAT). Convergent validity was supported in relation to the Core Self-Evaluations Scale (CSES) and the Psychological Capital Questionnaire. Discriminant validity was supported in relation to various demographic factors such as age, gender, occupation, and tenure. The findings support the WGS as a multidimensional measure that can be used in practice to measure overall work-related gratitude and to track the effectiveness of gratitude-related workplace interventions.

Introduction

As both a state and a psychological strength, gratitude has become one of the fundamental building blocks of positive psychology (van Zyl et al., 2021). Emmons (2004) defines gratitude as “a sense of thankfulness and joy in response to receiving a gift, whether the gift can be a tangible benefit from a specific other or a moment of peaceful bliss evoked by natural beauty” (p. 554). There are many recognized benefits of gratitude. For example, gratitude promotes health, wellbeing and life satisfaction (Dickens, 2017). Gratitude is also related to effective coping (Wood et al., 2007), development of social support, and reduction of stress and depression (Wood et al., 2008a). Additionally, gratitude leads to prosocial behaviors that can promote healthy, satisfying, and productive relationships and connections (Portocarrero et al., 2020).

To-date, with very few exceptions, much of the empirical gratitude research pertains to non-work domains (Emmons, 2004; Watkins, 2014). On the other hand, in the context of positive organizational behavior, Luthans et al. (2015) propose gratitude as an evidence-based positive psychological resource that is open to development and management in the workplace. Relatedly, Fehr et al. (2017) emphasize that “organizations are not simply extensions of everyday social interactions. Rather, the organizational context introduces a unique set of constraints and affordances that influence how individual employees feel, think, and act on a daily basis” (p. 361) and make a case for a multifaceted work gratitude model that incorporates several personal, situational, and organizational contingencies. It follows that work gratitude may also exhibit unique dimensionality that may necessitate the purposeful design and validation of dedicated measures. This study seeks to fill this gap, by developing a work-specific and multidimensional measure of gratitude.

Conceptualizations of Gratitude

Gratitude has been conceptualized and measured as a general, stable dispositional trait (Portocarrero et al., 2020) or an enduring virtue (Peterson and Seligman, 2004; Morgan et al., 2017). Seligman et al. (2005) conceptualize character strengths such as gratitude as “trait-like—an individual difference with demonstrable generality and stability” (p. 411). In other words, within this perspective, grateful people have a general tendency to experience thankfulness or appreciation more frequently, more intensely, for longer periods, and across a broader range of people and situations than their less grateful counterparts (McCullough et al., 2002). In the context of the workplace, Cain et al. (2019) conceptualize gratitude as a dispositional trait or an enduring “tendency to notice and be thankful for how various aspects of a job affect one’s life” (p. 441).

However, alternative, more malleable perspectives of gratitude also abound and are supported by abundant empirical evidence. Gratitude has been shown to involve several cognitive, affective, social, and situational factors (Wood et al., 2008b,2009). Research shows that gratitude varies with situations and events (Wood et al., 2008a). Gratitude can also change over time (Froh et al., 2010; Chopik et al., 2019). Importantly, gratitude is open to development through a variety of relatively simple and practical interventions (c.f., Dickens, 2017; Richter et al., 2021). Interestingly, recent studies utilizing functional neuromagnetic imaging (fMRI) provide tangible neuroimaging evidence that gratitude, previously thought to be a “hardwired” tendency, is indeed malleable and responsive to basic, short, well-recognized development interventions such as gratitude journaling (Karns et al., 2017). Thus, gratitude cannot be just a general, dispositional trait.

Within the malleable perspectives of gratitude, at least four views can be found: (a) affective/emotional, (b) cognitive/evaluative, (c) social/other-focused, and (d) conative/intentional. First, gratitude has been supported as a quick, intense, and constantly fluctuating emotional state, with substantial within-person variability (Emmons and Mishra, 2011; Spence et al., 2014). Second, gratitude can be viewed as a situation-specific cognition that involves positive appraisals of various aspects of a particular situation. For example, according to Emmons and Crumpler (2000), gratitude is the appreciation of an altruistic gift. This appreciation requires recognizing the gift, recognizing the goodness of the gift, recognizing the goodness of the giver, and recognizing the benefits of the gift that go beyond one’s social expectations of others (Watkins, 2014). In other words, the extent of gratitude one experiences is often dependent on a combination of perceptions and evaluations of the value of the gift to the recipient, the cost of the gift to the giver, and the benevolence (i.e., altruistic intentions) of the giver toward the recipient of the gift. This multifaceted cognitive perspective goes beyond both the enduring trait and the purely transient affective state conceptualizations of gratitude.

Third is the social/other-focused perspective. Conceptualizations of this perspective vary in the literature along several dimensions. As indicated in the opening definition, the object of gratitude may another person’s generosity, or it can be a less tangible “moment” of thankfulness or appreciation of a specific event, or of one’s blessings and fortune in general (Emmons, 2004). When the object of gratitude is another person’s actions, another social dimension of gratitude is whether it involves reciprocating the gift or benevolent act. Furthermore, if gratitude involves reciprocity, the next social dimension is whether reciprocity is directed toward the original giver or another recipient, often referred to as “paying it forward” or prosocial behaviors in general (c.f., Ma et al., 2017).

The fourth and final perspective is the conative/intentional view of gratitude. In this view, a distinction is made between reactive gratitude, in which a person may experience gratitude as a result of the benevolence of others or being overwhelmed by life’s abundant blessings, and a proactive attitude, which is more intentional in nature. Being proactively grateful entails consciously choosing to be grateful and intentionally finding ways to do so. Examples of intentional gratitude include purposefully counting one’s blessings, enjoying life’s simple pleasures, and stopping to smell the roses (Watkins et al., 2003). Indeed, the most recognized gratitude development interventions closely follow these purposeful and intentional practices (Seligman et al., 2005).

Importantly, the above four perspectives or views of gratitude can and do overlap. For example, cognitive appraisals and conative aspects of gratitude may be necessary to determine social reciprocity actions, and all views of gratitude are likely to produce positive emotions. Thus, an integrative and multidimensional perspective of gratitude is both necessary and more accurate than narrower definitions and conceptualizations (Morgan et al., 2017). Furthermore, synergistic integration of these four perspectives (affective, cognitive, social, and conative) has also been conceptually supported in the context of similar positive psychological resources, such as psychological capital (PsyCap), a higher order construct that includes hope, efficacy, resilience, and optimism (Youssef and Luthans, 2013; Youssef-Morgan and Luthans, 2013; Luthans and Youssef-Morgan, 2017).

Integrating this four-pronged conceptualization of gratitude, we define work gratitude as “the intentional choice to engage in positive appraisals and feelings of thankfulness and appreciation toward the characteristics, situations, and people currently present in one’s work context.” Specifically, this definition synthesizes the conative (intentional choice), cognitive (positive appraisals), affective (feelings), and social (people) aspects of gratitude. Further, it takes into consideration that gratitude is a situational and context-specific state, rather than just a general disposition.

Relevant Approaches for Measuring Work Gratitude

The most commonly used measures of general gratitude are the Gratitude Questionnaire (GQ6; McCullough et al., 2002) and the Gratitude, Resentment, and Appreciation Scale (GRAT; Watkins et al., 2003). The GQ6 is a six-item scale that measures dispositional gratitude. Although dispositional gratitude is conceptualized in terms of frequency, intensity, span, and density, this scale assesses dispositional gratitude as a unidimensional factor (McCullough et al., 2002).

The GRAT also measures dispositional gratitude (Watkins et al., 2003). However, this 44-item scale, or its 16-item short version (Thomas and Watkins, 2003; Diessner and Lewis, 2007), are both multidimensional. They measure trait gratitude along three dimensions: sense of abundance (lack of sense of deprivation), simple appreciation (appreciation for simple pleasures), and appreciation for others (social appreciation).

Gratitude has also been measured as an affective state (Spence et al., 2014). This five-item scale measures state gratitude as a unidimensional, discrete emotion. While Spence et al. (2014) study is work-related (linked gratitude to organizational citizenship behaviors), the scale they developed is an measure of state gratitude in general, not work gratitude. Gratitude has also been conceptualized and measured as a multidimensional moral virtue (Morgan et al., 2017), with dimensions somewhat consistent with earlier views.

Recent studies demonstrate the relevance of gratitude in the workplace, both conceptually and empirically (Spence et al., 2014; Luthans et al., 2015; Fehr et al., 2017; Cain et al., 2019). However, measures of gratitude as a work-specific construct are lacking. A notable exception is Cain et al.’s (2019) recently developed Gratitude at Work Scale, which measures gratitude as a dispositional trait along two dimensions: gratitude for supportive work environment, and gratitude for meaningful work. While these two dimensions are highly relevant, we believe that they do not encompass the full range of conative, cognitive, affective, and social aspects of gratitude. Importantly, conceptualizing and measuring work gratitude as a dispositional trait or enduring tendency contradicts the extensive literature supporting the efficacy of short and simple gratitude interventions in changing participants’ gratitude levels (including Study 3 of Cain et al., 2019), which point to the malleability and state-like nature of gratitude (Luthans et al., 2015). Because the scale focuses on gratitude as a dispositional trait, it does not cover the volitional or intentional aspects of gratitude. It simply asks participants to recount how often they are grateful for various aspects of the workplace (e.g., coworkers, supervisors, clients, salary and benefits, work-life balance, autonomy, accomplishments, and growth opportunities).

We draw from the PsyCap literature, where a multidimensional work-specific measure of a positive psychological construct was developed and validated. PsyCap is supported as a higher-order construct, with hope, efficacy, resilience, and optimism as lower-order constructs. The Psychological Capital Questionnaire (PCQ-24, Luthans et al., 2007) was developed by adapting items from dispositional measures of hope, efficacy, resilience, and optimism. The wording of each item was adapted in two distinct ways. First, because the original scales were designed to measure the trait counterparts of each resource, they were adapted by adding language that reflects the state-like, “here and now” timeframe typically experienced in the work context. This approach was also used by Snyder et al. (1996) in adapting the dispositional hope scale (Snyder et al., 1991) to create a state hope scale. Examples of language added include: “at the present time,” “currently,” and “right now.” Second, with the exception of efficacy, the original scales were designed to measure general, not context-specific psychological constructs. Thus, the words “work,” “at work,” or “as it pertains to my work” were added to each item to make it work-specific.

Subsequently, a shorter, 12-item version (PCQ-12) of the PCQ-24 was developed (Avey et al., 2011). The PCQ-12 became widely used, particularly in cross-cultural research due to the reduced cost and increased ease of translation. One of the most notable changes is that the PCQ-12 does not include any reverse-scored items. Research shows that reverse-scored and negatively worded items tend to form a separate factor and change the dimensionality of a construct (Tomas and Oliver, 1999). Also they tend to lower the reliability of multi-item scales by as much as 20% (Barnette, 2000). This problem is particularly prevalent in measures of positive constructs, because seemingly opposite positive and negative constructs may not necessarily be opposite ends of a single construct, but rather distinct constructs (Peterson and Chang, 2002; Merritt, 2012). These method effects are evident in investigations of a number of established scales (DiStephano and Motl, 2006; Salazar, 2015). Thus, there is an abundance of evidence against the use of reverse-scored or negatively worded items.

The PCQ-12 was further adapted to other contexts beyond the workplace, such as health PsyCap, relationships PsyCap, overall (life in general) PsyCap (Luthans et al., 2013), and academic PsyCap (Martínez et al., 2019, 2021). Adaptation to most contexts is relatively easy. It can be accomplished simply by replacing the word “work” with the desired context. Context adaptations were not found to compromise the validity, reliability, or dimensionality of the scale.

Based on the lessons learned from the development and adaptation of PsyCap measures, it follows that a plausible approach to developing, or at least generating an initial list of items for, a work gratitude scale (WGS) is to adapt the items in existing trait gratitude scales. This can be accomplished by adding wording to reflect (a) the “here and now” timeframe and (b) the “at work” context. Additionally, (c) the adapted items should be positively worded, rather than reverse-scored.

With this approach in mind, the purpose of this study was to develop, evaluate and validate a robust measure for work gratitude. Specifically, it aimed to explore the factorial structure, internal consistency, measurement invariance (gender), concurrent, convergent and discriminant validity of the WGS.

Materials and Methods

Research Approach

A cross-sectional survey-based research design was utilized to collect the data for this study.

Participants

A convenience sample of 625 participants volunteered to take part in the study. Participants held a variety of positions in a medium-sized school district in the United States. At the time of the study, the school district employed about 900 employees, all of whom were invited to participate. Table 1 provides a descriptive overview of the demographic characteristics of the sample.

TABLE 1
www.frontiersin.org

Table 1. Demographic characteristics of participants (N = 625).

Measures

The Work Gratitude Scale

The WGS was developed based on the approach employed by Luthans et al. (2007), by adapting existing trait measures of positive psychological constructs to the present, “here and now,” and “at work” context. We also consulted recommended assessment approaches to-date for state and context-specific gratitude (McCullough et al., 2002; Wood et al., 2008a; Watkins et al., 2003), and heeded advice regarding avoiding negatively worded (reverse-scored) items, particularly when measuring positive psychological constructs (Tomas and Oliver, 1999; Barnette, 2000; Peterson and Chang, 2002; Merritt, 2012).

The initial pool of items was drawn from the GQ-6 (6 items) and the GRAT short version (16 items), which yielded 22 items for further consideration. Seven items were reverse-scored (negatively worded) and thus excluded, reducing the number to 15 items. Two items of the GRAT could not be adapted to the work context (“oftentimes I have been overwhelmed at the beauty of nature” and “every Fall I really enjoy watching the leaves change colors”). Thus, 13 items were adapted and used on the survey. Before survey administration, the 13 items were reviewed by an expert panel of positive psychology scholars to assess face validity and for final fine-tuning. The full list of items is shown in Table 4 and discussed further in subsequent sections. Each item was rated on a seven-point Likert scale ranging from 1 (Strongly Disagree) to 7 (Strongly Agree). The final measure was comprised of 10 items (c.f., Appendix A).

TABLE 2
www.frontiersin.org

Table 2. Model fit statistics.

TABLE 3
www.frontiersin.org

Table 3. Model fit statistics for competing exploratory factorial models.

TABLE 4
www.frontiersin.org

Table 4. Exploratory factor analysis-factor loadings and variance.

Concurrent Validity Measures

The GQ6 was used to measure the frequency, intensity and density of dispositional gratitude (McCullough et al., 2002). The six item, self-report questionnaire assesses dispositional gratitude as a unidimensional factor and is rated on a seven-point Likert type scale ranging from 1 (“Strongly Disagree”) to 7 (“Strongly Agree”). A sample item is “I am grateful to a wide variety of people.” The GQ-6 has shown to be a reliable measure in various contexts with an average Cronbach of 0.81 across 58 samples (Card, 2019).

The GRAT was used to measure dispositional gratitude as a stable trait (Watkins et al., 2003). The 16-item GRAT short version (Thomas and Watkins, 2003; Diessner and Lewis, 2007) is a multidimensional measure that assesses three components of gratitude: sense of abundance [lack of sense of deprivation. e.g., “There never seems to be enough to go around and I never seem to get my share (r)”], simple appreciation (appreciation for simple pleasures, e.g., “Oftentimes I have been overwhelmed at the beauty of nature”), and appreciation for others (social appreciation; e.g., “I feel deeply appreciative for the things others have done for me in my life”) on a nine-point Likert scale ranging from 1 (“Strongly Disagree”) to 9 (“Strongly Agree”). A meta-analysis has shown that the GRAT is a reliable measure in various contexts with an average Cronbach of 0.92 across 5 samples (Card, 2019).

Convergent Validity Measures

The Core Self-Evaluations Scale (CSES) was used to measure participants overall perception of self (Judge et al., 2003). The 12-item scale is a higher-order construct that measures four established personality traits: self-esteem (“Overall, I am satisfied with myself”), generalized efficacy (e.g., “I am confident I get the success I deserve in life”), locus of control (“I determine what will happen in my life”), and neuroticism (“There are times when things look pretty bleak and hopeless to me”). The CSES measures these as a unidimensional construct. Each item is rated on a five-point Likert type scale ranging from 1 (“Strongly Disagree”) to 5 (“Strongly Agree”). The instrument has shown to have high levels on internal consistency with Cronbach Alphas greater than 0.80 and test-retest reliability of 0.81 (Gardner and Pierce, 2010).

The PCQ-12 was used to measure PsyCap (Avey et al., 2011). The 12-item scale measures a higher-order psychological capital construct that is comprised of four first order factors: hope (e.g., “Right now I see myself as being pretty successful at work”), efficacy (e.g., “I feel confident in representing my work area in meetings with management”), resilience (e.g., “I usually take stressful things at work in stride”), and optimism (e.g., “I always look on the bright side of things regarding my job”). Each item is rated on a six-point Likert type scale ranging from 1 (“Strongly Disagree”) to 7 (“Strongly Agree”). The questionnaire has shown to be a reliable measure with McDonalds Omega’s ranging from 0.72 to 0.90 on the various sub-scales (Rice et al., 2021).

Discriminant Validity Measures

Discriminant validity was assessed by relating the WGS to various demographic factors such as age (in years), gender, type of occupation, and tenure (in years).

Statistical Analyses

Data were analyzed using SPSS v26 (IBM SPSS, 2019), JASP v. 0.14.1 (JASP, 2021), and Mplus v 8.6 (Muthén and Muthén, 2021). A systematic, six-phased approach through structural equation modeling (SEM) was used to determine the factorial validity, internal consistency, measurement invariance with gender, concurrent, convergent and discriminant validity of the WGS.

First, to explore the factorial structure and item loadings of the WGS, an exploratory factor analytical (EFA) approach through SEM was employed. To determine the factorability of the instrument, the Kaiser-Meyer-Olkin (KMO) approach and Bartlett’s sphericity test were estimated. According to Kaiser and Rice (1974), both a KMO value larger than 0.60 and a significant chi-square on Bartlett’s sphericity assessment would indicate that meaningful factorial structures could be extracted from the data. Thereafter, a competing EFA modeling approach with the maximum likelihood estimation (ML) method, and a direct Oblimin rotation was used through the SEM framework. Here, competing exploratory factorial models were specified to be extracted from the data, based on Eigenvalues larger than 1 (Muthén and Muthén, 2021). Competing EFA models were compared based on model fit statistics with associated cut-off criteria (c.f., Table 2), items were required to load statistically significantly (factor loading > 0.40; p < 0.05) on their respective extracted factors, cumulatively all factors needed to declare at least 50% total variance, and items should not represent multiple factors. Dual loadings were systematically removed, and models were re-estimated (Wong and Wong, 2020).

Second, the factorial validity of the WGS was explored. Based on the best fitting EFA model, a competing confirmatory factor analytical measurement modeling strategy with the ML estimator was used to explore different, theoretically informed factorial permutations of the WGS. Both traditional independent cluster modeling confirmatory factor analytical (ICM-CFA) models and a bifactor model were estimated and sequentially compared. Observed items were used as indicators for latent factors. Observed indicators were only permitted to load onto their a priori theoretical factors and cross-loadings were not permitted. For the bifactor model, a single general factor (Work Gratitude) and three specific factors (“grateful appraisals,” “gratitude toward others,” and “intentional attitude of gratitude”) were specified. All items were estimated to load on the general factor. For the specific factors, items were targeted to load onto their a priori factors. Here an orthogonal targeted rotation was used, and all covariances between specific factors were constrained to zero. To determine the best fitting model for the data, both the Hu and Bentler’s (1999) criteria for model fit indices (c.f., Table 2 for the criteria) as well as indicators of measurement quality were employed. Measurement quality for the best fitting measurement models was assessed through evaluating the standardized factor loadings (λ > 0.40; p < 0.05), item uniqueness (>0.1 but <0.9; p < 0.05), and the presence of no multiple cross-loadings (Kline, 2010). Models that showed both excellent fit and measurement quality were retained for further analyses (McNeish et al., 2018).

Third, for the best fitting traditional ICM-CFA measurement models, item-level descriptive statistics (means, standard deviations, skewness, and kurtosis), standardized factor loadings, corrected item-total correlations (CITC), average variance extracted (AVE), and levels of internal consistency were estimated. To determine the multivariate normality of each item, Kim (2013) suggested that absolute values for skewness (<2) and kurtosis (<2) be employed for samples larger than 500. CITC represents each individual item’s relationship to the overall factor on which it loads (Zijlmans et al., 2019). A CITC lower than r = 0.30 indicates that a specific item might not accurately represent the overall factor on which it is specified (Zijlmans et al., 2019). To determine the level of internal consistency of the WGS, three indicators were computed: point-estimate composite reliability (upper-bound; ρ > 0.80; Raykov, 2009), McDonald’s Omega (ω > 0.80; Hayes and Coutts, 2020), and Cronbach’s alpha (lower-bound; α > 0.70; Nunnally and Bernstein, 1994). Further, AVE was used as an indicator of the average level of reliability of each item within the scale. Here, levels of 50% or higher are deemed acceptable (Kline, 2010).

Additionally, for the bifactor model, the explained common variance (ECV), the item level explained common variance (IECV), the Average Relative Parameter Bias (ARPB), as well as Omegas for the specific factor (ωspecific > 0.80) and Omegahhierarchical > 0.80) for the general factor as indicators of reliability were computed. ECV refers to the proportion of total common variance explained by a general factor within bifactor models (Stucky and Edelen, 2015). For the specific factors, ECV represents the strength of the factor relative to all the explained variance within each specific factor. An ECV value for the general factor should exceed 0.50 (Stucky et al., 2013). Similarly, the IECV refers to “the extent to which an item’s responses are accounted for by variation on the latent general dimension alone, and thus acts as an assessment of unidimensionality at the individual item level” (Stucky et al., 2013, p. 51) which should also exceed 0.50. ARPB represents an indicator of item bias within bifactor models. Here an ARPB value of less than 0.15 (i.e., 15%) is acceptable and therefore “poses no serious concern” (Rodriguez et al., 2016).

Fourth, we also investigated the factor equivalence or “measurement invariance” for gender (males vs. females). Here, increasingly restrictive equality constraints were placed on the best fitting measurement models. Configural (similar factor structures), metric (similar factor loadings) and scalar (similar intercepts) invariance models were estimated and sequentially compared. Invariance was established when the following criteria are met: (a) a non-significant difference in χ2 between increasingly restrictive models, and (b) non-significant changes in RMSEA (Δ < 0.015), SRMR (Δ < 0.015), CFI (<0.01), TLI (<0.01), and χ2/df (<1) between increasingly constrained models (Cheung and Rensvold, 2002; Reise et al., 2013). Once invariance was established, we proceeded to estimate latent mean differences between males and females. Here, the latent mean score for the reference group (males) was constrained to zero. The mean score for the female group was then freely estimated. If the latent mean score differed significantly (p < 0.05) from zero, it would indicate meaningful differences between genders (Wickrama et al., 2016; Wong and Wong, 2020).

Fifth, to establish convergent validity, the best fitting models of the WGS were then entered into a measurement model with both the GQ6 and the GRAT scales. The measurement models needed to fit the data based on the criteria in Table 3, as well as produce a statistically significant (p < 0.05) standardized correlation between WGS and the GQ6 and GRAT scales (Kline, 2010).

Finally, to investigate concurrent validity and discriminant validity, structural models were used. Here two separate structural models were estimated for the ICM-CFA and bifactor models. For concurrent validity, the WGS (as an exogenous factor) was regressed on the CSES and the PCQ-12 (as endogenous factors). We established discriminant validity within the same structural model by estimating correlations between the WGS and predefined demographic factors (gender, age, occupation, and tenure). For the bifactor model, a similar approach was employed, however, both the general factor as well as the three specific factors were estimated to be related to the endogenous factors and correlated with the demographic factors. A significance level of p < 0.05 (95% confidence interval) was set for each regressive path and correlation.

Results

Exploratory Factor Analysis

An EFA approach was employed to explore the factorial structure of the WGS. First, the KMO measure and Bartlett’s test for sphericity were used to determine the factorability of the instrument. Results showed that meaningful factors could be extracted from the data because the KMO value was larger than 0.60 (KMO = 0.93) and a significant chi-square [χ2(625) = 5996.35, df = 78, p < 0.01] was produced. We therefore proceeded to estimate the EFA models in Mplus.

Initially five factorial models were specified to be extracted from the data. Results showed that three factors could be extracted with eigenvalues larger than 1. Further, only three of the five models converged. Therefore, only the one, two, and three factorial models could be inspected (c.f., Table 3). EFA Model 0, a single first order factorial model2(615) = 1365.22; p < 0.01; df = 65; χ2/df = 21.00; CFI = 0.78; TLI = 0.74; RMSEA = 0.18 [0.172, 0.189], p < 0.01; SRMR = 0.09; AIC = 19147.92; BIC = 19320.36; Eigenvalue = 7.57; R2 = 58.23%] did not fit the data and was therefore rejected. EFA Model 1, a two first order factorial model2(615) = 744.814; p < 0.01; df = 53; χ2/df = 14.05; CFI = 0.88; TLI = 0.83; RMSEA = 0.15 [0.137, 0.155], p < 0.01; SRMR = 0.06; AIC = 18551.50; BIC = 18777.01; Eigenvalue Factor 1 = 7.57; R2 = 58.23%; Eigenvalue Factor 2 = 1.25; R2 = 11.67%], also did not fit the model fit criteria, and was also rejected. Only EFA Model 2, the three first order factorial model2(615) = 188.79; p < 0.01; df = 42; χ2/df = 4.95; CFI = 0.98; TLI = 0.95; RMSEA = 0.08 [0.065, 0.086], p < 0.01; SRMR = 0.02; AIC = 18017.48; BIC = 18291.62; Eigenvalue Factor 1 = 7.57; R2 = 58.23%; Eigenvalue Factor 2 = 1.25; R2 = 11.67%; Eigenvalue Factor 3 = 1.02; R2 = 7.82%], fitted the data the best.

The three-factor EFA Model 3 also showed to fit the data significantly better than the one and two first-order factorial models. The item loadings and declared variance for this model are presented in Table 4. The results showed that three items (WGS3, WGS4, and WGS13) needed to be removed due to dual loadings, and therefore the three-factor model was respecified to produce new fit statistics. EFA Model 3, the three first order factorial model with the three items removed2(615) = 23.45; p > 0.01; df = 18; χ2/df = 1.30; CFI = 1.00; TLI = 1.00; RMSEA = 0.02 [0.000, 0.045], p > 0.01; SRMR = 0.01; AIC = 14260.60; BIC = 14468.57] fitted the data the best. Table 4 shows that all the items loaded significantly on their respective factors, with factor loadings exceeding the 0.40 threshold. The first factor was labeled “grateful appraisals,” the second factor “gratitude toward others,” and the third factor “intentional attitude of gratitude.” The Oblimin factorial correlation showed that all factors were strongly correlated (with a range of r between 0.59 and 0.66; p < 0.01).

Competing Confirmatory Factor Analytical Measurement Models

Next, a theoretically informed competing measurement modeling strategy was employed to further explore the factorial validity of the WGS. Measured items were used as indicators for latent factors, no items were removed, and error terms were not permitted to correlate. Four measurement models were estimated and compared:

Model 1: A single first-order factorial model was specified where all 10 items loaded directly on to a single factor called “Work Gratitude.”

Model 2: A three first-order correlated factor model was estimated for the factors labeled “grateful appraisals” (comprised of three items: SWGS1, SWGS2, and SWGS6), “gratitude toward others” (comprised of four items: SWGS5, SWGS7, SWGS8, and SWGS12), and “intentional attitude of gratitude” (comprised of three items: SWGS9, SWGS10, and SWGS11).

Model 3: A second-order factorial model comprised of the three first-order factors specified in the previous model was specified to directly load onto an overall “Work Gratitude” factor.

Model 4: A bifactor model with one general Work Gratitude factor (on which all 10 items directly loaded) and three specific first-order factors (as mentioned in Model 2) was estimated.

The results, summarized in Table 5, showed that Models 2, 3, and 4 fitted the data best. Models 2 and 3 produced the same fit statistics [χ2(625) = 133.21; df = 32; χ2/df = 4.16; CFI = 0.98; TLI = 0.97; RMSEA = 0.07 [0.059, 0.084]; SRMR = 0.07]. This is expected if the three factors fully represent a second-order factorial model. Further, the bifactor model, Model 4, fitted the data significantly better than the second-order factor model, Model 2 (Δχ2 = −86.26; Δdf = −7; χ2/df = −2.28; ΔCFI = 0.02; ΔTLI = 0.03; ΔRMSEA = −0.03; ΔSRMR = −0.02; ΔAIC = −72.26; ΔBIC = −41.29). Both models further fitted the data significantly better than Model 1. Therefore, only Model 3 and 4 was retained for further inspection and analysis.

TABLE 5
www.frontiersin.org

Table 5. Competing confirmatory factor analytical models.

Item Level Descriptive Statistics, Standardized Factor Loadings, and Internal Consistencies

As shown in Table 6, all items were normally distributed (skewness and kurtosis <2; Kim, 2013). Each item was clearly associated with the overall factor being assessed (CITC r > 0.30; Zijlmans et al., 2019), and each of the three sub-factors and overall work gratitude was reliable at both the upper- (ρ > 0.80; ω > 0.80) and lower- bound level of internal consistency (α > 0.70). For the bifactor model, both the Omega for the specific factors and the Hierarchical Omega for the general factor were higher than 0.80.

TABLE 6
www.frontiersin.org

Table 6. Item level descriptive statistics, factor loadings and internal consistencies of the second-order factorial and bifactor models.

For the second-order factorial model, Model 3, all items in each subscale loaded statistically significantly onto their respective a priori factors with standardized factor loadings ranging 0.74 to 0.93 (λ > 0.40; p < 0.01; Kline, 2010). Further, the AVE for both factors (and the overall Work Gratitude factor) was higher than the suggested 0.50 cutoff point (Kline, 2010). Further, all three first-order factors, grateful appraisals (λ = 0.82, SE = 0.02, p < 0.01), gratitude toward others (λ = 0.79, SE = 0.03, p < 0.01) and intentional attitude of gratitude (λ = 0.86, SE = 0.03, p < 0.01) loaded statistically significantly onto the second-order Work Gratitude factor.

For the bifactor factorial Model 4, similar trends were observed. All items loaded statistically significantly onto both the general and specific factors with standardized factor loadings ranging from 0.40 to 0.81 (λ > 0.40; p < 0.01; Kline, 2010). Additionally, the IECV for all items exceeded the 0.50 threshold (Stucky et al., 2013). Further, the ARPB was below 15% on each item, therefore, no item-related bias was evident (Rodriguez et al., 2016). The ECV for the general factor was larger than the suggested 0.50 threshold, however, those for the specific factors ranged from 0.31 to 0.36. This implies that the general factor for the WGS is more representative of overall Work Gratitude, than the individual factors. This lower level of ECV is still acceptable, given that the threshold for the General Factor exceeds the limits.

Therefore, both models showed excellent levels of measurement quality and were therefore retained for further analysis.

Measurement Invariance and Mean Comparisons

Next, the factorial equivalence of both Model 3 and Model 4 was tested with respect to males vs. females. The results, summarized in Table 7, showed that all models fitted the data based on the criteria described in Table 3. Further, no statistically significant differences in χ2 as well as RMSEA (Δ < 0.015), SRMR (Δ < 0.015), CFI (< 0.01), TLI (<0.01), and χ2/df (<1) between the configural, metric, scalar, and strict invariance models could be established (Cheung and Rensvold, 2002; Wong and Wong, 2020). Therefore, both models showed to be invariant between genders and meaningful mean comparisons can be made.

TABLE 7
www.frontiersin.org

Table 7. Measurement invariance for gender.

For Model 3’s first-order factors, the results showed that no differences between males and females could be found for grateful appraisals (Δ x̄ = −0.02; SE = 0.12; p = 0.87), gratitude toward others (Δ x̄ = 0.08; SE = 0.13; p = 0.50) or intentional attitude of gratitude (Δ x̄ = 0.18; SE = 0.12; p = 0.12). No mean differences for overall Work Gratitude between males and females could be established (Δ x̄ = 0.09; SE = 0.12; p = 0.44).

Similar results were present for the Bifactor Model 4. No mean differences between males and females could be found on the three specific factors: grateful appraisals (Δ x̄ = −0.19; SE = 0.28; p = 0.48), gratitude toward others (Δ x̄ = 0.02; SE = 0.19; p = 0.93) or intentional attitude of gratitude (Δ x̄ = 0.17; SE = 0.22; p = 0.44). No mean differences between genders on the general Work Gratitude could be established (Δ x̄ = 0.11; SE = 0.17; p = 0.53).

Convergent Validity With the Trait Gratitude Scales (GQ6 and Gratitude, Resentment, and Appreciation Scale)

To establish convergent validity, the two best fitting factorial models of the WGS were entered into a measurement model with two closely associated other measures of gratitude. The GQ6 was estimated as a unidimensional factor, with all items loading directly onto an overall dispositional gratitude factor. Further, the GRAT scale was estimated as a multidimensional factor comprised of three first order factors namely simple appreciation. appreciation for others and lack of a sense of deprivation. All items were specified to load onto their prior theoretical factorial models.

The results in Table 8 showed that for the second-order factorial Model 3 and the two trait gratitude scales, the data fitted the model adequately [χ2(601) = 1195.659; df = 452; χ2/df = 2.65; CFI = 0.90; TLI = 0.90; RMSEA = 0.05 [0.049, 0.056]; SRMR = 0.07]. Both gratitude factors were strongly (r > 0.50) and statistically significantly (p < 0.05) related to the WGS.

TABLE 8
www.frontiersin.org

Table 8. Convergent validity with the GQ6 and GRAT.

For the bifactor Model 4 including the two trait gratitude scales, the data also fitted the model adequately [χ2(601) = 1118.47; df = 440; χ2/df = 2.54; CFI = 0.91; TLI = 0.90; RMSEA = 0.05 [0.047, 0.054]; SRMR = 0.07]. The results showed that the general Work Gratitude factor was significantly related to both the GRAT (r = 0.57; p < 0.05) and the GQ6 (r = 0.34; p < 0.05). All the specific factors, excluding gratitude toward others (r = −0.11; p = 0.08), related statistically significantly to GQ6 and GRAT. However, these relationships ranged from small to marginal. The results imply that the second order factorial model seems to be better associated with the trait gratitude scales than the bifactor model.

Concurrent and Discriminant Validity

To establish concurrent and discriminant validity, separate structural models were estimated for the second-order Model 3 and the bifactor Model 4, and CSES and PCQ-12. For concurrent validity, CSES was specified as a unidimensional construct, where all items loaded directly onto a single factor. PCQ-12 was specified as second-order factorial model comprised of four specific factors (hope, efficacy, resilience, and optimism). In both models, demographic factors were used to establish discriminant validity. For concurrent validity, the WGS was regressed on both CSES and the second order PsyCap factor. For discriminant validity, the demographic factors were specified to correlate with the WGS.

The results in Table 9 showed that the second-order factorial Model 3, with demographic factors, CSES and PCQ-12, fitted the data adequately [χ2(607) = 1722.41; df = 652; χ2/df = 2.64; CFI = 0.90; TLI = 0.90; RMSEA = 0.05 [0.049, 0.055]; SRMR = 0.06]. The results showed that none of the demographic factors related significantly to Work Gratitude (p > 0.05). Further, Work Gratitude was positively and significantly related to CSES (β = 0.38; SE = 0.05; p < 0.05; R2 = 0.15) and PCQ-12 (β = 0.61; SE = 0.04; p < 0.05; R2 = 0.37). Both concurrent and discriminant validity could therefore be established for the second order factorial Model.

TABLE 9
www.frontiersin.org

Table 9. Concurrent and discriminant validity.

For the Bifactor Model 4, with demographic factors, CSES and PCQ-12, the results showed that the model fitted the data adequately [χ2(607) = 1358.03; df = 614; χ2/df = 2.22; CFI = 0.91; TLI = 0.90; RMSEA = 0.05 [0.041, 0.058]; SRMR = 0.05]. The results showed that most of the demographic variables were not associated with neither the general nor the specific factors of the WGS, with three exceptions. Age (r = 0.24, p < 0.05) and tenure (r = 0.18, p < 0.05) were significantly related to intentional attitude of gratitude. Occupation was related to gratitude toward others (r = −0.16, p < 0.05). Therefore, discriminant validity could not be established. However, concurrent validity for the bifactor Model 4 was established as all specific and general factors related positively and significantly to CSES and PCQ-12 (p < 0.05).

Therefore, the results show that only the second-order factorial model was supported to be both concurrently and discriminately valid.

Discussion

Despite its numerous recognized benefits, to-date there are limited applications of gratitude in the workplace. Furthermore, current gratitude measures pose a number of challenges that hamper effective measurement of gratitude at work. This study sought to fill this gap by developing and evaluating a WGS. Integrating the extant gratitude literature, we defined work gratitude as “the intentional choice to engage in positive appraisals and feelings of thankfulness and appreciation toward the characteristics, situations, and people currently present in one’s work context.” We used a systematic, six-phased approach to determine the factorial validity, internal consistency, measurement invariance, concurrent, convergent and discriminant validity of the WGS. Furthermore, we compared first-order, second-order, and bifactor competing models for Work Gratitude.

The results supported a 10-item measure for a second-order factorial model of work gratitude comprised of three dimensions: “grateful appraisals” (three items), “gratitude toward others” (four items), and “intentional attitude of gratitude” (three items). This second-order factorial model showed significantly better model fit, measurement quality, internal consistency, measurement invariance in relation to gender, concurrent validity in relation to two existing dispositional gratitude scales (GQ-6; McCullough et al., 2002, and GRAT; Thomas and Watkins, 2003; Watkins et al., 2003), convergent validity in relation to core self-evaluations (Judge et al., 2003) and PsyCap (Luthans et al., 2007; Avey et al., 2011), and discriminant validity in relation to demographic factors (age, gender, occupation and tenure) than other a priori factorial permutations.

This study, therefore, supports work gratitude as a second-order construct with three underlying first-order dimensions. From this perspective, work gratitude is operationalized and measured as a function of (a) grateful appraisals of work (i.e., positive, cognitive appraisals of work characteristics and situations), (b) gratitude toward others at work (i.e., social appreciation toward the contributions of others at one’s work), and (c) an intentional attitude of gratitude (i.e., purposefully enumerating, enjoying, and being mindful of positive aspects of one’s work). The results showed that this multidimensional conceptualization of work gratitude is related to, yet empirically distinct from other existing gratitude measures. In line with the findings of Cain et al. (2019), this means that employees who are generally inclined to show gratitude toward others may or may not necessarily show feelings of gratitude at work, and those experiences of gratitude at work may not necessarily extend to other life domains. Thus, work gratitude is related to, but conceptually distinct from gratitude in other life domains, or gratitude in general.

This multidimensional measurement strategy is closely aligned with the gratitude literature (Watkins et al., 2003; Morgan et al., 2017), as well as the positive organizational literature (Youssef and Luthans, 2013; Youssef-Morgan and Luthans, 2013; Luthans and Youssef-Morgan, 2017). This three-dimensional self-other-environment characterization of gratitude is also consistent with established psychological frameworks such as social cognitive theory, where agentic actions occur at the intersection of self-reflection, observation and learning from others, and influencing while being simultaneously influenced by one’s environment (Bandura, 2001, 2012; Bandura and Locke, 2003).

Specifically, gratitude is not just a unidimensional, deterministic dispositional trait (McCullough et al., 2002), or a transient, momentary affective state (Spence et al., 2014). It involves intentional, cognitive, affective, social mechanisms through which one reflects upon, evaluates, and appreciates various aspects of a specific context, such as meaningful and enjoyable work experiences, as well as the contributions of leaders, mentors, and colleagues at work (Luthans et al., 2015). The agentic and intentional components of gratitude are essential. Here, an employee purposefully chooses to be mindful of these various positive aspects of work and react to them positively and gratefully, rather than taking them for granted. Lyubomirsky (2007) posits that about 50% of positivity is trait-based, and circumstances determine only 10%, but 40% is open to growth and development through one’s intentional choices, thoughts and actions. This malleability and intentionality of gratitude is particularly relevant in the work context. For example, widely recognized gratitude development interventions (Davis et al., 2016) can be beneficial and effective if applied in the workplace to promote well-being, prosocial behaviors, and other desirable work outcomes. With the contribution of the current study, employee levels of work gratitude can be regularly assessed, monitored, and targeted for short and effective training interventions to promote grateful appraisals, gratitude toward others, and intentional attitudes of gratitude in employees.

Strengths and Limitations

Among the notable strengths of this study are sample size and the availability and utilization of highly relevant constructs with valid and reliable measures (GQ-6, GRAT, CSES, and PCQ-12) to facilitate item generation and assess the concurrent, convergent, and discriminant validity of the WGS. Another strength is the rigorous and systematic testing of competing models and the highly consistent results supporting the two-factor model.

An important limitation of this study is that the sample was drawn from an educational environment, namely a medium-sized school district in the United States. This may limit the generalizability of the findings to other contexts. More effort should be taken by future researchers to investigate the factorial structure of the instrument in other work-related contexts. Furthermore, the majority of participants were young, female, teachers, with short tenure, which limits the external validity of the findings. However, the positions of the participants still varied widely, resembling a wide range of jobs in other industries and professions. Males, older, and longer tenured participants were adequately represented. Measurement invariance was supported for gender, and there was sufficient variation in gender, age, tenure and occupation to support discriminant validity.

Another limitation is that this study did not test for predictive or incremental validity of the WGS. Future studies can utilize the WGS to predict meaningful work attitudes, behaviors, performance, and other important work outcomes. They can also incorporate established predictors of such outcomes to assess the incremental validity of the WGS.

Future Directions

Future research should examine the WGS in a wide range of work contexts such as manufacturing, services, and non-profit organizations of varying sizes to establish external validity. Furthermore, gratitude and other character strengths and virtues (Peterson and Seligman, 2004) are perceived and expressed differently across cultures. Thus, the WGS should be examined in other countries and cultures beyond the United States.

The availability of a valid and reliable measure of work gratitude is an important step in expanding the gratitude literature and research to the work context, linking it to strategic workplace initiatives such as human resource selection and development, and utilizing it to promote desirable work outcomes such as employee productivity, wellbeing, and prosocial behaviors. In terms of practical implications, there are many recognized and easy-to-implement gratitude interventions, which can be readily implemented in the workplace. Developing gratitude can yield highly desirable prosocial behaviors (Ma et al., 2017), which can promote employee wellbeing and a positive organizational culture.

Finally, the development of a context-specific measure of gratitude is an important step in operationalizing, measuring, and developing gratitude in other important life domains. Specifically, the WGS can be easily adapted to other contexts, by replacing the word “work” with other contexts of interest. This approach is similar to adaptations of the PCQ-12 to measure PsyCap in a variety of contexts (e.g., academic PsyCap, Martínez et al., 2019, 2021; relationship and health PsyCap, Luthans et al., 2013). Future research should rigorously examine and evaluate the psychometric characteristics of such adaptations of the WGS, but the availability of a context-specific measure of gratitude offers a valuable starting point.

Data Availability Statement

The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author.

Ethics Statement

The studies involving human participants were reviewed and approved by the Western IRB. The patients/participants provided their written informed consent to participate in this study.

Author Contributions

CY-M was primarily responsible for the conceptual framework of the manuscript, as well as leading and integrating the work of the research team. LZ was primarily responsible for the data analysis. BA was primarily responsible for the data collection. All authors contributed to the article and approved the submitted version.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

Avey, J. B., Avolio, B. J., and Luthans, F. (2011). Experimentally analyzing the impact of leader positivity on follower positivity and performance. Leadersh. Q. 22, 282–294.

Google Scholar

Bandura, A. (2001). Social cognitive theory: an agentic perspective. Annu. Rev. Psychol. 52, 1–26.

Google Scholar

Bandura, A. (2012). On the functional properties of perceived self-efficacy revisited. J. Manag. 38, 9–44.

Google Scholar

Bandura, A., and Locke, E. (2003). Negative self-efficacy and goal effects revisited. J. Appl. Psychol. 88, 87–99. doi: 10.1037/0021-9010.88.1.87

PubMed Abstract | CrossRef Full Text | Google Scholar

Barnette, J. J. (2000). Effects of stem and Likert response option reversals on survey internal consistency: if you feel the need, there is a better alternative to using those negatively worded stems. Educ. Psychol. Measur. 60, 361–370.

Google Scholar

Cain, I. H., Cairo, A., Duffy, M., Meli, L., Rye, M. S., and Worthington, E. L. Jr. (2019). Measuring gratitude at work. J. Posit. Psychol. 14, 440–451.

Google Scholar

Card, N. A. (2019). Meta-analyses of the reliabilities of four measures of gratitude. J. Posit. Psychol. 14, 576–586.

Google Scholar

Cheung, G. W., and Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Struct. Equ. Model. 9, 233–255.

Google Scholar

Chopik, W. J., Newton, N. J., Ryan, L. H., Kashdan, T. B., and Jarden, A. J. (2019). Gratitude across the life span: age differences and links to subjective well-being. J. Posit. Psychol. 14, 292–302. doi: 10.1080/17439760.2017.1414296

PubMed Abstract | CrossRef Full Text | Google Scholar

Davis, D. E., Choe, E., Meyers, J., Wade, N., Varjas, K., Gifford, A., et al. (2016). Thankful for the little things: a meta-analysis of gratitude interventions. J. Counsel. Psychol. 63, 21–31. doi: 10.1037/cou0000107

PubMed Abstract | CrossRef Full Text | Google Scholar

Dickens, L. R. (2017). Using gratitude to promote positive change: a series of meta-analyses investigating the effectiveness of gratitude interventions. Basic Appl. Soc. Psychol. 39, 193–208. doi: 10.1080/01973533.2017.1323638

CrossRef Full Text | Google Scholar

Diessner, R., and Lewis, G. (2007). Further validation of the gratitude, resentment, and appreciation test (GRAT). J. Soc. Psychol. 147, 445–447. doi: 10.3200/socp.147.4.445-448

PubMed Abstract | CrossRef Full Text | Google Scholar

DiStephano, C., and Motl, R. W. (2006). Further investigating method effects associated with negatively worded items on self-report surveys. Struct. Equ. Model. 13, 440–464.

Google Scholar

Emmons, R. A. (2004). “Gratitude,” in Character Strengths and Virtues: A Handbook and Classification, eds C. Peterson and M. Seligman (Oxford: Oxford University Press), 553–568.

Google Scholar

Emmons, R. A., and Crumpler, C. A. (2000). Gratitude as a human strength: appraising the evidence. J. Soc. Clin. Psychol. 19, 56–69. doi: 10.1017/S1041610220000964

PubMed Abstract | CrossRef Full Text | Google Scholar

Emmons, R. A., and Mishra, A. (2011). “Why gratitude enhances well-being: what we know, what we need to know,” in Designing Positive Psychology: Taking Stock and Moving Forward, eds K. M. Sheldon, T. B. Kashdan, and M. F. Steger (New York, NY: Oxford University Press), 248–262.

Google Scholar

Fehr, R., Fulmer, A., Awtrey, E., and Miller, J. A. (2017). The grateful workplace: a multilevel model of gratitude in organizations. Acad. Manag. Rev. 42, 361–381. doi: 10.5465/amr.2014.0374

CrossRef Full Text | Google Scholar

Froh, J. J., Bono, G., and Emmons, R. (2010). Being grateful is beyond good manners: gratitude and motivation to contribute to society among early adolescents. Motiv. Emot. 34, 144–157.

Google Scholar

Gardner, D. G., and Pierce, J. L. (2010). The core self-evaluation scale: further construct validation evidence. Educ. Psychol. Measur. 70, 291–304.

Google Scholar

Hayes, A. F., and Coutts, J. J. (2020). Use omega rather than Cronbach’s alpha for estimating reliability. But…. Commun. Methods Measur. 14, 1–24. doi: 10.1080/19312458.2020.1718629

CrossRef Full Text | Google Scholar

Hu, L., and Bentler, P. M. (1999). Cut-off criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct. Equ. Model. 6, 1–55. doi: 10.1080/10705519909540118

CrossRef Full Text | Google Scholar

IBM SPSS (2019). IBM SPSS Software Version 26. Indianapolis, Ind: IBM Press.

Google Scholar

JASP (2021). Jeffery’s Amazing Stats Program (v.0.14.1). [Statistical Software]. Available online at: https://jasp-stats.org

Google Scholar

Judge, T. A., Erez, A., Bono, J. E., and Thoresen, C. J. (2003). The core self-evaluations scale (CSES): development of a measure. Pers. Psychol. 56, 303–331. doi: 10.1111/j.1744-6570.2003.tb00152.x

CrossRef Full Text | Google Scholar

Kaiser, H. F., and Rice, J. (1974). Little Jiffy, Mark IV. Educ. Psychol. Measur. 34, 111–117.

Google Scholar

Karns, C. M., Moore, W. E., and Mayr, U. (2017). The cultivation of pure altruism via gratitude: a functional MRI study of change with gratitude practice. Front. Hum. Neurosci. 11:599. doi: 10.3389/fnhum.2017.00599

PubMed Abstract | CrossRef Full Text | Google Scholar

Kim, H. Y. (2013). Statistical notes for clinical researchers: assessing normal distribution (2) using skewness and kurtosis. Restor. Dent. Endodont. 38, 52–54. doi: 10.5395/rde.2013.38.1.52

PubMed Abstract | CrossRef Full Text | Google Scholar

Kline, R. B. (2010). Principles and Practices of Structural Equation Modelling, 3rd Edn, New York, NY: Gilford Press.

Google Scholar

Luthans, F., Avolio, B. J., Avey, J. B., and Norman, S. M. (2007). Positive psychological capital: measurement and relationship with performance and satisfaction. Pers. Psychol. 60, 541–572.

Google Scholar

Luthans, F., Youssef, C. M., Sweetman, D. S., and Harms, P. D. (2013). Meeting the leadership challenge of employee well-being through relationship PsyCap and health PsyCap. J. Leadersh. Organ. Stud. 20, 118–133.

Google Scholar

Luthans, F., and Youssef-Morgan, C. M. (2017). Psychological capital: an evidence-based positive approach. Annu. Rev. Organ. Psychol. Organ. Behav. 4, 339–366. doi: 10.1146/annurev-orgpsych-032516-113324

CrossRef Full Text | Google Scholar

Luthans, F., Youssef-Morgan, C. M., and Avolio, B. (2015). Psychological Capital and Beyond. New York, NY: Oxford University Press.

Google Scholar

Lyubomirsky, S. (2007). The How of Happiness. New York, NY: Penguin.

Google Scholar

Ma, L. K., Tunney, R. J., and Ferguson, E. (2017). Does gratitude enhance prosociality? A meta-analytic review. Psychol. Bull. 143, 601–635. doi: 10.1037/bul0000103

PubMed Abstract | CrossRef Full Text | Google Scholar

Martínez, I. M., Meneghel, I., Carmona, M., and Youssef-Morgan, C. M. (2021). Adaptation and validation to Spanish of the psychological capital questionnaire–12 (PCQ-12) in academic contexts. Curr. Psychol. 40, 3409–3416.

Google Scholar

Martínez, I. M., Youssef-Morgan, C. M., Chambel, M. J., and Marques-Pinto, A. (2019). Antecedents of academic performance in university students: psychological capital and academic engagement. Educ. Psychol. 39, 1047–1067. doi: 10.1080/01443410.2019.1623382

CrossRef Full Text | Google Scholar

McCullough, M. E., Emmons, R. A., and Tsang, J. A. (2002). The grateful disposition: a conceptual and empirical topography. J. Pers. Soc. Psychol. 82:112. doi: 10.1037/0022-3514.82.1.112

PubMed Abstract | CrossRef Full Text | Google Scholar

McNeish, D., An, J., and Hancock, G. R. (2018). The thorny relation between measurement quality and fit index cut-offs in latent variable models. J. Pers. Assess. 100, 43–52. doi: 10.1080/00223891.2017.1281286

PubMed Abstract | CrossRef Full Text | Google Scholar

Merritt, S. M. (2012). The two-factor solution to Allen and Meyer’s (1990) affective commitment scale: effects of negatively worded items. J. Bus. Psychol. 27, 421–436. doi: 10.1007/s10869-011-9252-3

CrossRef Full Text | Google Scholar

Morgan, B., Gulliford, L., and Kristjánsson, K. (2017). A new approach to measuring moral virtues: the multi-component gratitude measure. Pers. Individ. Differ. 107, 179–189.

Google Scholar

Muthén, L. K., and Muthén, B. O. (2021). Mplus (Version 8.4). [Statistical Software]. Los Angeles, CA: Muthén and Muthén.

Google Scholar

Nunnally, J. C., and Bernstein, I. H. (1994). Psychometric Theory, 3rd Edn, New York, NY: McGraw-Hill.

Google Scholar

Peterson, C., and Chang, E. (2002). “Optimism and flourishing,” in Flourishing: Positive Psychology and the Life Well-Lived, eds C. Keyes and J. Haidt (Washington, DC: American Psychological Association), 55–79.

Google Scholar

Peterson, C., and Seligman, M. E. P. (2004). Character Strengths and Virtues: A Handbook and Classification. Oxford: Oxford University Press.

Google Scholar

Portocarrero, F. F., Gonzalez, K., and Ekema-Agbaw, M. (2020). A meta-analytic review of the relationship between dispositional gratitude and well-being. Pers. Individ. Differ. 164:110101. doi: 10.1016/j.paid.2020.110101

CrossRef Full Text | Google Scholar

Raykov, T. (2009). Evaluation of scale reliability for unidimensional measures using latent variable modeling. Measur. Eval. Counsel. Dev. 42, 223–232.

Google Scholar

Reise, S. P., Scheines, R., Widaman, K. F., and Haviland, M. G. (2013). Multidimensionality and structural coefficient bias in structural equation modeling a bifactor perspective. Educ. Psychol. Measur. 73, 5–26.

Google Scholar

Rice, S. P., Probst, T. M., and Bohle, S. L. (2021). Psychometric properties and measurement invariance of psychological capital, grit, and gratitude in selected samples from chile and the USA. J. Well Being Assess. 1–22. doi: 10.1007/s41543-021-00039-3

CrossRef Full Text | Google Scholar

Richter, S., Van Zyl, L. E., Lara, C., and Stander, M. W. (2021). Positive psychological coaching tools and techniques: a systematic review and classification. Front. Psychiatry 12:667200. doi: 10.3389/fpsyt.2021.667200

PubMed Abstract | CrossRef Full Text | Google Scholar

Rodriguez, A., Reise, S. P., and Haviland, M. G. (2016). Evaluating bifactor models: calculating and interpreting statistical indices. Psychol. Methods 21, 137–150.

Google Scholar

Salazar, M. S. (2015). The dilemma of combining positive and negative items in scales. Psicothema 27, 192–199. doi: 10.7334/psicothema2014.266

PubMed Abstract | CrossRef Full Text | Google Scholar

Seligman, M. E. P., Steen, T. A., Park, N., and Peterson, C. (2005). Positive psychology progress: empirical validation of interventions. Am. Psychol. 60, 410–421.

Google Scholar

Snyder, C. R., Harris, C., Anderson, J. R., Holleran, S. A., Irving, L. M., Sigmon, S. T., et al. (1991). The will and the ways: development and validation of an individual-differences measure of hope. J. Pers. Soc. Psychol. 60, 570–585. doi: 10.1037//0022-3514.60.4.570

CrossRef Full Text | Google Scholar

Snyder, C. R., Sympson, S. C., Ybasco, F. C., Borders, T. F., Babyak, M. A., and Higgins, R. L. (1996). Development and validation of the state hope scale. J. Pers. Soc. Psychol. 70, 321–335.

Google Scholar

Spence, J. R., Brown, D. J., Keeping, L. M., and Lian, H. (2014). Helpful today, but not tomorrow? Feeling grateful as a predictor of daily organizational citizenship behaviors. Pers. Psychol. 67, 705–738.

Google Scholar

Stucky, B. D., and Edelen, M. O. (2015). “Using heierarchical IRT models to create unidimensional measures from multidimensional data,” in Handbook of Item Response Theory Modeling: Applications to Typical Performance Assessment, eds S. P. Reise and D. A. Revicki (New York, NY: Routledge), 183–206.

Google Scholar

Stucky, B. D., Thissen, D., and Edelen, M. O. (2013). Using logistic approximations of marginal trace lines to develop short assessments. Appl. Psychol. Measur. 37, 41–57. doi: 10.1177/0146621612462759

CrossRef Full Text | Google Scholar

Thomas, M., and Watkins, P. (2003). Measuring the grateful trait: development of revised GRAT. Paper Presented at the Annual Convention of the Western Psychological Association, Vancouver, BC.

Google Scholar

Tomas, J. M., and Oliver, A. (1999). Rosenberg’s self-esteem scale: two factors or method effects. Struct. Equ. Model. 6, 84–98.

Google Scholar

van Zyl, L. E., Arijs, D., Cole, M. L., Glinska, A., Roll, L. C., Rothmann, S., et al. (2021). The strengths use scale: psychometric properties, longitudinal invariance and criterion validity. Front. Psychol. 12:676153. doi: 10.3389/fpsyg.2021.676153

PubMed Abstract | CrossRef Full Text | Google Scholar

Watkins, P. C. (2014). Gratitude and the Good Life: Toward a Psychology of Appreciation. Dordrecht: Springer.

Google Scholar

Watkins, P. C., Woodward, K., Stone, T., and Kolts, R. L. (2003). Gratitude and happiness: development of a measure of gratitude, and relationships with subjective well-being. Soc. Behav. Pers. Intern. J. 31, 431–451. doi: 10.1037/pas0000209

PubMed Abstract | CrossRef Full Text | Google Scholar

Wickrama, K., Lee, T. K., O’Neal, C. W., and Lorenz, F. (2016). Higher-Order Growth Curves and Mixture Modeling With Mplus: A Practical Guide. Milton Park: Routledge.

Google Scholar

Wong, J., and Wong, X. (2020). Structural Equation Modelling: Applications Using Mplus, 2nd Edn, Chichester: Wiley & Sons.

Google Scholar

Wood, A. M., Joseph, S., and Linley, P. A. (2007). Coping style as a psychological resource of grateful people. J. Soc. Clin. Psychol. 26, 1076–1093. doi: 10.1016/j.cjtee.2020.11.007

PubMed Abstract | CrossRef Full Text | Google Scholar

Wood, A. M., Joseph, S., Lloyd, J., and Atkins, S. (2009). Gratitude influences sleep through the mechanism of pre-sleep cognitions. J. Psychosom. Res. 66, 43–48. doi: 10.1016/j.jpsychores.2008.09.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Wood, A. M., Maltby, J., Gillett, R., Linley, P., and Joseph, S. (2008a). The role of gratitude in the development of social support, stress, and depression: two longitudinal studies. J. Res. Pers. 42, 854–871. doi: 10.1016/j.jrp.2007.11.003

CrossRef Full Text | Google Scholar

Wood, A. M., Maltby, J., Stewart, R., Linley, P., and Joseph, S. (2008b). A social-cognitive model of trait and state levels of gratitude. Emotion 8, 281–290. doi: 10.1037/1528-3542.8.2.281

PubMed Abstract | CrossRef Full Text | Google Scholar

Youssef, C. M., and Luthans, F. (2013). “Managing psychological capital in organizations: cognitive, affective, conative, and social mechanisms of happiness,” in Oxford Handbook of Happiness, eds S. A. David, I. Boniwell, and A. C. Ayers (New York, NY: Oxford University Press), 751–766.

Google Scholar

Youssef-Morgan, C. M., and Luthans, F. (2013). “Psychological capital theory: toward a positive holistic model,” in Advances in Positive Organizational Psychology, ed. A. Bakker (Bingley: Emerald), 145–166. doi: 10.1108/s2046-410x(2013)0000001009

CrossRef Full Text | Google Scholar

Zijlmans, E. A. O., Tijmstra, J., van der Ark, L. A., and Sijtsma, K. (2019). Item-score reliability as a selection tool in test construction. Front. Psychol. 9:2298. doi: 10.3389/fpsyg.2018.02298

PubMed Abstract | CrossRef Full Text | Google Scholar

Appendix A: The work gratitude scale

Instructions: For the following set of questions, think about your current working environment. Consider, the nature and function of your work, your colleagues/peers and the role work plays in your life. Then indicate to what extent you agree with the following 10 questions.

Keywords: gratitude, work gratitude, positive psychology, positive organizational behavior, scale development, measurement, positive psychological assessment

Citation: Youssef-Morgan CM, van Zyl LE and Ahrens BL (2022) The Work Gratitude Scale: Development and Evaluation of a Multidimensional Measure. Front. Psychol. 12:795328. doi: 10.3389/fpsyg.2021.795328

Received: 14 October 2021; Accepted: 17 November 2021;
Published: 05 January 2022.

Edited by:

Chiara Consiglio, Sapienza University of Rome, Italy

Reviewed by:

Ana Cláudia Souza Vazquez, Federal University of Health Sciences of Porto Alegre, Brazil
Katarzyna Danuta Durniat, University of Wrocław, Poland

Copyright © 2022 Youssef-Morgan, van Zyl and Ahrens. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Carolyn M. Youssef-Morgan, cyoussefmorgan@bellevue.edu

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.