ORIGINAL RESEARCH article
Work Engagement among Rescue Workers: Psychometric Properties of the Portuguese UWES
- 1Faculty of Philosophy, Sciences and Letters of Ribeirão Preto, University of São Paulo, São Paulo, Brazil
- 2Faculty of Psychology and Education Sciences, University of Porto, Porto, Portugal
- 3Faculdade de Psicologia, Centro de Investigação em Ciência Psicológica, Universidade de Lisboa, Lisboa, Portugal
- 4William James Centre for Research, ISPA-Instituto Universitário, Lisboa, Portugal
Rescue workers have a stressful and risky occupation where being engaged is crucial to face physical and emotional risks in order to help other persons. This study aims to estimate work engagement levels of rescue workers (namely comparing nurses, firefighters, and police officers) and to assess the validity evidence related to the internal structure of the Portuguese versions of the UWES-17 and UWES-9, namely, dimensionality, measurement invariance between occupational groups, and reliability of the scores. To evaluate the dimensionality, we compared the fit of the three-factor model with the fit of a second-order model. A Portuguese version of the instrument was applied to a convenience sample of 3,887 rescue workers (50% nurses, 39% firefighters, and 11% police officers). Work engagement levels were moderate to high, with firefighters being the highest and nurses being the lowest engaged. Psychometric properties were evaluated in the three-factor original structure revealing acceptable fit to the data in the UWES-17, although the UWES-9 had better psychometric properties. Given the observed statistically significant correlations between the three original factors, we proposed a 2nd hierarchal structure that we named work engagement. The UWES-9 first-order model obtained full uniqueness measurement invariance, and the second-order model obtained partial (metric) second-order invariance.
Rescue workers' main tasks are to bring people out of danger after accidents, attacks, disasters, etc., are the first on the scene of an emergency or provide care to victims who are suffering. Firefighters, police officers or health professionals working in urgency or pre-hospital departments can be considered as rescue workers, having a highly risky and stressful occupation (Stassen et al., 2013). However, they are very motivated and engaged with their tasks frequently facing physical and emotional risks to help other persons (Shakespeare-Finch, 2011). To better understand work engagement among rescue workers, the theoretical framework is presented beginning with the work engagement concept and its study among rescue workers, followed by some considerations about work engagement measurement using the Utrecht Work Engagement Scale (UWES).
Work Engagement Concept and Its Study Among Rescue Workers
Considering the frequent occurrence of disasters due to natural or human causes, particularly attention must be given to rescue workers dealing with critical incidents or disasters, since chronic emotional demands and coping with stressful situations harms their health and the services provided by their institution (Queirós et al., 2013; Rabjohn, 2013; International Labour Organization, 2016). Therefore, these professionals can develop negative emotional states, psychological disorders or mental diseases (e.g., anxiety, loneliness, panic attacks, depression, post-traumatic stress disorder, vicarious trauma), but particularly, they can experience chronic job stress and become vulnerable to burnout (Cieslak et al., 2014; Katsavouni et al., 2016; Krok, 2016). Several studies have emphasized the relationships between burnout and work engagement (Schaufeli et al., 2002a; Maslach and Leiter, 2008; Leon et al., 2015; Leiter and Maslach, 2017; Schaufeli and De Witte, 2017), suggesting that promoting work engagement can prevent burnout (Argentero and Setti, 2011), thus ameliorating rescue workers' mental health and helping their stress management (Nishi et al., 2016; O'Neill and Rothbard, 2017). In fact, work engagement seems to be an important psychological resource for rescue workers, since it may protect them from the risk of developing negative health effects (Setti and Argentero, 2014), depression, sleep disturbances, relational conflicts, burnout, compassion fatigue or vicarious trauma (Lenthall et al., 2009; Kumar, 2011; Ray et al., 2013), or presenteeism (Burton et al., 2017).
For several decades, Psychology has focused on pathology and psychological illness, which has led to a restricted view of human behavior that has consequently contributed to the depreciation of resources, qualities and skills of human beings as promoters of individual growth and psychological well-being (Diener et al., 1999). However, the recent emergence of Positive Psychology has counteracted this focus, valorizing the study of the positive part of human experience (Luthans, 2002), aiming to increase the quality of life, to promote individual qualities, resources, and characteristics that increase psychological well-being and growth (Seligman and Csikszentmihalyi, 2000). This approach within Positive Psychology explores building positive qualities, instead of focusing on repairing psychological illness. One of the theoretical concepts that arises within this perspective is work engagement (Schaufeli et al., 2002a), focused on the positive aspects of behaviors, the well-being and the optimal functioning of each person (Schaufeli and Salanova, 2007).
Although work engagement is a relatively new construct, it has been viewed as being comprised of slightly different aspects, such as physical, cognitive, emotional and mental expression by employees within the exercise of their roles (Kahn, 1990). Distinctions between organizational and job engagement have appeared regarding employees' different roles suggesting that engaged workers invest and dedicate themselves deeply into their tasks, which are viewed as motivated situations (Saks, 2006). Other authors (Maslach and Leiter, 1997, 2017; Maslach et al., 2001) have considered work engagement as a concept diametrically opposed to burnout, being defined as an energetic state of involvement in vital personal activities, but quite different from job satisfaction or organizational commitment (Hallberg and Schaufeli, 2006).
While the discussion about burnout and work engagement as different constructs or as opposite poles of the same construct continues (Schaufeli et al., 2002b; Macey et al., 2009; Cole et al., 2012; Leon et al., 2015; Leiter and Maslach, 2017; Schaufeli and De Witte, 2017), we adopt Schaufeli and colleagues' perspective on work engagement as a positive motivational, cognitive-affective, and emotional persistent state (Schaufeli and Salanova, 2007; Schaufeli, 2017b), divided into three factors or dimensions: vigor, dedication and absorption. Vigor is related to persistence, energy and mental resilience during work, while dedication implies being involved in the work and living with enthusiasm, inspiration, and pride, and finally, absorption means to be concentrated and immersed in one's work, with the perception that time flies (Schaufeli et al., 2002b). Thus, workers with high levels of work engagement see themselves as full of energy when facing their professional activities (Albrecht, 2010).
Work engagement is also related with other important occupational health and organizational outcomes, including in-role and extra-role behavior (Bakker et al., 2004). It is positively correlated with performance (Cooper and Quick, 2017; Reijseger et al., 2017); more specifically, a direct and positive relation has been found with job performance and a direct and negative relation with turnover intention (Karatepe and Avci, 2017; Kim, 2017), proactive behaviors and employee intrapreneurship (Gawke et al., 2017), job crafting and personal resources (Xanthopoulou et al., 2009; Vogt et al., 2016), general job resources (Schaufeli et al., 2009), structural and social resources (Harju et al., 2016), and job, career and life satisfaction (Karatepe and Karadas, 2015).
Work Engagement Measurement with the Utrecht Work Engagement Scale
In line with its three-dimensional definition, the work engagement measure was divided into three sub-scales, in a psychometric instrument called Utrecht Work Engagement Scale (UWES), a self-report instrument that includes the vigor, dedication and absorption factors (with six, five and six items respectively). Although the UWES presents good psychometric properties. it is common to find very strong correlations between the factors (Chughtai and Buckley, 2013; Agarwal, 2014), leading some studies to prefer the single factor measure (Shimazu et al., 2008; Seppälä et al., 2009; Klassen et al., 2012), while others (Shimazu et al., 2008; Alok, 2013) tested UWES as a second-order construct (Edwards, 2001). Kulikowski (2017) conducted a literature review with 21 studies using Confirmatory Factor Analysis (CFA) of UWES; six of these recognized the three-factor version as superior to the one-factor solution, six studies found the opposite, eight studies found both structures as equivalent, and one study failed to confirm both structures. However, usually, the CFAs present good results with the three-factor structure. Moreover, various studies found invariance between different occupational and racial groups and countries (Storm and Rothmann, 2003; Xanthopoulou et al., 2012), and relative longitudinal invariance for the short version (Seppälä et al., 2009). This shorter version with nine items is divided into the same three dimensions, with three items per dimension (Schaufeli et al., 2006).
The UWES has been used in several studies with rescue workers and translated into many languages (Schaufeli and Bakker, 2003). Several studies have shown that the structure of the UWES remains unchanged among different occupational groups. Table 1 presents a synthesis of 30 studies between 2003 and 2017, conducted mainly in Europe but also in America, Asia, Africa and Oceania, with professionals with occupation statuses similar to the ones of our study, revealing that work engagement levels are moderate to high among these rescue workers.
Considering previous studies with UWES among these professionals, our research question was to investigate if UWES is an adequate instrument to assess rescue workers' engagement. Thus, this study aims to estimate work engagement levels of rescue workers (namely comparing nurses, firefighters, and police officers) and to assess the validity evidence related with the internal structure of the Portuguese versions of the UWES-17 and UWES-9, namely to evaluate their dimensionality (comparing the fit of the three-factor first-order model of the UWES-17 and UWES-9, and of a possible UWES-9 second-order model), measurement invariance between the three occupational groups, and reliability of the scores, according to the Standards for Educational and Psychological Testing framework (American Educational Research Association et al., 2014). According to these aims, we have as hypotheses: (H1) UWES-17 presents validity evidence that supports its usage among rescue workers; (H2) UWES-9 presents validity evidence that supports its usage among rescue workers; (H3) UWES-9 presents measurement invariance that allows for comparing different occupational groups; (H4) UWES-9 reveals different work engagement levels between the three different occupational groups of rescue workers.
A sample of 3,887 Portuguese rescue workers completed the UWES-17 (except 428 workers that only completed the UWES-9), with data collected from several research projects (seven studies) developed at the Psychosocial Rehabilitation Laboratory from FPCEUP, between 2010 and 2016. Data were from different Portuguese districts, but with all occupations contributing to the data during the same year. The average age was 33.35 years old (SD = 9.84), 50% male, 44% married (and 50% single), 62% at least had a college degree. Regarding occupations, 50% were nurses, 39% voluntary firefighters (according to the Portuguese firefighters' organization, they can be voluntary or professional firefighters; this study collected data from voluntary firefighters, a larger group than professional firefighters) and 11% police officers.
A sociodemographic questionnaire was administered, with items such as age, sex, marital status, school level and occupation. Despite other questions specific to each rescuer occupation, these questions were asked to all groups. To assess work engagement, we used the UWES (Table 2) developed by Schaufeli et al. (2002b) in its Portuguese version (Marques-Pinto and Picado, 2011).
Participants were invited to voluntarily participate after formal authorization from each organization where they were working at and filled out printed versions of the UWES anonymously. The study was approved by the Ethics Committee of University of Porto, Portugal, and written informed consent from all research participants was obtained.
To study the dimensionality of the UWES versions, a CFA was conducted to verify if the three-factor structure proposed by the UWES' authors presented an adequate fit for this study's sample. We used as the goodness-of-fit indices the TLI (Tucker Lewis Index), NFI (Normed Fit Index), χ2/df (ratio chi-square and degrees of freedom), CFI (comparative fit index) and the RMSEA (root mean square error of approximation). The fit of the model was considered good for χ2/df smaller than 5, CFI, NFI and TLI values above 0.95 and RMSEA values below 0.08 (Hoyle, 1995; Boomsma, 2000; McDonald and Ho, 2002; Marôco, 2014; Byrne, 2016).
To analyze convergent validity evidence, the average variance extracted (AVE) was estimated as described in Fornell and Larcker (1981). Values of AVE ≥ 0.5 were considered indicative of the constructs' convergent validity evidence, for both versions of the UWES per the proposal by Hair et al. (2009).
Discriminant validity indicates that the items that represent a dimension are not strongly correlated with other dimensions (Fornell and Larcker, 1981; Marôco, 2014). For two factors x and y, if AVEx and AVEy ≥ ρ2 xy (squared correlation between the factors x and y) there is evidence of discriminant validity (Marôco, 2014).
The reliability of the UWES scores was investigated using internal consistency estimates, Composite Reliability (CR), the ordinal Cronbach's alpha coefficient (α) and the ordinal omega coefficient (ω) for each factor and for the total scale. The second-order factor reliability was also calculated with the omega coefficient (semTools Contributors, 2016).
The measurement invariance corresponds to the situation where links between the items and the construct studied are invariant for different contexts, such as countries, religions, times, or languages (Gregorich, 2006; Little, 2013; Brown, 2015; Hayduk, 2016). This should be tested on the construction or adaptation plan of any psychometric instrument (Edwards et al., 2017). This analysis will show if in different measurement conditions we are measuring the same attributes. Without evidence for this, the basis for drawing inferences will be severely compromised, and, as a result, the findings of possible differences between samples of different groups cannot be unambiguously interpreted (Horn and McArdle, 1992).
Establishing measurement invariance consists of the estimation of an increasingly constrained set of structural equation models, and then evaluating if the differences between those models are significant (van de Schoot et al., 2012). To detect whether the same three-factor model holds in each group of professionals, a group of nested models with indications of equivalence is needed (Marôco, 2014). For the three-factor first-order version of the UWES-9, the first model to be tested is one where only the factor loadings are equal across groups, but the thresholds are allowed to differ between groups; this is called metric invariance and assesses if the professionals in the different occupational groups attribute the same meaning to the three work engagement factors. Next, to assess scalar invariance, a model in which the thresholds and loadings are forced to be the same is tested; it indicates that the three work engagement latent variables (in other words, the loadings), and that the levels of the thresholds are equal for the three different kinds of professionals (van de Schoot et al., 2012). As a result, the occupational groups can be compared on their scores for the vigor, absorption and dedications variables. The next step tests a model in which the residual variances are also forced to be equal across the three groups of professionals, achieving the so-called full uniqueness Measurement Invariance; if obtained, the explained variance for all items is the same for the occupational groups. This means the three factors are measured identically across professional groups. Finally, a model in which the latent means are the same for the different groups is tested. This approach is based on the recommendations of Millsap and Yun-Tein (2004), who specifically discuss the measurement invariance for ordered-categorical measures using the theta-parameterization. Most researchers still use multi-group confirmatory maximum likelihood factor analysis of a Person covariance matrix irrespective of the nature of the measures (Koh and Zumbo, 2008). The approach used in this study tries to be more precise and adequate given the kind of measures adopted (Hirschfeld and von Brachel, 2014).
For the second-order model, a different approach (with more models) is needed. A group of seven models were tested, based on the recommendations of Chen et al. (2005) to test the invariance in second-order models, and in the recommendations of Millsap and Yun-Tein (2004) due to the ordered-categorical nature of our measures. The following models with increasing constraints were compared: (a) configural invariance, (b) first-order factor loadings, (c) second-order factor loadings, (d) thresholds of measured variables, (e) intercepts of first-order factors, (f) disturbances of first-order factors, and (g) residual variances of observed variables. Invariance is supported if the ΔCFI < 0.01 between constrained and free models is presented (Cheung and Rensvold, 2002) and if Δχ2 test comparing the fit of the constrained vs. free models is not statistically significant (Satorra and Bentler, 2001).
All statistical analyses were performed with R (R Core Team, 2017) and Rstudio (RStudio Team, 2017). The descriptive statistics were obtained with the skimr package (Arino de la Rubia et al., 2017). The CFA analysis was conducted with the lavaan package (Rosseel, 2012) using the Weighted Least Squares Means and Variances (WLSMV) estimation method. The reliability estimates and measurement invariance (for the first-order model) were calculated with the semTools package (semTools Contributors, 2016), the measurement invariance for the second-order model was analyzed with lavaan (Rosseel, 2012), the Mardia Kurtosis (Mardia, 1970) was assessed with the psych package (Revelle, 2017), and the doBy package (Højsgaard and Halekoh, 2016) for the percentiles. The comparisons of the raw levels of the factors (estimated as the mean of the items for each factor) between the occupational groups were tested using one-way ANOVA with pairwise comparisons using the stats package (R Core Team, 2017). The effect sizes were calculated using Partial Eta Squared from the lsr package (Navarro, 2015).
Results are presented following the Standards for Educational and Psychological Testing framework.
Internal Structure Validity Evidence
Distributional properties of items
As shown in Table 3 (UWES-17) and Table 4 (UWES-9), there were no items with skewness and kurtosis values that were indicative of severe normality deviations (Kline, 2016), the Mardia's Multivariate Kurtosis for the UWES-17 items was 279.4, p < 0.001, and for the UWES-9 version it was 189.4, p < 0.001. No outliers were deleted. All possible answer values for each item were also present. The mean for most items was close to 4. Therefore, factor analysis with WLSMV, to account for the ordinal level of measurement of the items, can be done without concerns about the validity of its estimates.
Factor related validity evidence
The three-factor hypothesized model of UWES-17 demonstrated acceptable fit to the data ( = 3,166.950, p < 0.001, n = 3,196; CFI = 0.994; TLI = 0.993; NFI = 0.993; RMSEA = 0.091; P(rmsea ≤ 0.05) < 0.001, IC90 ]0.088; 0.093[), since CFI, TLI, and NFI values were above 0.95, but RMSEA values were above 0.08 (Marôco, 2014), while the factor loadings of all items were above 0.57.
For the UWES-9 hypothesized model, the fit was considered acceptable (Figure 1; = 981.892, p < 0.001, n = 3,623; CFI = 0.997; TLI = 0.995; NFI = 0.996; RMSEA = 0.105; P(rmsea ≤ 0.05) < 0.001, IC90 ]0.099; 0.111[) with CFI, TLI, and NFI values above 0.95, and RMSEA values above 0.08. The factor loadings of all items were above 0.68. As the UWES-9 showed a better fit to the sample data, we proceeded with the analysis of this version of the UWES.
Figure 1. Confirmatory Factor Analysis of the Utrecht Work Engagement Scale (9 items) with Portuguese rescue workers ( = 981.892, p < 0.001, N = 3,623; CFI = 0.997; TLI = 0.995; NFI = 0.996; RMSEA = 0.105; P(rmsea ≤ 0.05) < 0.001, IC90 ]0.099; 0.111[).
Convergent validity evidence
For the UWES-17, AVE was satisfactory for all dimensions: vigor = 0.65, dedication = 0.72, and absorption = 0.52. For the nine-item version, UWES-9, AVE was good for all dimensions, vigor = 0.80, dedication = 0.78, and absorption = 0.61.
Discriminant validity evidence
The discriminant validity was assessed by comparing the AVE of the factors with the squared correlation of the factors, as proposed by Fornell and Larcker (1981) and described in Marôco (2014). Discriminant validity evidence is obtained when the AVE for two scales is larger than the squared Pearson correlation between the two scales. For the UWES-17, AVEvigor = 0.65 and AVEdedication = 0.72 were smaller than = 0.86, AVEabsorption = 0.52 and AVEdedication = 0.72 were smaller than = 0.85 and AVEvigor = 0.65 and AVEabsorption = 0.52 were smaller than = 0.86. For the UWES-9, AVE vigor = 0.80 and AVEdedication = 0.78 were not larger than = 0.83, AVEabsorption = 0.61 and AVEdedication = 0.78 were smaller than = 0.82, and AVEvigor = 0.80 and the AVEabsorption = 0.61 are, respectively, larger and smaller than = 0.76.
When there is a higher order latent variable (work engagement) that is hypothesized to consider the relations among the lower order factors (vigor, dedication, and absorption in this case), a second-order latent model is admissible (Chen et al., 2005). Another possibility to consider second-order latent models is when the first-order dimensions are substantially correlated with each other (Marôco, 2014), which is verified in the first-order three-factor UWES-9 model. For the UWES-9 model, a second-order latent factor was proposed. A correlation between the residual variances of item 1 and item 4 of the Vigor dimension was added. Regarding the UWES-9 with a second-order latent factor, the fit was very good (Figure 2; = 498.849, p < 0.001, n = 3,623; CFI = 0.998; TLI = 0.997; NFI = 0.998; RMSEA = 0.074; P(rmsea ≤ 0.05) < 0.001; IC90 ]0.068; 0.080[).
Figure 2. Confirmatory Factor Analysis of the Utrecht Work Engagement Scale (9 items) second-order latent factor with Portuguese rescue workers ( = 498.849, p < 0.001, n = 3,623; CFI = 0.998; TLI = 0.997; NFI = 0.998; RMSEA = 0.074; P(rmsea ≤ 0.05) < 0.001, IC90 ]0.068; 0.080[).
Reliability of the Scores: Internal Consistency
To assess the internal consistency, first we used the Composite Reliability of the factors. Also standard Cronbach's alpha coefficient (α) and omega coefficient (ω) were used for each dimension proposed in the UWES-17 and in the UWES-9, and to assess the consistency of the total scales (Table 5).
Reliability of the higher-order construct was very good. The proportion of the second-order factor explaining the total score (ωL1) was 0.93, the proportion of the second-order factor explaining the variance of the first-order factor level (ωL2) was 0.98, and the proportion of observed variance explained by the second-order factor after controlling for the uniqueness from the first-order factor (ωpartial L1) was 0.94. The structural weights for the second-order factor model were: vigor (β = 0.99; p < 0.001); dedication (β = 0.98; p < 0.001); and absorption (β = 0.93; p < 0.001).
To detect whether the same original three-factor (first-order model) holds in each occupation (Table 6), a group of nested models with indications of equivalence is needed (Marôco, 2014). The hypothesized scale invariance was supported by the Cheung and Rensvold (2002) ΔCFI criterion, but not by the Δχ2 criterion (Satorra and Bentler, 2001), although the second criterion is more restrictive. According to the Cheung and Rensvold (2002) criterion, the results supported the full uniqueness measurement invariance between the occupational groups (nurses, firefighters, and police officers). However, there were significant differences between the means of the UWES dimensions for the different occupational groups. It could be noticed that these comparisons are valid since the measures showed scalar invariance.
Table 6. UWES-9 first-order three-factor latent model comparison between occupational groups of rescue workers.
The test of the measurement invariance for the second-order model for categorical variables is shown in Table 7. According to ΔCFI criteria, only partial (metric) second-order invariance is supported in the second-order UWES-9 model for the three different occupational groups.
Table 7. UWES-9 second-order three-factor latent model comparison between occupational groups of rescue workers.
Considering rescue workers' occupations, Table 8 presents percentiles and mean levels of each work engagement dimension, and a comparison between nurses, firefighters, and police officers. For the hypothesized differences between occupational groups, some statistical significant differences in work engagement were found between the three groups (Table 9), being highest among firefighters and lowest among nurses. Percentile analyses reveal the exact value for each category and occupation, reflecting the tendency revealed by the mean analysis of each sample.
Considering the psychometric properties of data gathered with the UWES in the present sample, our hypotheses were confirmed since UWES-17 and UWES-9 presented validity evidence that supports its usage among rescue workers (respectively H1 and H2), and UWES-9 presented measurement invariance that allows for comparing occupational groups (H3). In fact, the data presented better psychometric properties for the UWES-9 and supported a second-order latent factor for the three-factor structure due to strong correlations between the first-order dimensions. This solution is supported by other international studies, presenting better goodness-of-fit indexes for the shorter version of the instrument (Nerstad et al., 2010; Hernandez-Vargas et al., 2016). The convergent validity evidence and reliability of the scores were good, although the discriminant validity was not acceptable, leading to the proposal of a second-order latent factor. There have been several reports that discuss the dimensionality of work engagement as assessed by UWES (see Table 1). Our data suggests that work engagement can be defined as a second-order factor that is reflected in the workers' vigor, dedication, and absorption. Thus, we suggest that work engagement can be estimated as a single value in research contexts and in clinical settings facilitating the use of the UWES. A second-order latent factor has advantages over a single first-order factor for the UWES as proposed by several researchers (see Table 1) since it allows for the estimation of a single value for work engagement while retaining the three first-order factors proposed (Schaufeli and Bakker, 2003).
Regarding H4 (UWES-9 can evaluate different occupational groups of rescue workers), and considering rescue workers' occupation specificities, work engagement levels varied; despite being moderate to high, they were higher among firefighters and lower among nurses. This can be explained by the fact that Portuguese firefighters are traditionally volunteers (paid or not), being highly engaged in their tasks and frequently assuming physical risks to help in rescue situations (e.g., the tragedy of the Portuguese forest fire during June 2017 at Pedrógão Grande where a firefighter died, and several were severely burned; or the Portuguese forest fire during the summer of 2013 at Caramulo where eight firefighters died). According to Portuguese data on firefighters, in 2014 there were 42,000 firefighters, only 6,000 of whom were professionals and the remaining were volunteers, despite all of them being trained by the Portuguese Firefighters' National School. Moreover, some studies explain that aid workers, such as firefighters, can present a sense of coherence, a concept developed by Antonovsky (1987). Related to the salutogenic theory, it is defined as the “ability of the persons to understand what happens around them, to what extent they were able to manage the situation on their own or through significant others in their social network, and the ability to find meaning in the situation” (Eriksson and Lindström, 2005, p. 460). This can help someone to better cope with traumatic events life adversities (Veronese and Pepe, 2014; Veronese et al., 2016). The study of 464 firefighters by Dudek and Koniarek (2000) revealed that post-traumatic stress symptoms were associated with a low level of sense of coherence, especially if they already have post-traumatic stress disorder. Additionally, firefighters, like police officers, share some personality traits like sensation seeking (Perrott and Blenkarn, 2015), that increase their motivation to pursue certain occupations. Nurses presented the lowest work engagement values, maybe due to the external demands their occupation is facing, namely lack of human or material resources, conflicts with patients or being aggressed by them or their families, etc. (Lin et al., 2016; Marôco et al., 2016). Indeed, recent austerity measures adopted in countries such as Portugal have had significant negative effects on the availability of healthcare system resources, including reduced staffing and employment conditions (Dussault and Buchan, 2014). Regarding the work engagement dimensions, it is important to notice that they are differentiated according to each rescue occupation, since vigor is related to physical energy, used more by firefighters and police officers, while dedication is clearly higher among firefighters who voluntarily seek this activity. Finally, absorption must be interpreted according to each task, which was higher among firefighters and police officers, especially when they are in rescue operations where time “flies,” while nurses have more rigid protocols to obey, accomplishing schedules and some rigid tasks. Results are similar to other studies where rescue workers present moderate to high work engagement levels (see Table 1), with nurses having lower work engagement than police officers (Schaufeli et al., 2006), and a lack of studies about firefighter's work engagement (curiously the one found was with a Portuguese sample).
Limitations and Recommendations for Future Research
This study has some limitations, namely having a convenience sample collected using participants' voluntary participation. In the future, respecting voluntary participation, we would like to attract more participants, trying to have equal representation among the occupations. In fact, in this sample the percentages were not homogeneous, with nurses representing half of the sample, and police officers comprising only 11% of the sample. Firefighters were also included, but not other rescuers such as medical emergency staff, civil protection technicians, social workers or psychologists, who, for example, during the summer of 2017 in Portugal, participated in rescue tasks for the population due to the tragic forest fires. Furthermore, we did not have any source of evidence-based on relations to other variables, which can provide external validity evidence of UWES when compared with other concurrent or divergent measures (American Educational Research Association et al., 2014). This was a consequence of collecting data from each occupational group separately or during a different year, according to different research projects developed in the same University research unit, which were addressing different topics, having in common the measurement of work engagement with UWES. In the future, we would like to increase the sample, with replication efforts to collect data among more diverse rescue occupations. Also, we intend to have more homogeneity between rescue workers' samples sizes, having thus a stronger national representativeness, which can be obtained using web-based versions (Ilieva et al., 2002) of UWES (with other measures) through, for example, LimeSurvey (Limesurvey GmbH, 2017). The advantages of web-based surveys can also include increased delivery speed, control and monitoring, automatic data validation, and decreased data entry error (Falletta and Combs, 2002). Finally, we would like to combine work engagement measurement with other variables such as burnout, trauma or job satisfaction, as frequently studied in numerous research (e.g., Argentero and Setti, 2011; Ângelo and Chambel, 2015; Espinoza-Parra et al., 2015).
The study has some theoretical implications, enabling a better understanding of work engagement dimensions related with each occupational group specificities (e.g., vigor is higher among firefighters and police officers who use more physical energy). Additionally, the recent Schaufeli (2017a) publication of the general engagement scale (UGES), with 9 items evaluating daily activities and not only work/job activities will broad the evaluation of engagement and its relationship with psychological variables such as positive and negative affect, satisfaction with life, personality traits (Schaufeli, 2017b), or sense of coherence and trauma (Dudek and Koniarek, 2000; Veronese and Pepe, 2017). Thus, work engagement seems to be an important concept to study among workers and organizations, considering that organizations are facing more competition, innovation, and constant changes, and also a decrease of resources (Graffigna, 2017). Engaged workers are thus an important element for organizations' productivity or to the care/services they provide to citizens.
Regarding practical implications, this validation of a Portuguese version of UWES can contribute to the improvement of rescue workers' quality of life, since these results can alert individuals and institutions about the need to explore work engagement level to buffer against negative physiological health effects (Lenthall et al., 2009; Kumar, 2011; Ray et al., 2013; Setti and Argentero, 2014; Burton et al., 2017). Moreover, reference values for the Portuguese firefighters, nurses and police officers' populations make it possible to establish comparisons with other occupational groups of rescue workers (e.g., physicians, social workers). Taken together, the findings of the present study have important ecological implications for Portuguese policymakers and human resource managers who can structure rescue workers' work conditions, or develop intervention programs to promote their work engagement, and therefore help prevent burnout and other mental health conditions that affect these professionals' well-being.
Regarding the four research hypotheses, all were confirmed, since convergent validity evidence was found. Due to the lack of discriminant validity evidence, a second-order latent factor was proposed. Additionally, reliability evidence presented good values, and we tested measurement invariance for ordinal variables, using an innovative approach for categorical variables. Moreover, UWES can discriminate work engagement levels for each occupational group of rescue workers. Thus, this UWES version can be used to collect more data for future comparative studies. Additionally, due to natural or human causes (e.g., forest fires, multi-victim accidents, terrorist attacks), rescue workers play an increasingly important role in modern society, and the work engagement concept will help to better understand rescue workers' motivation to continue performing their tasks even when they risk their own life and frequently face tragedies.
This study was carried out in accordance with the recommendations of guidelines of the Faculty of Psychology and Education Sciences of the University of Porto with written informed consent from all subjects. All subjects gave written informed consent in accordance with the Declaration of Helsinki. The protocol was approved by the Ethics Committee of the Faculty of Psychology and Education Sciences of the University of Porto.
All authors of this research paper have directly participated in the planning, execution, or analysis of this study. More specifically, JS wrote the paper, and with JM performed all statistical analysis and its discussion. JS and AM-P discussed engagement concept, theoretical framework, and its results interpretation, JS and CQ discussed rescue workers' engagement, theoretical framework and engagement results.
The authors would like to thank the Portuguese National Occupational Health Program of the Directorate-General of Health (DGS) for the scientific sponsorship. And to the University of São Paulo (USP) International grant conceded to Jorge Sinval (Grant agreement number: 2014.1.3766.1.8). This work was funded by the Center for Psychology at the University of Porto, Portuguese Science Foundation (FCT UID/PSI/00050/2013) and EU FEDER through COMPETE 2020 program (POCI-01-0145-FEDER-007294).
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Aboshaiqah, A. E., Hamadi, H. Y., Salem, O. A., and Zakari, N. M. (2016). The work engagement of nurses in multiple hospital sectors in Saudi Arabia: a comparative study. J. Nurs. Manage. 24, 540–548. doi: 10.1111/jonm.12356
American Educational Research Association, American Psychological Association, and National Council on Measurement in Education. (2014). Standards for Educational and Psychological Testing. Washington, DC: American Psychological Association.
Ângelo, R. P., and Chambel, M. J. (2015). The reciprocal relationship between work characteristics and employee burnout and engagement: a longitudinal study of firefighters. Stress Heal. 31, 106–114. doi: 10.1002/smi.2532
Antonovsky, A. (1987). Unraveling the Mystery of Health: How People Manage Stress and Stay Well. San Francisco, CA: Jossey-Bass. Available online at: http://psycnet.apa.org/record/1987-97506-000
Arino de la Rubia, E., Zhu, H., Ellis, S., Waring, E., and Quinn, M. (2017). skimr: Skimr (R package version 0.9100) [Computer software]. Available online at: https://github.com/ropenscilabs/skimr
Bolier, L., Ketelaar, S. M., Nieuwenhuijsen, K., Smeets, O., Gärtner, F. R., and Sluiter, J. K. (2014). Workplace mental health promotion online to enhance well-being of nurses and allied health professionals: a cluster-randomized controlled trial. Internet Interv. 1, 196–204. doi: 10.1016/j.invent.2014.10.002
Breevaart, K., Bakker, A. B., Demerouti, E., and Hetland, J. (2012). The measurement of state work engagement: a multilevel factor analytic study. Eur. J. Psychol. Assess. 28, 305–312. doi: 10.1027/1015-5759/a000111
Brunetto, Y., Teo, S. T. T., Shacklock, K., and Farr-Wharton, R. (2012). Emotional intelligence, job satisfaction, well-being and engagement: explaining organisational commitment and turnover intentions in policing. Hum. Resour. Manage. J. 22, 428–441. doi: 10.1111/j.1748-8583.2012.00198.x
Burton, W. N., Chen, C. Y., Li, X., and Schultz, A. B. (2017). The association of employee engagement at work with health risks and presenteeism. J. Occup. Environ. Med. 59, 988–992. doi: 10.1097/JOM.0000000000001108
Chen, F. F., Sousa, K. H., and West, S. G. (2005). Teacher's corner: testing measurement invariance of second-order factor models. Struct. Equ. Model. A Multidiscip. J. 12, 471–492. doi: 10.1207/s15328007sem1203_7
Cieslak, R., Shoji, K., Douglas, A., Melville, E., Luszczynska, A., and Benight, C. C. (2014). A meta-analysis of the relationship between job burnout and secondary traumatic stress among workers with indirect exposure to trauma. Psychol. Serv. 11, 75–86. doi: 10.1037/a0033798
Cole, M. S., Walter, F., Bedeian, A. G., and O'Boyle, E. H. (2012). Job burnout and employee engagement: a meta-analytic examination of construct proliferation. J. Manage. 38, 1550–1581. doi: 10.1177/0149206311415252
Dussault, G., and Buchan, J. (2014). “The economic crisis in the EU: impact on health workforce mobility,” in Health Professional Mobility in a Changing Europe: New Dynamics, Mobile Individuals and Diverse Responses, eds J. Buchan, M. Wismar, I. A. Glinos, and J. Bremner (Copenhagen: World Health Organization/European Observatory on Health Systems and Policies), 35–64. Available online at: http://www.euro.who.int/en/about-us/partners/observatory/publications/studies/health-professional-mobility-in-a-changing-europe.-new-dynamics,-mobile-individuals-and-diverse-responses-2014
Espinoza-Parra, S., Molero, F., and Fuster-Ruizdeapodaca, M. J. (2015). Transformational leadership and job satisfaction of police officers (carabineros) in Chile: the mediating effects of group identification and work engagement. Rev. Psicol. Soc. 30, 439–467. doi: 10.1080/02134748.2015.1065087
Falletta, S. V., and Combs, W. (2002). “Surveys as a tool for organizational development and change,” in Organizational Development: A Data-Driven Approach to Organizational Change, eds J. Waclawski and A. H. Church (San Francisco, CA: Jossey-Bass), 78–102.
Fong, T. C., and Ho, R. T. (2015). Dimensionality of the 9-item Utrecht Work Engagement Scale revisited: a Bayesian structural equation modeling approach. J. Occup. Health 57, 353–358. doi: 10.1539/joh.15-0057-OA
Gilchrist, R. M., Villalobos, C. E. P., and Fernández, L. R. (2013). Factorial structure and internal consistency of the Utrecht Work Engagement Scale (Uwes) 17 among health workers of Chile. Liberabit 19, 163–171.
Gillet, N., Huart, I., Colombat, P., and Fouquereau, E. (2013). Perceived organizational support, motivation, and engagement among police officers. Prof. Psychol. Res. Pract. 44, 46–55. doi: 10.1037/a0030066
Graffigna, G. (2017). Is a transdisciplinary theory of engagement in organized settings possible? A concept analysis of the literature on employee engagement, consumer engagement and patient engagement. Front. Psychol. 8:872. doi: 10.3389/fpsyg.2017.00872
Gregorich, S. E. (2006). Do self-report instruments allow meaningful comparisons across diverse population groups? Testing measurement invariance using the confirmatory factor analysis framework. Med. Care 44, S78–S94. doi: 10.1097/01.mlr.0000245454.12228.8f
Harju, L. K., Hakanen, J. J., and Schaufeli, W. B. (2016). Can job crafting reduce job boredom and increase work engagement? A three-year cross-lagged panel study. J. Vocat. Behav. 95–96, 11–20. doi: 10.1016/j.jvb.2016.07.001
Hernandez-Vargas, C. I., Llorens-Gumbau, S., Rodriguez-Sanchez, A. M., and Dickinson-Bannack, M. E. (2016). Validación de la escala UWES-9 en profesionales de la salud en México. Pensam. Psicol, 14, 89–100. doi: 10.11144/Javerianacali.PPSI14-2.veup
Hirschfeld, G., and von Brachel, R. (2014). Multiple-group confirmatory factor analysis in R: a tutorial in measurement invariance with continuous and ordinal indicators. Pract. Assess. Res. Eval. 19. Available online at: http://pareonline.net/getvn.asp?v=19&n=7
Højsgaard, S., and Halekoh, U. (2016). doBy: Groupwise Statistics, LSmeans, Linear Contrasts, Utilities (R package version 4.5-15) [Computer software]. Available online at: https://cran.r-project.org/package=doBy
Hu, Q., Schaufeli, W. B., and Taris, T. W. (2017). How are changes in exposure to job demands and job resources related to burnout and engagement? A longitudinal study among Chinese nurses and police officers. Stress Heal. 33, 631–644. doi: 10.1002/smi.2750
International Labour Organization (2016). Workplace Stress: A Collective Challenge. Geneva: International Labour Organization. Available online at: http://www.ilo.org/safework/info/publications/WCMS_466547/lang--en/index.htm [Accessed July 1, 2017].
Karatepe, O. M., and Avci, T. (2017). The effects of psychological capital and work engagement on nurses' lateness attitude and turnover intentions. J. Manage. Dev. 36, 1029–1039. doi: 10.1108/JMD-07-2016-0141
Karatepe, O. M., and Karadas, G. (2015). Do psychological capital and work engagement foster frontline employees' satisfaction? Int. J. Contemp. Hosp. Manage. 27, 1254–1278. doi: 10.1108/IJCHM-01-2014-0028
Katsavouni, F., Bebetsos, E., Malliou, P., and Beneka, A. (2016). The relationship between burnout, PTSD symptoms and injuries in firefighters. Occup. Med. (Chic. Ill). 66, 32–37. doi: 10.1093/occmed/kqv144
Klassen, R. M., Aldhafri, S., Mansfield, C. F., Purwanto, E., Siu, A. F. Y., Wong, M. W., et al. (2012). Teacher' engagement at work: an international validation study. J. Exp. Educ. 80, 317–337. doi: 10.1080/00220973.2012.678409
Koh, K. H., and Zumbo, B. D. (2008). Multi-group confirmatory factor analysis for testing Measurement invariance in mixed item format data. J. Mod. Appl. Stat. Methods 7, 471–477. doi: 10.22237/jmasm/1225512660
Kulikowski, K. (2017). Do we all agree on how to measure work engagement? Factorial validity of Utrecht Work Engagement Scale as a standard measurement tool – a literature review. Int. J. Occup. Med. Environ. Health 30, 161–175. doi: 10.13075/ijomeh.1896.00947
Lenthall, S., Wakerman, J., Opie, T., Dollard, M., Dunn, S., Knight, S., et al. (2009). What stresses remote area nurses? Current knowledge and future action. Aust. J. Rural Health 17, 208–213. doi: 10.1111/j.1440-1584.2009.01073.x
Limesurvey GmbH (2017). LimeSurvey: An Open Source Survey Tool [Computer software]. Available online at: http://www.limesurvey.org
Lin, T. C., Lin, H. S., Cheng, S. F., Wu, L. M., and Ou-Yang, M. C. (2016). Work stress, occupational burnout and depression levels: a clinical study of paediatric intensive care unit nurses in Taiwan. J. Clin. Nurs. 25, 1120–1130. doi: 10.1111/jocn.13119
Little, T. D. (2013). Longitudinal Structural Equation Modeling. New York, NY: The Guildford Press. Available online at: http://www.guilford.com/books/Longitudinal-Structural-Equation-Modeling/Todd-Little/9781462510160
Marôco, J., Marôco, A. L., Leite, E., Bastos, C., Vazao, M. J., and Campos, J. A. D. B. (2016). Burnout in Portuguese healthcare professionals: an analysis at the national level. Acta Med. Port. 29, 24–30. doi: 10.20344/amp.6460
Maslach, C., and Leiter, M. P. (2017). “Understanding burnout: new models,” in The Handbook of Stress and Health: A Guide to Research and Practice, eds C. L. Cooper and J. C. Quick (Chichester: John Wiley & Sons), 36–56.
Montero-Marin, J., Zubiaga, F., Cereceda, M., Piva Demarzo, M. M., Trenc, P., and Garcia-Campayo, J. (2016). Burnout subtypes and absence of self-compassion in primary healthcare professionals: a cross-sectional study. PLoS ONE 11:e0157499. doi: 10.1371/journal.pone.0157499
Naudé, J. L. P., and Rothmann, S. (2015). The validation of the Utrecht work Engagement Scale for emergency medical technicians in Gauteng. South Afr. J. Econ. Manag. Sci. 7, 459–468. doi: 10.4102/sajems.v7i3.1356
Navarro, D. (2015). Learning Statistics with R: A Tutorial for Psychology Students and Other Beginners (R package version 0.5). Available online at: https://cran.r-project.org/package=lsr
Nerstad, C. G., Richardsen, A. M., and Martinussen, M. (2010). Factorial validity of the Utrecht Work Engagement Scale (UWES) across occupational groups in Norway. Scand. J. Psychol. 51, 326–333. doi: 10.1111/j.1467-9450.2009.00770.x
Nishi, D., Kawashima, Y., Noguchi, H., Usuki, M., Yamashita, A., Koido, Y., et al. (2016). Resilience, post-traumatic growth, and work engagement among health care professionals after the great east Japan earthquake: a 4-year prospective follow-up study. J. Occup. Health 58, 347–353. doi: 10.1539/joh.16-0002-OA
O'Neill, O. A., and Rothbard, N. P. (2017). Is love all you need? The effects of emotional culture, suppression, and work-family conflict on firefighter risk-taking and health. Acad. Manag. J. 60, 78–108. doi: 10.5465/amj.2014.0952
Poulsen, M. G., Poulsen, A. A., Khan, A., Poulsen, E. E., and Khan, S. R. (2011). Work engagement in cancer workers in Queensland: the flip side of burnout. J. Med. Imaging Radiat. Oncol. 55, 425–432. doi: 10.1111/j.1754-9485.2011.02281.x
Ray, S. L., Wong, C., White, D., and Heaslip, K. (2013). Compassion satisfaction, compassion fatigue, work life conditions, and burnout among frontline mental health care professionals. Traumatology (Tallahass. Fla). 19, 255–267. doi: 10.1177/1534765612471144
R Core Team (2017). R: A Language and Environment for Statistical Computing (version 3.4.2) [Computer software]. Available online at: https://www.r-project.org/
Reijseger, G., Peeters, M. C. W., Taris, T. W., and Schaufeli, W. B. (2017). From motivation to activation: why engaged workers are better performers. J. Bus. Psychol. 32, 117–130. doi: 10.1007/s10869-016-9435-z
Revelle, W. (2017). psych: Procedures for Psychological, Psychometric, and Personality Research (R package version 1.7.8) [Computer software]. Available online at: https://cran.r-project.org/package=psych
Richardsen, A. M., Burke, R. J., and Martinussen, M. (2006). Work and health outcomes among police officers: the mediating role of police cynicism and engagement. Int. J. Stress Manage. 13, 555–574. doi: 10.1037/1072-5245.13.4.555
RStudio Team (2017). RStudio: Integrated Development for R (version 1.1.383) [Computer software]. Available online at: http://www.rstudio.com/
Schaufeli, W. B. (2017b). Work Engagement in Europe: Relations with National Economy, Governance, and Culture. Leuven: KU Leuven. Available online at: www.wilmarschaufeli.nl/publications/Schaufeli/472.pdf
Schaufeli, W. B., Bakker, A. B., and Salanova, M. (2006). The measurement of work engagement with a short questionnaire: a cross-national study. Educ. Psychol. Meas. 66, 701–716. doi: 10.1177/0013164405282471
Schaufeli, W. B., Bakker, A. B., and Van Rhenen, W. (2009). How changes in job demands and resources predict burnout, work engagement, and sickness absenteeism. J. Organ. Behav. 30, 893–917. doi: 10.1002/job.595
Schaufeli, W. B., Martinez, I. M., Marques-Pinto, A., Salanova, M., and Bakker, A. B. (2002a). Burnout and engagement in university students: a cross-national study. J. Cross. Cult. Psychol. 33, 464–481. doi: 10.1177/0022022102033005003
Schaufeli, W. B., and Salanova, M. (2007). “Work engagement: an emerging psychological concept and its implications for organizations,” in Managing Social and Ethical Issues in Organizations, eds S. W. Gilliland, D. D. Steiner, and D. P. Skarlicki (Greenwich, CT: Information Age Publishing), 135–177.
Schaufeli, W. B., Salanova, M., González-Romá, V., and Bakker, A. B. (2002b). The measurement of engagement and burnout: a two sample confirmatory factor analytic approach. J. Vocat. Behav. 3, 71–92. doi: 10.1023/A:1015630930326
semTools Contributors (2016). semTools: Useful Tools for Structural Equation Modeling (R package version 0.4-14) [Computer software]. Available online at: https://cran.r-project.org/package=semTools
Seppälä, P., Mauno, S., Feldt, T., Hakanen, J. J., Kinnunen, U., Tolvanen, A., et al. (2009). The construct validity of the Utrecht Work Engagement Scale: multisample and longitudinal evidence. J. Happiness Stud. 10, 459–481. doi: 10.1007/s10902-008-9100-y
Shimazu, A., Schaufeli, W. B., Kosugi, S., Suzuki, A., Nashiwa, H., Kato, A., et al. (2008). Work engagement in Japan: validation of the Japanese version of the Utrecht work engagement scale. Appl. Psychol. 57, 510–523. doi: 10.1111/j.1464-0597.2008.00333.x
Spontón, C., Medrano, L. A., Maffei, L., Spontón, M., and Castellano, E. (2012). Validation of the engagement questionnaire UWES for the population of workers of Córdoba, Argentina. Liberabit 18, 147–154.
Tomietto, M., Comparcini, D., Simonetti, V., Pelusi, G., Troiani, S., Saarikoski, M., et al. (2016). Work-engaged nurses for a better clinical learning environment: a ward-level analysis. J. Nurs. Manage. 24, 475–482. doi: 10.1111/jonm.12346
Vallières, F., McAuliffe, E., Hyland, P., Galligan, M., and Ghee, A. (2017). Measuring work engagement among community health workers in Sierra Leone: validating the Utrecht Work Engagement Scale. J. Work Organ. Psychol. 33, 41–46. doi: 10.1016/j.rpto.2016.12.001
Van Bogaert, P., Peremans, L., Van Heusden, D., Verspuy, M., Kureckova, V., Van de Cruys, Z., et al. (2017). Predictors of burnout, work engagement and nurse reported job outcomes and quality of care: a mixed method study. BMC Nurs. 16:5. doi: 10.1186/s12912-016-0200-4
van Gelderen, B. R., and Bik, L. W. (2016). Affective organizational commitment, work engagement and service performance among police officers. Polic. An Int. J. Police Strateg. Manag. 39, 206–221. doi: 10.1108/PIJPSM-10-2015-0123
Vazquez, A. C. S., Magnan, E., dos, S., Pacico, J. C., Hutz, C. S., and Schaufeli, W. B. (2015). Adaptation and validation of the Brazilian version of the Utrecht Work Engagement Scale. Psico-USF 20, 207–217. doi: 10.1590/1413-82712015200202
Veronese, G., and Pepe, A. (2014). Sense of coherence mediates the effect of trauma on the social and emotional functioning of Palestinian health providers. Am. J. Orthopsychiatry 84, 597–606. doi: 10.1037/ort0000025
Veronese, G., and Pepe, A. (2017). Sense of coherence as a determinant of psychological well-being across professional groups of aid workers exposed to war trauma. J. Interpers. Violence 32, 1899–1920. doi: 10.1177/0886260515590125
Veronese, G., Pepe, A., and Afana, A. (2016). Conceptualizing the well-being of helpers living and working in war-like conditions: a mixed-method approach. Int. Soc. Work 59, 938–952. doi: 10.1177/0020872814537855
Vogt, K., Hakanen, J. J., Brauchli, R., Jenny, G. J., and Bauer, G. F. (2016). The consequences of job crafting: a three-wave study. Eur. J. Work Organ. Psychol. 25, 353–362. doi: 10.1080/1359432X.2015.1072170
Xanthopoulou, D., Bakker, A. B., Demerouti, E., and Schaufeli, W. B. (2009). Reciprocal relationships between job resources, personal resources, and work engagement. J. Vocat. Behav. 74, 235–244. doi: 10.1016/j.jvb.2008.11.003
Xanthopoulou, D., Bakker, A. B., Kantas, A., and Demerouti, E. (2012). Measuring burnout and work engagement: factor structure, invariance, and latent mean differences across Greece and the Netherlands. Int. J. Bus. Sci. Appl. Manage. 7, 40–52. doi: 10.1080/09585192.2012.751438
Keywords: work engagement, rescue workers, UWES, reliability, validity evidence, measurement invariance
Citation: Sinval J, Marques-Pinto A, Queirós C and Marôco J (2018) Work Engagement among Rescue Workers: Psychometric Properties of the Portuguese UWES. Front. Psychol. 8:2229. doi: 10.3389/fpsyg.2017.02229
Received: 07 July 2017; Accepted: 08 December 2017;
Published: 22 January 2018.
Edited by:Courtney McKim, University of Wyoming, United States
Reviewed by:Alessandro Pepe, Università degli Studi di Milano Bicocca, Italy
Jesús Nicasio García Sánchez, Universidad de León, Spain
Copyright © 2018 Sinval, Marques-Pinto, Queirós and Marôco. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: João Marôco, email@example.com