Skip to main content

ORIGINAL RESEARCH article

Front. Psychol., 19 September 2019
Sec. Quantitative Psychology and Measurement

The Temporal Experience of Pleasure Scale (TEPS): Measurement Invariance Across Gender in Chinese University Students

\r\nHuan Zhou,Huan Zhou1,2Wanting LiuWanting Liu1Jie FanJie Fan1Jie XiaJie Xia1Jiang ZhuJiang Zhu1Xiongzhao Zhu,*Xiongzhao Zhu1,2*
  • 1Medical Psychological Center, The Second Xiangya Hospital, Central South University, Changsha, China
  • 2Medical Psychological Institute of Central South University, Changsha, China

The Temporal Experience of Pleasure Scale (TEPS) is a self-report instrument assessing pleasure experience. The present study aimed to confirm the factor model of the Chinese version of TEPS and test measurement invariance of the scale across gender in Chinese university students. Participants were 2977 (51% female) undergraduates aged from 16 to 27 years (Mean age = 18.9 years). Results indicated that the revised four-factor structure of the TEPS had acceptable fit in the total sample and in gender groups. Furthermore, configural, metric and partial scalar invariance across gender were established. Two of the items (item 4 and 8) demonstrated different intercepts and women scored higher than men on both items. With partial scalar invariance demonstrated, test of differences in latent means indicated that men had lower levels of pleasure when compared with women. To our knowledge, this study is the first attempt to test the measurement invariance of the TEPS across gender, which provides support for future research that involves examining hedonic capacity in Chinese men and women.

Introduction

Anhedonia, a reduced ability to experience pleasure in normally pleasurable situations (Harvey et al., 2007), is one of the negative symptoms of schizophrenia and is also a critical feature of depression related to social functioning in these patients (Kelley et al., 1999; Keshavan et al., 2011). Some studies have recently suggested that trait anhedonia can be identified in a non-clinical sample of young adults (Chan et al., 2012b; Li Z. et al., 2015; Wu et al., 2017). With the deepening research of anhedonia, studies both in animal and in humans (Berridge and Robinson, 2003; Kringelbach and Berridge, 2009) have indicated that pleasure experience is not a unitary construct, but can be parsed into two distinct subcomponents, namely anticipatory (or wanting) and consummatory (or liking) pleasure (Hollenbeck and Klein, 1987; Berridge and Robinson, 1998; Berridge and Kringelbach, 2008). The anticipatory pleasure factor captures the future-oriented pleasure, while the consummatory pleasure factor captures in-the-moment pleasure. To specifically capture these two distinguishing components, Gard et al. (2006) developed the Temporal Experience of Pleasure Scale (TEPS) based on theoretical models of anticipatory and consummatory pleasure. As they hypothesized, results in several large college-age samples supported the two-factor construct of trait disposition in experiences of pleasure. Subsequently, the TEPS has been widely used to measure hedonic capacity not only in people with psychosis-spectrum disorders (Mote et al., 2014; Yang et al., 2018) but also in healthy individuals (Da Silva et al., 2017; Li et al., 2019). It was also used in different countries such as America (Novacek et al., 2016), China (Li Y. H. et al., 2015), German (Simon et al., 2018), the United Kingdom (Ho et al., 2015), Spain (Gooding et al., 2016), and Australia (Geaney et al., 2015). All results showed adequate reliability and validity of the TEPS to assess the construct of pleasure. In addition, the measurement invariance of the TEPS across culture and time were examined (Li et al., 2018), supporting for its application. In 2012, Chan and colleagues examined the structure of TEPS in the Chinese context, with results finding that a four-factor model fit best in Chinese population. In this four-factor structure, the original two constructs of anticipatory and consummatory pleasure experience are further divided into abstract and contextual components. The abstract component refers to belief-oriented statements, whereas the contextual component refers to event-oriented statements. In other words, the Chinese version of TEPS consists of four distinct components, that is abstract anticipatory pleasure, contextual anticipatory pleasure, abstract consummatory pleasure, and contextual consummatory pleasure (Chan et al., 2012a; Li Z. et al., 2015).

Previous studies have suggested significant gender effects on pleasure or anhedonia. Several studies found that women seem to have higher level of pleasure experience than men. For example, Seidlitz and Diener (1998) revealed that women recalled positive events and memories more vividly than men. Gross and John (1995) found that women reported more positive emotions than men. Carver and White (1994) reported that women had higher trait reward responsiveness than men. While some research found that males demonstrated higher level of anhedonia than females, such as physical, anticipatory and consummatory anhedonia than females (Miller and Burns, 1995; Oishi et al., 2001; Gard et al., 2006). It is obvious that those gender differences in anhedonia have typically been reported based on observed scores using a mean difference method. However, there is ambiguity regarding whether differences in self-rated scale score means can be attributed to authentic trait differences between gender. Stated differently, without evidence to support measurement invariance, any inferences about gender differences are necessarily weak (Vandenberg and Lance, 2000).

To our best knowledge, validation of the measurement invariance of the Chinese version of TEPS across gender has not been carried out in any study. Demonstrating measurement invariance of the Chinese version of TEPS between male and female, will allow future researchers to use this scale confidently irrespective of the gender of adults under examination. Hence, the goals of this study are to examine the factor model of the TEPS and to test measurement invariance for the better-fitting factor model across gender in Chinese university students. If the scale is found to be invariant across gender, latent means will be tested to examine potential differences for men and women.

Materials and Methods

Procedures

Participants came from three universities of Hunan province in China between June and December, 2018. Convenient sampling techniques was used to recruit participants. Students were informed of the purpose and procedure of participating in this study through digital advertisement delivered by their counselor, who also helped to arrange the specific investigation time. Data were collected on paper during regular class break with two trained psychology student nearby. After signing the written informed consent, participants completed and returned the anonymous self-report questionnaires immediately. Ethics approval for this study was obtained from the Ethics Committee of the Second Xiangya Hospital of Central South University.

Participants

Of 3066 undergraduates who agreed to take part in the study, 17 (0.6%) participants answered less than 90% of all items of the TEPS, 62 (2.0%) participants provided a same answer to every item and 10 (0.3%) participants did not report gender, and were thus eliminated. The final analytic sample consisted of 2977 undergraduates, and was a nearly even mix of men (1456) and women (1521). Participants aged between 16 and 27 years old. The mean (standard deviation, SD) ages of the men and women were 18.87 (0.93) years and 18.94 (1.224) years, respectively.

Instruments

The Chinese Version of the Temporal Experience of Pleasure Scale

The TEPS (Gard et al., 2006) is a self-report instrument that assesses pleasure experience. The Chinese version of TEPS (Chan et al., 2012a) was used in this study. It is a revised version of the original 18-item scale, containing two additional items (“I love it when a baby snuggles into my arms” and “On the way to my first date with my beloved, I can hardly wait to see him/her”). According to Chan et al.’s (2012a) study, the Chinese version of TEPS consisted of four factors. Anticipatory abstract pleasure reflected the pleasure experienced in anticipation of something more abstract or broad in nature. Anticipatory contextual pleasure referred to pleasure experienced in anticipation of something that is more concrete in nature. Consummatory abstract pleasure was related to consummation of emotional experience of something that is more abstract in nature. And consummatory contextual pleasure was about consummation of emotional experience of something that is more concrete in nature. Participants response on a 6-point Likert scale rated from 1 (very false for me) to 6 (very true for me). A lower score indicates a higher anhedonia propensity. In this study, Cronbach’s alpha of the whole scale was 0.84, showing high internal consistency.

Data Analysis

All analyses were conducted using Mplus Version 7.3 (Muthén and Muthén, 1998–2012). Firstly, a series of confirmatory factor analysis (CFA) were performed to examine the two- and four-factor models in the total sample. By comparing the goodness-of-fit for these models the better dimensional structure of the TEPS in Chinese university students was determined. And then, CFA of the better model was performed in male and female samples simultaneously. As the assumption of normality was not supported based on the Shapiro-Wilk test (p < 0.001), all the measurement models were estimated using the maximum likelihood estimation with standard errors and mean-adjusted Chi-square test statistics (Brown, 2006; Dietrich et al., 2013; Petrowski et al., 2018). Since the χ2 statistic is sensitive to sample size, it was not used as the crucial index. This study used several other goodness-of-fit indices to evaluate the fit of the models to the data, including chi-square/degree of freedom (χ2/df), comparative fit index (CFI), Tucker–Lewis index (TLI), the Bayesian information criterion (BIC), and root mean square error of approximation (RMSEA). For χ2/df, values around 5 and lower indicate an acceptable or good fit of the model. The CFI and TLI values higher than 0.90 and 0.95 are suggesting acceptable and excellent fits to the data, respectively. In relation to RMSEA indices, values lower than 0.08 demonstrate overall acceptable fit, and values lower than 0.05 demonstrate excellent fit (Hu and Bentler, 1995; Kline, 2010). In addition, the 90% confidence interval of the RMSEA was examined: the upper bound of this confidence interval less than 0.10 are taken to indicate acceptable fit (Rossi et al., 2010).

After identification of the optimal model of the TEPS, several multiple-group confirmatory factor analyses were carried out to test the measurement invariance of this scale across gender. Because full configural invariance, partial metric or scalar invariance are necessary to compare latent means, this study examined configural invariance, metric invariance, and scalar invariance. The three nested steps (Chen, 2007; Little et al., 2007; van de Schoot et al., 2012) were conducted progressively: configural invariance to assess whether the factor structure is same across independent samples; metric invariance to test the model fit when the factor loading of variables are constrained to be equal in men and women; scalar invariance to examine the equivalence of items’ intercepts across gender. Statistically, the more restrictive model will be tested only after the invariance of the less restrictive model is confirmed.

When comparing relative fit of nested models, the evidence of invariance is ΔCFI ≤ 0.01 and a smaller BIC value (Cheung and Rensvold, 2002). A small difference between two nested models may lead to a significant change of χ2 when the sample size is large, so this study didn’t rely on the chi-square difference test. If partial scalar invariance is supported, the test of latent mean differences between male and female groups will be performed (Baumgartner and Steenkamp, 1998; Vandenberg and Lance, 2000; Cheung and Rensvold, 2002).

Results

Descriptive Statistics

Descriptive data and gender differences on scale scores are presented in Tables 1, 2. The TEPS total scores ranged from 25 to 120 (25–120 among males and 29–120 among females), with a mean (SD) of 77.75 (14.05) for males and 84.23 (14.63) for females. Sex difference on the total scale scores was statistically significant (μ = −12.255, p < 0.001). The present study observed that in the four-factor model, the female participants reported significantly higher scores than the male participants on contextual anticipatory pleasure, abstract consummatory pleasure, and contextual consummatory pleasure, while there was no significant difference on abstract anticipatory pleasure. In the two-factor model, men reported higher level of anhedonia than women, both on anticipatory and consummatory pleasure. Table 3 shows correlation of the 20 items of the Chinese version of TEPS. Table 4 shows the correlations among the factors in the total sample and separately for both gender groups. All correlations were statistically significant.

TABLE 1
www.frontiersin.org

Table 1. Descriptive data and gender differences on factors of TEPS.

TABLE 2
www.frontiersin.org

Table 2. Descriptive data and gender differences on items scores.

TABLE 3
www.frontiersin.org

Table 3. Correlation of the 20 items of the Chinese version of TEPS.

TABLE 4
www.frontiersin.org

Table 4. Correlations between factors in the total sample and sub group.

Single Group Confirmatory Factor Analyses

To determine which was the better fitting model, the hypothesized four-factor model was compared with the two-factor model by using CFI and Bayes information criterion indices (the model with the bigger CFI and smaller Bayes information criterion values is the better fitting one). The fit indices of the two-factor model were as follows: χ2(df = 151; p < 0.001) = 3093.005; CFI = 0.756; TLI = 0.723; RMSEA = 0.081 with an interval at 90% (0.078–0.083); and BIC = 18,7041.51. While Goodness of fit indices of the four-factor model were found as χ2(df = 146; p < 0.001) = 1563.794; CFI = 0.882; TLI = 0.862; RMSEA = 0.057 with an interval at 90% (0.055–0.060); and BIC = 18,5231.48. Because of the bigger CFI and smaller Bayes information criterion values of the four-factor model, the four-factor model was better than the two-factor model. As presented in Table 5, the standardized factor loadings of each item for the four-factor model of the TEPS were all above 0.30, ranging from 0.385 to 0.764.

TABLE 5
www.frontiersin.org

Table 5. Factor loadings of the 4-factor solution for the TEPS in the Chinese sample.

As presented in Table 6, in the total sample, results of the CFA showed that the four-factor model was narrowly acceptable although the CFI was slightly lower than 0.9. The modifications included adding correlations of the error variance between item 16 and item 17 of Contextual Consummatory (“When ordering something off the menu, I imagine how good it will taste” and “The sound of crackling wood in the fireplace is very relaxing”) and item 10 and item 11 of Contextual Anticipatory (“I get so excited the night before a major holiday I can hardly sleep” and “When I’m on my way to an amusement park, I can hardly wait to ride the roller coasters”)1. These modifications were decided based on the modification indices in Mplus output and consideration of substantive meaningfulness. Measurement error covariances between two items may be due to similar wording, content, or directionality. This situation applies to our case, occurring when multiple items have a degree of overlap in content and assess the same construct (Byrne, 2012). Thus, this study correlated these error terms and the fit of the model was improved considerably to acceptable. Similarly, initial CFA models for the TEPS were not acceptable in men and women. After the same items were modified, the fitting of the model also reached the proposed standard. In sum, the findings supported that the four-factor model was superior to the two-factor model. And the present study retained the four-factor model (with two error correlations) as the final one.

TABLE 6
www.frontiersin.org

Table 6. Goodness-of-fit indices for each model in total sample and sub group.

Measurement Invariance Across Gender

Measurement invariance evaluation was started with the model that had no gender-invariance constraints. As can be seen in Table 7, although TLI of the configural model was a little lower than 0.9, the rest of indices all met the requirements (χ2(288) = 1282.908, p < 0.001, CFI = 0.915, RMSEA = 0.048), suggesting that the configural invariance was supported. This configural model was then used as the baseline model to compare against the more restrictive measurement invariance models.

TABLE 7
www.frontiersin.org

Table 7. Fit statistics for measurement invariance models across gender.

Then the metric invariance model was examined, with item loadings being treated as invariant for men and women. When compared against the less-constrained models, the results of ΔCFI = 0.002 and a decrease of 86.79 in BIC value implied support for metric invariance across gender. Accordingly, the same item of the Chinese TEPS represents the same concept across university students with different gender.

On the basis of the previous two steps, the item intercepts were further constrained to be equal between men and women. However, this restriction resulted in worse model fit, because a ΔCFI = 0.02 was bigger than 0.01, and also improvements in BIC value was found. In sum, results above did not support full scalar invariance across gender. Therefore, we conducted further analyses to detect whether equal intercept constrain on some items could be released to obtain a partial scalar invariance model. Inspecting intercept differences on observed items showed that item 4 of abstract anticipatory pleasure and item 8 of contextual anticipatory pleasure had contributed to the significant change in the CFI value. As a result, this study examined a partial scalar model in which intercepts of all the items were fixed equal except item 4 and 8 were free to vary across groups. According to no significant worse on CFI and decrease on BIC from the metric model, partial scalar invariance established.

Finally, comparisons of factor means could be tested with no need for controlling non-invariance. In this study, the male group served as the reference group and factor means among male were constrained to zero. We tested the factor means difference by examining the estimated values of the latent means among the female with its standard error. On the basis of the partial scalar model, standardized factor mean differences between men and women were 6.072 (p < 0.001) on Abstract Anticipatory, 16.724 (p < 0.001) on Contextual Anticipatory, 8.405 (p < 0.001) on Abstract Consummatory, and 6.242 (p < 0.001) on Abstract Consummatory. Gender difference on the four factors were statistically significant, and men had lower levels on all of the four factors compared with women.

Discussion

The current study confirmed the factor structure, examined the measurement invariance of the TEPS in a sample of Chinese young adults, and explored gender difference on latent factors. This investigation contributes to the empirical research on the TEPS by providing the first evidence for the measurement invariance across gender.

First of all, results of our study are in accord with previous findings, showing that the TEPS has a four-factor structure in Chinese sample, which is better than alternative two-factor solutions (Chan et al., 2012a; Li Z. et al., 2015; Li et al., 2018). And the revised four-factor model of the TEPS provided an adequate fit to the data in the full sample as well as in each gender group. Chan et al.’s (2012a) study pointed out that the labels of “abstract” versus “contextual” appear appropriate for the anticipatory items, but do not seem to fit as well in distinguishing the two consummatory factors. In other words, the items on the “abstract” consummatory factor may refer to specific contextual pleasures and the idea of a consummatory pleasure may be also inherently contextual. Thus, abstract consummatory factor was positively and highly correlated with contextual consummatory factor, while correlation coefficient between abstract anticipatory factor and contextual anticipatory factor was relatively low. Consistent with the study of Chan et al. (2012a), the correlation between abstract anticipatory factor and abstract consummatory factor was stronger than that between abstract anticipatory factor and contextual anticipatory, which emphasized the importance of parsing anticipatory pleasure into abstract and contextual component. So did consummatory pleasure. It’s also necessary to classify consummatory pleasure into abstract and contextual component, given that the correlation between contextual anticipatory factor and contextual consummatory was stronger than between abstract consummatory factor and contextual consummatory factor.

Further analysis on measurement invariance tests suggested full configural and full metric invariance, and partial scalar invariance of the TEPS across gender. That is to say, the four-factor structure of the scale holds both in men and woman, the factor loading of each observed item on corresponding latent variable is equal between different sex groups, and the same degree of change of observed variable have the same meaning regardless of gender.

The determination of the scalar invariance suggested that the intercepts of each variable are invariant and have the same reference points across groups. However, the adapted TEPS generally did not convincingly support the full scalar invariance for gender. There existed two items (item 4 and 8) whose intercepts weren’t invariant across different gender groups. Women scored higher than men on both items. Item 4 (I look forward to a lot of things in my life) is about the pleasure anticipation, which is related to the future goals. Greene and DeBacker (2004) found that females have more future goals than males, which may help explain our results. Item 8 (When I think of something tasty, like a chocolate chip cookie, I have to have one) is related to the pleasure feelings responding to the sweets. Women with higher scores on item 8 in present study might be consistent with the previous findings that women appreciated sweetness more than males did (Katou et al., 2005; Sena-Esteves et al., 2018). Notably, no studies have examined the measurement invariance of the TEPS across gender in other cultural contexts, so it is not clear whether the non-invariant intercepts of item 4 and 8 exist only in Chinese male and female, which warrants future exploration. Our results supported full metric and partial scalar invariance which suggested that gender differences of pleasure experience could be reflected by comparing latent means but not the observed scores (Cheung and Rensvold, 2002). It worth noting that if gender differences were reported on item 4 and 8, researchers should be careful whether it could be attributed to authentic differences between genders or to measurement differences across gender because of the non-invariant intercepts of item 4 and 8.

On the four dimensions of the TEPS, our findings revealed that men reported lower levels of pleasure compared to women. In other words, men presented higher level of anhedonia, which was consistent with previous studies (Miettunen et al., 2010; Gooding and Pflum, 2014; Gooding et al., 2017; Jha et al., 2018). On abstract anticipatory pleasure, there was no significant difference of the observed means between men and women, whereas women had higher latent means than men. By reason of partial scalar invariance supported in this study, the mean difference of latent variables between groups cannot be represented by observed mean scores (Tucker et al., 2006). Thus, the difference in observed means might not represent the real difference across gender, which means it’s inappropriate to compare gender difference based on item scores without confirmation of measurement invariance. And this is exactly the significance of testing measurement invariance.

One of limitations in the present study was that we used a convenience sample of students from universities, so it remains to be determined whether the results could be generalizable to other adult groups who have different education level. Having no other related measures to analyze the construct validity of the instrument is another limitation of this study. This study examined the measurement invariance across gender of the Chinese version of the TEPS, but it still unknown whether other language versions of the TEPS are measurement invariant across gender. Future researches exploring factorial invariance of different language versions of the TEPS across gender are welcomed. In addition, the TEPS can be used in both clinical patients and healthy people. In this study, only undergraduates were included and no clinical samples were involved. Thus, measurement invariance of the TEPS across clinical status should be examined in the future.

Conclusion

The results of this study indicate that the presently developed four-factor model better represented the underlying structure of the TEPS in Chinese samples. Evidence supported configural, metric and partial scalar invariance of the TEPS across gender in a large sample of Chinese university students. And males had significant higher level of anhedonia than females. The evidence of partial rather than full scalar invariance suggests that difference comparisons should be conducted not using observed scores but latent means cautiously.

Data Availability

The raw data supporting the conclusions of this manuscript will be made available by the authors, without undue reservation, to any qualified researcher.

Ethics Statement

The studies involving human participants were reviewed and approved by the Ethics Committee of the Second Xiangya Hospital of Central South University. The patients/participants provided their written informed consent to participate in this study.

Author Contributions

HZ conceived and designed the study. XZ had full access to all the data in the study and took responsibility for the integrity of the data and the accuracy of the data analysis. JX and JZ collected and inputted data. HZ, WL, and XZ contributed to interpret the data. HZ wrote the first draft of the manuscript. HZ and JF revised the manuscript. All authors read and approved the final version.

Funding

This study was supported by the National Natural Science Foundation of China (Grant No. 81671341).

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

The authors thank all the study participants who participated in this work and school teachers who facilitated the current study.

Footnotes

  1. ^ Error correlation coefficient was −0.137 (p < 0.05) between item 16 and item 17, and −0.143 (p < 0.05) between item 10 and item 11. In this study, items 16 and item 17 both focus on in-the-moment experience in response to a specific sensory stimulus, and reflect Contextual Consummatory, while items 11 and item 10 both measure the pleasure experienced in anticipation of a positive or pleasurable stimulus and the response facing positive or pleasurable stimulus, and reflect Contextual Anticipatory. In the other word, item 16 and item 17 were worded similarly and assess similar content, which might create a residual correlation between them. This explanation also applies to the residual correlation between item 10 and item 11.

References

Baumgartner, H., and Steenkamp, J.-B. E. M. (1998). Assessing measurement invariance in cross-national consumer research. J. Consum. Res. 25, 78–90. doi: 10.1086/209528

CrossRef Full Text | Google Scholar

Berridge, K. C., and Kringelbach, M. L. (2008). Affective neuroscience of pleasure: reward in humans and animals. Psychopharmacology 199, 457–480. doi: 10.1007/s00213-008-1099-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Berridge, K. C., and Robinson, T. E. (1998). What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain Res. Brain Res. Rev. 28, 309–369. doi: 10.1016/s0165-0173(98)00019-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Berridge, K. C., and Robinson, T. E. (2003). Parsing reward. Trends Neurosci. 26, 507–513. doi: 10.1016/s0166-2236(03)00233-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Brown, T. A. (2006). Confirmatory Factor Analysis for Applied Research. New York, NY: Guilford Press.

Google Scholar

Byrne, B. M. (2012). Structural Equation Modeling with Mplus: Basic Concepts, Applications, and Programming. New York, NY: Routledge, Taylor & Francis.

Google Scholar

Carver, C. S., and White, T. L. (1994). Behavioral inhibition, behavioral activation, and affective responses to impending reward and punishment: the BIS/BAS scales. J. Pers. Soc. Psychol. 67, 319–333. doi: 10.1037//0022-3514.67.2.319

CrossRef Full Text | Google Scholar

Chan, R. C. K., Shi, Y.-F., Lai, M.-K., Wang, Y.-N., Wang, Y., and Kring, A. M. (2012a). The temporal experience of pleasure scale (TEPS): exploration and confirmation of factor structure in a Healthy Chinese sample. PLoS One 7:e35352. doi: 10.1371/journal.pone.0035352

PubMed Abstract | CrossRef Full Text | Google Scholar

Chan, R. C. K., Wang, Y., Yan, C., Zhao, Q., McGrath, J., Hsi, X., et al. (2012b). A study of trait anhedonia in non-clinical chinese samples: evidence from the chapman scales for physical and social anhedonia. PLoS One 7:e34275. doi: 10.1371/journal.pone.0034275

PubMed Abstract | CrossRef Full Text | Google Scholar

Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Struct. Equ. Model. Multidiscipl. J. 14, 464–504. doi: 10.1080/10705510701301834

CrossRef Full Text | Google Scholar

Cheung, G. W., and Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Struct. Equ. Model. Multidiscipl. J. 9, 233–255. doi: 10.1207/s15328007sem0902_5

PubMed Abstract | CrossRef Full Text | Google Scholar

Da Silva, S., Saperia, S., Siddiqui, I., Fervaha, G., Agid, O., Daskalakis, Z. J., et al. (2017). Investigating consummatory and anticipatory pleasure across motivation deficits in schizophrenia and healthy controls. Psychiatry Res. 254, 112–117. doi: 10.1016/j.psychres.2017.04.040

PubMed Abstract | CrossRef Full Text | Google Scholar

Dietrich, A., Ormel, J., Buitelaar, J. K., Verhulst, F. C., Hoekstra, P. J., and Hartman, C. A. (2013). Cortisol in the morning and dimensions of anxiety, depression, and aggression in children from a general population and clinic-referred cohort: an integrated analysis. The TRAILS study. Psychoneuroendocrinology 38, 1281–1298. doi: 10.1016/j.psyneuen.2012.11.013

PubMed Abstract | CrossRef Full Text | Google Scholar

Gard, D. E., Gard, M. G., Kring, A. M., and John, O. P. (2006). Anticipatory and consummatory components of the experience of pleasure: a scale development study. J. Res. n Pers. 40, 1086–1102. doi: 10.1016/j.jrp.2005.11.001

PubMed Abstract | CrossRef Full Text | Google Scholar

Geaney, J. T., Treadway, M. T., and Smillie, L. D. (2015). Trait anticipatory pleasure predicts effort expenditure for reward. PLoS One 10:e0131357. doi: 10.1371/journal.pone.0131357

PubMed Abstract | CrossRef Full Text | Google Scholar

Gooding, D. C., Chan, R. C. K., Zhou, H.-Y., Li, Z., and Cheung, E. F. C. (2017). The indirect assessment of social anhedonia in Chinese adolescents: preliminary findings. Psychiatry Res. 257, 418–423. doi: 10.1016/j.psychres.2017.08.007

PubMed Abstract | CrossRef Full Text | Google Scholar

Gooding, D. C., and Pflum, M. J. (2014). Further validation of the ACIPS as a measure of social hedonic response. Psychiatry Res. 215, 771–777. doi: 10.1016/j.psychres.2013.11.009

PubMed Abstract | CrossRef Full Text | Google Scholar

Gooding, D. C., Pflum, M. J., Fonseca-Pedero, E., and Paino, M. (2016). Assessing social anhedonia in adolescence: the ACIPS-A in a community sample. Eur. Psychiatry 37, 49–55. doi: 10.1016/j.eurpsy.2016.05.012

PubMed Abstract | CrossRef Full Text | Google Scholar

Greene, B. A., and DeBacker, T. K. (2004). Gender and orientations toward the future: links to motivation. Educ. Psychol. Rev. 16, 91–120. doi: 10.1023/B:EDPR.0000026608.50611.b4

CrossRef Full Text | Google Scholar

Gross, J. J., and John, O. P. (1995). Facets of emotional expressivity: three self-report factors and their correlates. Pers. Indiv. Diff. 19, 555–568. doi: 10.1016/0191-8869(95)00055-b

CrossRef Full Text | Google Scholar

Harvey, P. O., Pruessner, J., Czechowska, Y., and Lepage, M. (2007). Individual differences in trait anhedonia: a structural and functional magnetic resonance imaging study in non-clinical subjects. Mol. Psychiatry 12, 767–775. doi: 10.1038/sj.mp.4002021

PubMed Abstract | CrossRef Full Text | Google Scholar

Ho, P. M., Cooper, A. J., Hall, P. J., and Smillie, L. D. (2015). Factor structure and construct validity of the temporal experience of pleasure scales. J. Pers. Assess. 97, 200–208. doi: 10.1080/00223891.2014.940625

PubMed Abstract | CrossRef Full Text | Google Scholar

Hollenbeck, J. R., and Klein, H. (1987). Goal commitment and the goal-setting process: problems, prospects, and proposals for future research. J. Appl. Psychol. 72, 212–220. doi: 10.1037//0021-9010.72.2.212

CrossRef Full Text | Google Scholar

Hu, L.-T., and Bentler, P. M. (1995). “Evaluating model fit,” in Structural Equation Modeling: Concepts, Issues, and Applications, ed. R. H. Hoyle, (Thousand Oaks, CA: Sage Publications, Inc), 76–99.

Google Scholar

Jha, M. K., Miller, A. H., Minhajuddin, A., and Trivedi, M. H. (2018). Association of T and non-T cell cytokines with anhedonia: role of gender differences. Psychoneuroendocrinology 95, 1–7. doi: 10.1016/j.psyneuen.2018.05.017

PubMed Abstract | CrossRef Full Text | Google Scholar

Katou, Y., Mori, T., and Ikawa, Y. (2005). Effect of age and gender on attitudes towards sweet foods among Japanese. Food Qual. Prefer. 16, 171–179. doi: 10.1016/j.foodqual.2004.04.012

CrossRef Full Text | Google Scholar

Kelley, M. E., van Kammen, D. P., and Allen, D. N. (1999). Empirical validation of primary negative symptoms: independence from effects of medication and psychosis. Am. J. Psychiatry 156, 406–411.

PubMed Abstract | Google Scholar

Keshavan, M. S., DeLisi, L. E., and Seidman, L. J. (2011). Early and broadly defined psychosis risk mental states. Schizophrenia Res. 126, 1–10. doi: 10.1016/j.schres.2010.10.006

PubMed Abstract | CrossRef Full Text | Google Scholar

Kline, B. R. (2010). Principles and Practice of Structural Equation Modeling. New York, NY: Guilford Press.

Google Scholar

Kringelbach, M. L., and Berridge, K. C. (2009). Towards a functional neuroanatomy of pleasure and happiness. Trends Cogn. Sci. 13, 479–487. doi: 10.1016/j.tics.2009.08.006

PubMed Abstract | CrossRef Full Text | Google Scholar

Li, S., Zhang, Y., Fan, J., Liu, W., Gan, J., He, J., et al. (2019). Patients with obsessive-compulsive disorder exhibit deficits in consummatory but not anticipatory pleasure. Front. Psychol. 10:1196. doi: 10.3389/fpsyg.2019.01196

PubMed Abstract | CrossRef Full Text | Google Scholar

Li, Y. H., Mou, X. D., Jiang, W. H., Yang, Z., Shen, X. H., Jin, Z. M., et al. (2015). A comparative study of anhedonia components between major depression and schizophrenia in Chinese populations. Ann. Gen. Psychiatry 14:24. doi: 10.1186/s12991-015-0061-3

PubMed Abstract | CrossRef Full Text | Google Scholar

Li, Z., Lui, S. S. Y., Geng, F.-L., Li, Y., Li, W.-X., Wang, C.-Y., et al. (2015). Experiential pleasure deficits in different stages of schizophrenia. Schizophrenia Res. 166, 98–103. doi: 10.1016/j.schres.2015.05.041

PubMed Abstract | CrossRef Full Text | Google Scholar

Li, Z., Shi, H.-S., Elis, O., Yang, Z.-Y., Wang, Y., Lui, S. S. Y., et al. (2018). The structural invariance of the temporal experience of pleasure scale across time and culture. Psych J. 7, 59–67. doi: 10.1002/pchj.207

PubMed Abstract | CrossRef Full Text | Google Scholar

Little, T. D., Card, N. A., Slegers, D. W., and Ledford, E. C. (2007). “Representing contextual effects in multiple-group MACS models,” in Modeling Contextual Effects in Longitudinal Studies, eds T. D. Little, J. A. Bovaird, and N. A. Card, (Mahwah, NJ: Lawrence Erlbaum Associates Publishers), 121–147.

Google Scholar

Miettunen, J., Veijola, J., Freimer, N., Lichtermann, D., Peltonen, L., Paunio, T., et al. (2010). Data on schizotypy and affective scales are gender and education dependent — study in the Northern Finland 1966 Birth Cohort. Psychiatry Res. 178, 408–413. doi: 10.1016/j.psychres.2008.07.022

PubMed Abstract | CrossRef Full Text | Google Scholar

Miller, L. S., and Burns, S. A. (1995). Gender differences in Schizotypic features in a large sample of young adults. J. Nervous Ment. Dis. 183, 657–661. doi: 10.1097/00005053-199510000-00007

PubMed Abstract | CrossRef Full Text | Google Scholar

Mote, J., Minzenberg, M. J., Carter, C. S., and Kring, A. M. (2014). Deficits in anticipatory but not consummatory pleasure in people with recent-onset schizophrenia spectrum disorders. Schizophrenia Res. 159, 76–79. doi: 10.1016/j.schres.2014.07.048

PubMed Abstract | CrossRef Full Text | Google Scholar

Muthén, L. K., and Muthén, B. O. (1998–2012.) Mplus, Version 7.3. Computer software. Los Angeles, CA: Muthén and Muthén. doi: 10.1016/j.schres.2014.07.048

PubMed Abstract | CrossRef Full Text | Google Scholar

Novacek, D. M., Gooding, D. C., and Pflum, M. J. (2016). Hedonic capacity in the broader autism phenotype: should social anhedonia be considered a characteristic feature? Front. Psychol. 7:666. doi: 10.3389/fpsyg.2016.00666

PubMed Abstract | CrossRef Full Text | Google Scholar

Oishi, S., Schimmack, U., and Diener, E. (2001). Pleasures and subjective well-being. Eur. J. Pers. 15, 153–167. doi: 10.1002/per.406

CrossRef Full Text | Google Scholar

Petrowski, K., Kliem, S., Sadler, M., Meuret, A. E., Ritz, T., and Brähler, E. (2018). Factor structure and psychometric properties of the english version of the trier inventory for chronic stress (TICS-E). BMC Med. Res. Methodol. 18:18. doi: 10.1186/s12874-018-0471-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Rossi, G., Elklit, A., and Simonsen, E. (2010). Empirical evidence for a four factor framework of personality disorder organization: multigroup confirmatory factor analysis of the Millon clinical multiaxial inventory - III personality disorder scales across Belgian and Danish data samples. J. Pers. Disord. 24, 128–150. doi: 10.1521/pedi.2010.24.1.128

PubMed Abstract | CrossRef Full Text | Google Scholar

Seidlitz, L., and Diener, E. (1998). Sex differences in the recall of affective experiences. J. Pers. Soc. Psychol. 74, 262–271. doi: 10.1037//0022-3514.74.1.262

PubMed Abstract | CrossRef Full Text | Google Scholar

Sena-Esteves, M. M., Mota, M., and Malfeito-Ferreira, M. (2018). Patterns of sweetness preference in red wine according to consumer characterisation. Food Res. Int. 106, 38–44. doi: 10.1016/j.foodres.2017.12.043

PubMed Abstract | CrossRef Full Text | Google Scholar

Simon, J. J., Zimmermann, J., Cordeiro, S. A., Maree, I., Gard, D. E., Friederich, H.-C., et al. (2018). Psychometric evaluation of the temporal experience of pleasure scale (TEPS) in a German sample. Psychiatry Res. 260, 138–143. doi: 10.1016/j.psychres.2017.11.060

PubMed Abstract | CrossRef Full Text | Google Scholar

Tucker, K. L., Ozer, D. J., Lyubomirsky, S., and Boehm, J. K. (2006). Testing for measurement invariance in the satisfaction with life scale: a comparison of Russians and North Americans. Soc. Indic. Res. 78, 341–360. doi: 10.1007/s11205-005-1037-5

CrossRef Full Text | Google Scholar

van de Schoot, R., Lugtig, P., and Hox, J. (2012). A checklist for testing measurement invariance. Eur. J. Dev. Psychol. 9, 486–492. doi: 10.1080/17405629.2012.686740

CrossRef Full Text | Google Scholar

Vandenberg, R. J., and Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: suggestions, practices, and recommendations for organizational research. Organ. Res. Methods 3, 4–70. doi: 10.1177/109442810031002

CrossRef Full Text | Google Scholar

Wu, H., Mata, J., Furman, D. J., Whitmer, A. J., Gotlib, I. H., and Thompson, R. J. (2017). Anticipatory and consummatory pleasure and displeasure in major depressive disorder: an experience sampling study. J. Abnorm. Psychol. 126, 149–159. doi: 10.1037/abn0000244

PubMed Abstract | CrossRef Full Text | Google Scholar

Yang, Z. Y., Xie, D. J., Zou, Y. M., Wang, Y., Li, Y., Shi, H. S., et al. (2018). Prospection deficits in schizophrenia: evidence from clinical and subclinical samples. J. Abnorm. Psychol. 127, 710–721. doi: 10.1037/abn0000382

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: measurement invariance, anhedonia, TEPS, gender, confirmatory factor analysis

Citation: Zhou H, Liu W, Fan J, Xia J, Zhu J and Zhu X (2019) The Temporal Experience of Pleasure Scale (TEPS): Measurement Invariance Across Gender in Chinese University Students. Front. Psychol. 10:2130. doi: 10.3389/fpsyg.2019.02130

Received: 29 May 2019; Accepted: 02 September 2019;
Published: 19 September 2019.

Edited by:

África Borges, University of La Laguna, Spain

Reviewed by:

Rubén García-Sánchez, Universidad Europea de Madrid, Spain
Eldad Davidov, University of Cologne, Germany

Copyright © 2019 Zhou, Liu, Fan, Xia, Zhu and Zhu. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Xiongzhao Zhu, xiongzhaozhu@csu.edu.cn

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.