- General Education Centre, Guangzhou Academy of Fine Arts, Guangzhou, China
Introduction: Epistemic emotion is a significant concept in education, but traditional scales rarely focus on the status of epistemic emotions in intercultural issues. Additionally, cultural identity and critical thinking are vital in navigating the complexities inherent in intercultural contexts. Existing measures of critical thinking and cultural identity seldom consider the influence of emotions. The EpiCT-CI Scale, developed in this research, seeks to bridge this gap by measuring how epistemic emotions influence critical thinking and cultural identity in intercultural settings.
Method: Developing and validating the EpiCT-CI Scale combines qualitative and quantitative methods. Study 1 collected data from students’ comments, judgments, and narrations about critical thinking during COVID-19. Study 2 focused on the emotional experiences of constructing cultural identity by reading, analyzing, and writing about cultural issues. The data from Studies 1 and 2 are analyzed in NVivo 15.0. The original EpiCT-CI Scale is validated through SPSS 20.0 and Amos 29.0 in Study 3.
Results: The results from Studies 1 and 2 indicate that epistemic emotions are a blend of neutral, positive, and negative states, rather than simple linear progressions. The initial 52-item scale underwent a thorough evaluation, modification, and validation process in Study 3, resulting in a four-dimensional 19-item EpiCT-CI Scale, which represents four groups of epistemic emotions: joy in critical cultural inquiry, boredom in critical cultural reflection, curiosity in cultural identity reflection, and distress in cultural adaptation. The EpiCT-CI Scale provides an effective tool for assessing epistemic emotions in cultural identity constructions and critical thinking applications.
1 Introduction
Emotion is generated by understanding experiences, beliefs, values, and imagination. It is not merely a physical or psychological phenomenon but is closely related to the cultural background and is profoundly influenced by cultural rules, language, and social practices (Boellstorff and Lindquist, 2004; Kotchemidova, 2010). Epistemic emotions can be considered as emotions about learning, which play a critical role in regulating how people engage with information, especially when encountering cognitive dissonance or uncertainty (Pekrun et al., 2017). When dealing with cultural challenges, epistemic emotion encompasses the features of emotions, but in a more cognitive way. When addressing cultural diversity, epistemic emotion, cultural identity, and critical thinking are interconnected. Integrating epistemic emotions, critical thinking, and cultural identity development would be a crucial approach for understanding how university students can survive and thrive in the complexities of cultural diversity. This research aims to develop a measurement to investigate the status of epistemic emotions. The EpiCT-CI Scale can measure art students’ status of epistemic emotion when actively applying critical thinking to cultural identity constructions in challenging cultural issues. It provides a valuable tool to assess how students manage their epistemic emotional responses when engaging in multicultural situations.
2 Literature review
2.1 The epistemic emotion and cultural identity
Epistemic emotions can be defined as emotions “that are caused by cognitive qualities of task information and the processing of that information” (Muis et al., 2015b), which arise when individuals focus on knowledge and knowing (Muis et al., 2015a). Emotions are a wide range of physical and psychological phenomena. Scarantino (2025) divides the emotions into eight groups: “protecting the body (e.g., pain, fear), improving decision-making and goal achievement (e.g., desire, stress, surprise), fostering skills development (e.g., amusement, interest), improving communal living and interpersonal relations (e.g., guilt, empathy, gratitude), creating and upholding systems of norms (e.g., embarrassment), moving within status/positional hierarchies (e.g., envy, pride), contributing directly to wellbeing (e.g., pleasure, hope), and procreating and caring for the offspring (e.g., love, compassion).” According to Muis et al. (2015b), epistemic emotions mainly “include, but are not limited to, surprise, curiosity, enjoyment, confusion, anxiety, frustration, and boredom.” Besides, Pekrun et al. (2017) propose the Epistemically related Emotion Scales (EES) to outline the other 16 specific epistemic emotions, which include interested, anxious, inquisitive, dull, amazed, worried, happy, muddled, irritated, monotonous, excited, astonished, nervous, joyful, and puzzled. These emotions are related to the degree of conflicts, challenges, and puzzles in “acquiring knowledge about the world and the self (Pekrun et al., 2017).”
Epistemic emotions can be considered multi-dimensional constructions. Based on the Control-Value Theory (CVT, Pekrun, 2006), the epistemic beliefs and self-regulated learning model (Muis, 2007), and the integrated model of epistemic beliefs (Bendixen and Rule, 2004), Muis et al. (2015b) propose the integrative model of epistemic beliefs, epistemic emotions, and learning. This model suggests that epistemic beliefs influence the generation of epistemic emotions, affecting learning strategies and outcomes. Muis et al. (2018) further indicate that epistemic emotions in self-regulated learning can be aroused by five factors: “control, value, novelty, complexity of information, and the achievement or impasse of an epistemic aim.” When engaging in learning, the individual’s perceptions of the task, information, and target are significant for epistemic emotions. The perception of control and value can be considered as a sense of task assessment that predicts the various epistemic emotions, such as joy, anxiety, or boredom; the perception of novelty and information complexity can be viewed as the information evaluation that triggers the surprise, curiosity or confusion; the perception of achievement or impasse of an epistemic aim predicts enjoyment or frustration.
Emotions are crucial in forming and developing identity; identity also significantly influences emotional responses. Identity is an active, self-constructed “being” process that can vary depending on individual perspectives (Berzonsky and Papini, 2014; Berzonsky, 2016; Berzonsky and Kinney, 2019). A strong commitment to one’s identity can enhance a sense of pride, but it may also result in anxiety when expectations are not fulfilled (Mackenzie, 2002). Identity is a “creation” that involves a process of self-driven actions (Berzonsky, 2016). Positive psychology views identity construction as a developmental process that involves behaviors such as exploration, reflection, and negotiation. Waterman (2015) summarizes identity development into four dimensions: “(a) exploration in breadth, (b) exploration in depth, (c) reconsideration of commitment, and (d) ruminative exploration.” In this process, individuals experience varying degrees of emotional fluctuation. The research focuses on the relationship between emotion and identity and mainly covers the different groups of people in intercultural contexts (Abbott and Burkitt, 2023; Gürsoy, 2023; Derakhshan et al., 2023; Karimpour et al., 2024; Yoshida, 2024) and educational settings (Arslan, 2023; Kettunen et al., 2023; Yazan, 2023; Kang, 2024; Fisher et al., 2024; Wang et al., 2021). These studies indicate that identity construction involves the multi-dimensional ongoing process by which individuals form and refine their sense of self, including emotions, social roles, and beliefs.
Epistemic emotions and cultural identity are interconnected. Jameson (2007) defines cultural identity as “an individual’s sense of self derived from formal or informal membership in groups that transmit and inculcate knowledge, beliefs, values, attitudes, traditions, and ways of life.” The cultures, the changing nature of identity, and the different emotional expressions work together to form our unique story of cultural identity. Cultures have a multifaceted impact on emotion, intertwined with emotional recognition and expression, positive and negative emotions, cultural values and religious beliefs, or economic and political factors (Van Hemert et al., 2007). Boellstorff and Lindquist (2004) use the example of “shame” in Southeast Asian culture to illustrate the impact of the culture on individual emotional experiences and cultural identity. Epistemic emotions can influence an individual’s identity by affecting how they process and integrate new knowledge into their self-concept, and cultural identity also influences the pattern of epistemic emotions. Some studies indicate a complex interplay between epistemic emotions and cultural identity, such as the diverse elements influence the individuals’ epistemic beliefs and emotions in cultural and intercultural practices (Gottlieb, 2007; Odebiyi and Choi, 2022); or the construction of cultural identity also shapes the evaluation of knowledge (Mato, 1996; Tisdell, 2006; Bortolan, 2024; Padilla Cruz, 2024). Given the significant impact of epistemic emotions on cultural identity, it is essential to integrate critical thinking in addressing the challenges and difficulties that arise from cultural diversity.
2.2 The epistemic emotion, critical thinking, and cultural identity constructions
Critical thinking involves emotions in many ways, for it cannot function completely rationally. Critical thinking is the skill to observe, forecast, analyze, evaluate, infer, reflect, and reason to solve problems. It is purposeful and consists of solving problems, formulating inferences, calculating probabilities, and making decisions (Halpern, 2014). Stanovich and West (2000) claim that the thinking patterns of System 1 (emotional, fast, intuitive thinking) and System 2 (analytical, slow, critical thinking) are cooperating to work. When dealing with problems, a critical thinker should be one with “critical spiritedness” in mind, such as “love for truth, open-mindedness, fair-mindedness, self-confidence, and intellectual courage to describe what kind of person a critical thinker is” (Pettersson, 2020). Steinert et al. (2025) further state, “A genuine critical thinker is not only open to new empirical evidence but also actively seeks out perspectives that could destabilize their values and norms.” Critical thinking goes beyond mere reasoning and usually causes strong and challenging emotional experiences because being a critical thinker can overrun personal values and goals (Steinert et al., 2025). Emotions influence critical thinking directly or indirectly, for example, by enhancing emotional experiences to promote more profound reflection on complex issues (Bull and De Angeli, 2021), by creating an emotionally supportive environment to promote critical thinking skills (Zhang and Zhang, 2013; Danvers, 2016), or by providing psychological safety for critical thinking application (Candiotto and Slaby, 2022; Christodoulakis et al., 2023).
The interrelations between critical thinking and epistemic emotions are evident in adjusting beliefs. Epistemic emotions and epistemic beliefs are closely related (Pekrun et al., 2017). Pekrun et al. (2017) state that epistemic emotions serve “evolutionary-based purposes of acquiring knowledge about the world and the self” and share the same goal as epistemic belief. The integrative personal epistemology model developed by Bendixen and Rule (2004) involves three parts: epistemic doubt, epistemic volition, and resolution strategies, which explain how individuals create and adjust their epistemic beliefs in different environments and situations. This model offers a more holistic perspective on the elements that evoke epistemic emotions, such as cognitive abilities and cultural contexts. Additionally, Halpern (2014) proposes that developing the disposition for effortful thinking and learning is significant for applying critical thinking. A stronger belief in meaningful learning is associated with the more effective use of learning strategies (Shinogaya, 2008, 2011, 2018). Muis et al. (2015a,b) suggest a positive correlation between epistemic emotions and critical thinking. When engaging in the learning process, the individuals “who believe that knowledge is simple, certain, ……and passively constructed (i.e., less constructivist beliefs), may experience surprise, confusion, anxiety, frustration, and boredom, whereas those who believe that knowledge is complex, uncertain, justified through inquiry and critical thinking (i.e., more constructivist beliefs), may experience curiosity and enjoyment.” The scope of Halpern’s (2014) “disposition” about critical thinking can also be comprehended as the “more constructivist beliefs (Muis et al., 2015a,b), which represent the attitudes and beliefs about the importance of questioning assumptions, the value of diverse perspectives, and the necessity of reflective thinking.
Moreover, the interplays between critical thinking, cultural identity, and epistemic emotions are reflected in information processing. Epistemic emotions emerge from “information-oriented appraisals about the alignment or misalignment between new information and existing beliefs, existing knowledge structures, or recently processed information (Muis et al., 2018).” Cultural identity construction encompasses specific tasks that deal with different cultural information. As Dervin and Yuan (2022) state, cultural identity is “reflecting on themselves, others, and the world while interacting with them. “The epistemic emotions enhance the commitment to cultural identity. Trevors et al. (2016) state that when individuals encounter information that aligns with their cultural identity, they are more likely to experience positive epistemic emotions such as curiosity and interest. However, information contradicting their cultural identity can lead to negative emotions like confusion, anxiety, and frustration. Critical thinking enables individuals to reflect on their cultural affiliations by analyzing, evaluating, or reflecting (Collins, 2018; Sato and Horn, 2023; Peng, 2024). Studies on identity negotiation demonstrate that critical thinking is a transformative tool for overcoming cultural prejudices and systematic imbalances (Caldwell, 2012; Sheybani and Miri, 2019; An Le and Hockey, 2022). Epistemic emotions can either facilitate or hinder critical thinking in constructing cultural identity. Muis et al. (2021) state that confusion and anxiety can be positive predictors of critical thinking, while frustration is a negative predictor that leads to an excessive burden on the cognitive system and reduced effort to apply critical thinking. Thus, critical thinking is significant for helping individuals to manage the complexities of new or conflicting cultural information.
2.3 Measuring epistemic emotion, critical thinking, and cultural identity in social and cultural interaction
Epistemic emotions depend on dynamic learning situations. According to Pekrun et al. (2017), epistemic emotions can be identified not just in the academic setting of reading materials. Besides, how emotions affect task performance involves complex relationships with cognitive processes. Pekrun (2024) further indicates that the dimension of emotions (positive or negative) is not the only element influencing the learning outcome. The impact of emotions on task performance is achieved through the interaction of multiple mechanisms, such as “motivation, working memory, or modes of thinking.” Furthermore, emotions are associated with specific objects or situations in the external world rather than just internal physiological responses. As Whissell (2023) states, emotions are learned through various life experiences. According to Van Hemert et al. (2007), some cultures may encourage the expression of positive emotions, while others are more restrained in emotional expression. Some studies mainly explore the interwined relationships between emotions, behavior, and culture from the intercultural perspective (Evans et al., 2017; Lu et al., 2017; Mesquita et al., 2017; Gip et al., 2022; Dickter et al., 2025; Alhwaiti, 2024), or focus on emotional behavior measurement (Brown et al., 2025; Manzi et al., 2025; Quansah et al., 2024; You, 2025), cultural adaptability (Chan et al., 2024; Ebrahimabadi et al., 2024; Yang and Liu, 2025), and social problems (Ghorbanzadeh et al., 2023; Hogan and Barnes, 2024; Mesana et al., 2024; O’Keeffe, 2024). These findings suggest that emotional expressions and reactions are distinguished depending on the dynamic social and cultural contexts. Individuals’ epistemic emotions can be various in the same learning situations when dealing with cultural differences. Thus, measuring epistemic emotions requires a multifaceted approach considering cognitive ability and cultural context.
The measurement of epistemic emotions cannot be completely “emotional.” The self-report method used by Pekrun et al. (2017) lists the types of emotions involved in epistemic activities. Nevertheless, given the complexities of individuals’ rational and emotional responses to different cultures, this method may not be suitable for measuring epistemic emotions in specific cultural situations. Emotions change with situational impressions and identity expectations. According to Heise (1987), “An emotion qualifies an identity in a way that describes where the transient impression of a person is relative to the fundamental sentiment for the person’s identity.” Robinson et al. (2006) state that emotional “labels” that are culturally assigned indicate self-identity according to specific situations. These “labels” can be specified through three dimensions in social interactions: evaluation (good or bad), potency (powerful or weak), and activity (lively or weak). Moreover, according to Lively and Heise (2014), “An identity’s characteristic emotion can be viewed as the target emotion being sought by individuals enacting that identity,” indicating that emotions drive the construction and development of identity. In line with that, critical thinking is an “epistemically responsible procedure” for constructing critical identity (Marabini, 2022) in overcoming biases (Morton and Parsons, 2018), fostering critical cultural self-awareness (Cameron, 2023; Flake and Lubin, 2024), and helping individuals reflect on beliefs and behaviors in cultural adaptation (Ilyas, 2018; Kassis-Henderson et al., 2018; Morgan and Cieminski, 2023). These studies underscore the importance of critical thinking as a vital epistemic activity in constructing cultural identity. Consequently, integrating critical thinking and cultural identity should be considered when assessing epistemic emotions.
Furthermore, epistemic emotions are rarely included in critical thinking and cultural identity inventories. Measurements of critical thinking are various, such as the Watson-Glaser Critical Thinking Appraisal (WGCTA, Watson and Glaser, 1985) and the California Critical Thinking Disposition Inventory (CCTDI, Facione, 1989); other new inventories assess the attitude and belief about critical thinking, like the Critical Thinking Toolkit (CriTT, Stupple et al., 2017), the Questionnaire of Attitudes Towards Critical Thinking (QATCT, Manassero-Mas et al., 2022), and the Student-Educator Negotiated CT Dispositions Scale (SENCTDS, Quinn et al., 2020). Additionally, the inventories of identity and cultural identity are also abundant, such as Bicultural Identity Integration Scale (BIIS-1, Haritatos and Benet-Martı́nez, 2002), Multigroup Ethnic Identity Measure (MEIM, Phinney, 1992; Phinney and Ong, 2007), Ethnic Identity Scale (EIS, Umaña-Taylor et al., 2004), Self-Concept and Identity Measure (SCIM, Bogaerts et al., 2018), and Multigroup Ethnic & National Identity Measure (MENI, Maehler et al., 2019; Maehler et al., 2025). However, these measurements seldom contain epistemic emotions. Critical thinking application and cultural identity construction are significant in the learning process of coping with cultural differences. Therefore, in this research, the EpiCT-CI Scale is developed to offer a more comprehensive framework for exploring the complex relationships between emotions, cognition, and cultural contexts. By integrating critical thinking and cultural identity within the measurement of epistemic emotions, this scale explores how individuals’ evaluation of cultural information influences their epistemic emotions, highlighting the significant role of epistemic emotions in shaping the cognitive processes and developing cultural identity.
3 Materials and methods
3.1 Research aims
The research has three purposes. The first is to explore the related epistemic emotion in the process of comprehension, application, and reflection about critical thinking during COVID-19 in Study 1. The second is to investigate the epistemic emotions experienced by participants who conducted the task of reading and writing English articles in Study 2. The third purpose is to develop and validate the EpiCT-CI Scale. Combining the qualitative and quantitative methods, this research focuses on four research questions:
1. What kind of epistemic emotions are experienced by students during the comprehension, application, and reflection on critical thinking during the COVID-19 pandemic?
2. What epistemic emotions are experienced by EFL learners while reading and writing English articles?
3. How can the EpiCT-CI Scale be formed and developed based on the findings of Studies 1 and 2?
4. How can the EpiCT-CI Scale be validated?
3.2 Research design
This research employs a sequential QUAL→QUAN approach (Churchill, 1979; Creswell and Clark, 2017) to develop and validate the EpiCT-CI Scale. It includes three studies and utilizes both qualitative and quantitative analyses involving different groups of participants. Study 1 encouraged students to express perspectives and real-life experiences about how critical thinking had influenced their beliefs and actions when dealing with cultural issues exacerbated by COVID-19. Thirty participants’ essays were selected randomly for qualitative analysis on epistemic emotion. In Study 2, students were required to read two English articles before writing the essay. The narrations about epistemic emotion during the reading and writing task were submitted with the essay. Thirty-five participants’ narrations and essays were randomly selected for qualitative analysis. The item pool of the EpiCT-CI Scale was generated based on the results of Studies 1 and 2. In Study 3, the EpiCT-CI Scale was modified and validated.
3.3 Samples and data collection
Approximately 400 students from arts subjects and 600 from various disciplines in China were involved in this research study. Informed consent was obtained from participants before the research. In Study 1, qualitative data were collected from the writing assignments of 30 participants who were randomly selected among 300 students. In Study 2, students were required to submit narrations about epistemic emotions and writing assignments for the English class. The data from 35 participants were randomly selected to be analyzed in NVivo 15.0. Study 3 distributed the newly developed EpiCT-CI Scale among 800 students for validation.
3.4 Research tools
The research employs a variety of tools. In Studies 1 and 2, NVivo 15.0 analyzes the data from the selected writing assignment for college English courses. The qualitative data in Study 1 were taken from 30 essays about comprehension and reflection on the critical thinking application in COVID-19. In Study 2, two articles from the intercultural expert Roger Baumgarte were chosen as the reading materials (Baumgarte, 2016). After reading and writing, 35 randomly selected essays were analyzed. In Study 3, the EpiCT-CI Scale was refined and validated using SPSS 20.0 and AMOS 29.0.
3.5 The procedure of EpiCT-CI scale development and validation
The EpiCT-CI Scale is developed and validated through Studies 1, 2, and 3. The first phase of studies 1 and 2 involved identifying emotions by automatically coding. This initial step was crucial for understanding the map of individuals’ epistemic emotions on a macro level. The second phase was open coding, where the data was reviewed to generate keywords and phrases that emerged from the data. The third phase was axial coding, which categorized the child nodes regarding critical thinking application and cultural identity constructions. The final phase was selective coding, where the categories were continually integrated to form the core themes. The initial item pool was established based on child nodes and then classified according to the themes. In Study 3, after content validation, the scale was modified and validated through exploratory factor analysis (EFA) in SPSS 20.0 and confirmatory factor analysis (CFA) in AMOS 29.0. The scale’s criterion-related validity was examined through the Need for Cognition Scale (NFC) (18 items, Cacioppo et al., 1984) and the dimension of Openness in the Big Five Inventory (10 items, John et al., 2008).
4 Results
4.1 The development of the EpiCT-CI scale
4.1.1 The qualitative data analysis of epistemic emotions in critical thinking applications
Figures 1, 2 illustrate the epistemic emotions experienced by participants as they analyze and reflect on their experiences of applying critical thinking during COVID-19 (S1, S2,…, S30 represent the participants). As Figure 1 shows, the participants’ emotions identified automatically by NVivo 15.0 encompass neutral, mixed, positive, and negative emotions. Figure 2 demonstrates that each category of epistemic emotion-related activities is labeled as positive epistemic emotions (PEE) and negative epistemic emotions (NEE). Besides, according to Mendonça (2024), emotions have the nature of dynamic, multi-layered structures. Derived from the analysis of participants’ descriptions, related activities in applying critical thinking are also generated into different levels: EE-Clearly Related, EE-Contextually Related, and EE-Dependent on Assessment. EE-Clearly Related represents the activities that directly involve epistemic emotions in knowledge acquisition or evaluation; EE-Contextually Related represents the activities that are related to epistemic emotions only in specific contexts; EE-dependent on Assessment represents those activities that involve epistemic emotions depending on the assessment for the external or internal events. Furthermore, Quinn et al.’s (2020) SENCTDS clarifies the critical thinking dispositions into “reflection, attentiveness, open-mindedness, organization, perseverance, and intrinsic goal motivation.” These can be integrated into the epistemic activities of evaluating evidence and information, addressing cultural issues, and navigating challenging contexts. Therefore, the roles of critical thinking in cultural identity construction are categorized into three themes: “Identifying Cultural Differences in Problem-Solving,” “Evaluating the Unforeseeable Cultural Context,” and “Overcoming Cultural Biases in Social Structures.” Based on the involved epistemic emotions in each theme, 30 items of the EpiCT-CI Scale are established.
4.1.1.1 Identifying cultural differences in problem-solving
“Identifying Cultural Differences in Problem-Solving (ICDPS)” is vital for applying critical thinking to cultural challenges. Figure 2 and Table 1 illustrate that this theme includes EE-Clearly Related and EE-Dependent on Assessment.
The EE-Clearly Related activities are characterized by Critical Analysis (45), Cultural Exploration (27), and Reflection on Beliefs (28). These activities represent critical thinking applications, such as analyzing, recognizing, reflecting, and comprehending, which are associated with positive epistemic emotions (curiosity, enjoyment, interest, excitement) and negative epistemic emotions (stress, boredom). Items ICDPS1, ICDPS2, and ICDPS3 are based on these results. The EE-dependent on Assessment activities involve Acknowledging Cultural Impacts (26), Comparative Cultural Analysis (30), Contextual Interpretation (69), Cultural Identity Reflection (53), and Thinking Pattern Assessment (24). These activities represent the assessing, comparing, and verifying in critical thinking applications, which are associated with a mix of positive epistemic emotions (joy, confidence, desire, interest, surprise, excitement) and negative epistemic emotions (worry, confusion, anxiety). These epistemic emotions highlight the complexity of engaging with cultural differences, where individuals may experience enthusiasm or frustration in cultural identity reflection and in navigating the dynamic and multifaceted nature of cultural differences. Based on the findings, items ICDPS4, ICDPS5, ICDPS6, ICDPS7, and ICDPS8 are created.
Based on the theme ICDPS, eight EpiCT-CI scale items can be established as follows:
• ICDPS1. I’m curious about different cultures and eager to discover why they differ.
• ICDPS2. I think using critical thinking to analyze cultural differences is stressful.
• ICDPS3. When I reflect on the differences in cultural values, I am always excited about the new insights.
• ICDPS4. Using critical thinking makes me feel more confident in different cultural situations.
• ICDPS5. I am interested in analyzing why cultural differences happen.
• ICDPS6. I am confused when I critically analyze cultural differences.
• ICDPS7. I am surprised and excited about discovering new ways of thinking in Chinese culture.
• ICDPS8. I’m worried that I am confused about my reflection of Chinese culture.
4.1.1.2 Evaluating the unforeseeable cultural contexts
The theme “Evaluating the Unforeseeable Cultural Contexts (EUCC)” provides a structured approach to applying critical thinking in evaluating and analyzing cultural contexts. As Figure 2 and Table 2 show, this theme also encompasses two parent nodes related to epistemic emotion activities: EE-Clearly Related and EE-dependent on Assessment.
Table 2 shows that four activities are in EE-Clearly Related categories: Cultural Comparison (47), Historical Events Interpretation (13), Verification of Information (36), and Reflective Analysis (45), which represent the comprehensive approach for applying critical thinking in dealing with uncertain cultural challenges. These activities involve positive epistemic emotions (interest, curiosity, confidence), which drive individuals to engage deeply with information, concepts, and historical events in different cultural contexts. Conversely, negative epistemic emotions (fear, boredom) may hinder this process. The high number of nodes (47 for Cultural Comparison and 45 for Reflective Analysis) indicates the significance of these activities in the overall framework. Items EUCC1, EUCC2, EUCC3, and EUCC4 are based on these results.
The “EE-dependent on Assessment” category contains six activities that apply critical thinking in assessing and interpreting cultural contexts: Comparative Analysis (39), Critical Cultural Analysis (48), Cultural Value Evaluation (33), Cultural Concept Analysis (35), Cultural Identity Evaluation (20), and Cross-Cultural Reflective Analysis (27). The associated positive epistemic emotions (enjoyment, interest, excitement, desire, pride) reflect the intellectual enthusiasm that arises from applying critical thinking in cross-cultural evaluations, indicating an active motivation for reflective cultural analysis. In comparison, the negative epistemic emotions (anxiety, frustration, confusion, envy) indicate potential emotional challenges and resistance in the assessment process. The high number of nodes (39 for Comparative Analysis and 48 for Critical Cultural Analysis) shows the significance of these two activities in ensuring reliable cultural analysis. EUCC5, EUCC6, EUCC7, EUCC8, EUCC9, EUCC10, and EUCC11are established in this category.
Based on the theme EUCC, 11 EpiCT-CI scale items can be created as follows:
• EUCC1. I am confident as I critically evaluate the accuracy of cultural information.
• EUCC2. I am curious and interested in critically comparing the differences between cultures.
• EUCC3. I resist critically reflecting on cultural phenomena.
• EUCC4. I find critically interpreting historical events dull and uninteresting.
• EUCC5. I enjoy critically analyzing complex issues in different cultural values.
• EUCC6. Applying critical thinking in cultural comparison makes me anxious because it is challenging.
• EUCC7. I feel interested and excited when I use critical thinking to analyze the cultural concepts.
• EUCC8. I am frustrated because using critical thinking in cultural issues analysis is challenging.
• EUCC9. I feel envious when I critically reflect on the amazing aspects of other cultures.
• EUCC10. I feel proud to critically recognize the strengths of the impressive aspects of Chinese culture.
• EUCC11. I like to evaluate the value of different cultures critically.
4.1.1.3 Overcoming cultural biases in social structures
The theme “Overcoming Cultural Biases in Social Structures (OCBSS)” provides a comprehensive perspective for overcoming cultural biases. Figure 2 and Table 3 illustrate that three categories are included: EE-Clearly Related, EE-Contextually Related, and EE-dependent on Assessment.
As Table 3 demonstrates, the “EE-Clearly Related” involves the activities that are directly associated with overcoming cultural biases: Cross-Cultural Comparison (27), Critical Cultural Reflection (30), Autonomous Cultural Analysis (16), and Curiosity-Driven Inquiry (24), which represent the establishment of comprehensive insights into cultural biases through critical thinking. The related positive epistemic emotions (surprise, excitement, interest, curiosity, enjoyment) drive individuals to reflect on cultural issues and evaluate cultural bias critically. In contrast, negative epistemic emotions (boredom) obstruct the process of personal understanding of cultural biases. Table 3 shows that OCBSS1, OCBSS5, OCBSS6, OCBSS4, and OCBSS7 are created in this category.
The “EE-Contextually Related” includes three activities that are significant in overcoming cultural biases: Cultural Generalization Avoidance (27), Contextual Reflection (36), and Practical Experience Analysis (24). The associated positive epistemic emotion (curiosity) encourages individuals to recognize and analyze their cultural identities and practical experiences. In contrast, the negative epistemic emotions (confusion, boredom) represent the resistance to critical analysis of cultural identity commitment. Based on this result, OCBSS2, OCBSS3, and OCBSS8 are created.
The “EE-dependent on Assessment” also includes three activities that manage the negotiations of cultural identity: Cultural Identity Recognition (14), Critical Social Analysis (43), and Navigating Complexity in Cultural Cognition (26). The related positive epistemic emotions (confidence) suggest the emotion that enhances cultural identity comprehension through critical analysis, while the related negative epistemic emotions (stress, boredom) represent unpleasant experiences when overcoming the difficulties in understanding cultural influences on identity. OCBSS9, OCBSS10, and OCBSS11 are established in this category.
Based on the theme OCBSS, 11 items of the EpiCT-CI scale can be created as follows:
• OCBSS1. I feel surprised and excited when analyzing the unexpected similarities between Chinese and Western cultures.
• OCBSS2. I am confused when critically reflecting on how to avoid misunderstandings of other cultures.
• OCBSS3. It is boring to critically examine the cultural bias in our context.
• OCBSS4. I enjoy critically examining cultural phenomena to understand them truly.
• OCBSS5. It feels boring and unnecessary to critically evaluate information from different cultures.
• OCBSS6. It is fascinating to analyze and explore the causes of cultural differences.
• OCBSS7. I am curious to explore different cultural information and verify it myself.
• OCBSS8. I am curious about recognizing and exploring the interesting aspects of Chinese culture.
• OCBSS9. It feels boring to reflect on how culture shapes my behavior.
• OCBSS10. I believe critical thinking fosters understanding of diverse cultures and encourages social harmony.
• OCBSS11. It is stressful to apply critical thinking when analyzing the complexity of Chinese culture.
4.1.2 The qualitative analysis of epistemic emotions in cultural identity constructions
The result of Study 2 is shown in Table 4 and Figures 3, 4. Study 2 was conducted differently from Study 1. In a regular writing class of a college English course, participants are assigned to describe their opinions and feelings about friendship. Friendship is an interesting and relatable topic that represents the internal and external relationships between individuals and the world around them. The students are provided with two articles by Roger Baumgarte, which discuss how cultural differences influence friendships. One is a reading assignment in our English course textbook, which is excerpted from Roger’s book, Friends Beyond Borders. The other is a chapter titled “Interveners and Independents” from his research paper (Baumgarte, 2016). These two articles are at an average level of English, and participants are encouraged to express their specific emotions through reading and writing. Figure 3 is the sentiment coding from NVivo 15.0 for the emotions of 35 participants (S1, S2, S3…, S35). Compared with Figure 1, Figure 3 shows fewer negative emotions; most participants express positive, mixed, or neutral emotions. This result suggests that when participants relate cultural differences to real life, they think positively and neutrally.
Table 4 and Figure 4 illustrate the four main themes of epistemic emotion groups when dealing with cultural identity challenges: Cultural Identity Confusion in Cross-cultural Interactions, Curiosity about Cultural Identity Exploration, Frustration from Cultural Identity Collision, and Optimism in Cross-cultural Engagement. Each theme encompasses various epistemic emotions and activities, including thinking, analyzing, and evaluating cultural impacts. According to the research findings, 22 items are newly created based on every activity associated with each epistemic emotion, with the other two shared items from Study 1 (ICDPS6, EUCC5).
4.1.2.1 Cultural identity confusion in cross-cultural interactions
Table 4 and Figure 4 show that the theme of Cultural Identity Confusion in Cross-cultural Interactions (CICCI) encompasses four types of negative epistemic emotions: Anxiety, Confusion, Doubt, Stress, and Shock. Cross-cultural interactions would cause these mixed feelings of confusion.
S6: The article’s labeling of the intervenor and the independent as representations of Eastern and Western friendship confuses me because I have realized that friendship cannot always be defined rigidly as interventionist or independent. I also feel stressed, for it is anxious to imagine myself in a friendship with someone from a completely different culture.
S13: The article’s exploration of the boundaries of friendship across different cultures has sometimes confused me, such as in the interventionist style. Understanding complex cultural differences in friendships causes stress and may lead to inaccuracies in my writing and practical applications.
The parent node Anxiety includes Cultural Adaptation Challenges (10). Confusion involves Dealing with Different Cultural values (69). Doubt involves Dealing with Cultural Beliefs (20) and Cultural Identity Comprehension Overload (106). Stress involves Managing Cultural Stereotypes (69). Shock includes Coping with Cultural Shock and Identity (14). These epistemic emotions demonstrate the mixed feelings that participants experience in interpersonal interactions in different cultures when constructing cultural identity. Based on every activity associated with each epistemic emotion, items CICCI1, CICCI2, CICCI3, CICCI4, CICCI5, and CICCI6 of the EpiCT-CI Scale are created. Due to the epistemic emotion “Confusion” (Dealing with Different Cultural Values) in this theme being closely connected to “Confusion & Anxiety” (Comparative Cultural Analysis) in the theme ICDPS of Study 1, these two nodes are linked by the shared item CICCI2 (ICDPS6).
• CICCI1. I feel anxious when I struggle with cultural adaptation challenges.
• CICCI2. I am confused when trying to understand different cultural values.
• CICCI3. I doubt my ability to truly understand unfamiliar cultural traditions when overwhelmed by their complexity.
• CICCI4. It is confusing to deal with a variety of cultural beliefs.
• CICCI5. I feel stressed when dealing with stereotypes about a certain group.
• CICCI6. I was in shock at how different everything is from the culture I grew up in.
4.1.2.2 Curiosity about cultural identity exploration
As illustrated in Table 4 and Figure 4, the Curiosity about Cultural Identity Exploration (CCIE) theme comprises five positive epistemic emotions: Interest, Curiosity, Confidence, Excitement, and Surprise. The parent node Interest includes Cultural Identity recognition (27), Critically Examining Cultural Identity (42), and Critical Analysis of Cultural Differences (48). Curiosity includes Exploring Cultural Differences (32). Confidence includes Cultural Identity Negotiation (41). Excitement includes Uncovering New Discoveries (27). Surprise includes Finding New Cultural Perspectives (26). This theme primarily concerns the participants’ positive epistemic emotions when discovering, exploring, and evaluating new cultural knowledge and perspectives in constructing cultural identities.
S19: I have developed a strong interest in different cultural values. I am also excited by the various behavioral styles arising from cultural differences. Exploring these differences sparks my interest and desire to think.
S20: When reading this article, I became intensely interested in how cultural identity influences friendships. I was also surprised to learn for the first time about the concepts of ‘interferers’ and ‘independents.’ The idea of an “interferer” has challenged my conventional understanding of what constitutes a true friendship.
Items CCIE1, CCIE2, CCIE3, CCIE4, CCIE5, CCIE6, and CCIE7 are established in this theme.
• CCIE1. Understanding my cultural traditions is interesting and helps me understand who I am.
• CCIE2. Curiosity often drives me to explore the differences between various cultures.
• CCIE3. It is interesting to comprehend those unique values from different cultural backgrounds.
• CCIE4. It is amazing to discover new cultural phenomena because they give me new ways of thinking.
• CCIE5. I am confident in my ability to handle conflicts between different cultural identities.
• CCIE6. I am interested in critically examining the history and traditions of different cultures.
• CCIE7. It is exciting to find something new when encountering new cultural phenomena.
4.1.2.3 Frustration from cultural identity collision
Table 4 and Figure 4 show that the theme of Frustration from Cultural Identity Collision (FCIC) comprises five negative epistemic emotions: Disappointment, Depression, Frustration, Nervousness, and Stress, which reflect various kinds of annoyance when dealing with cultural challenges.
S11: I am disappointed that the article simplistically considers Western friendships as ‘independent’ style and Eastern friendships as ‘interfering’. I’ve seen many Western friends actively helping others in tough times, while some Easterners prefer independence. I also felt frustrated about conveying my message in English because my thoughts were lost in that language.
S34: I feel stressed by friendships involving cultural differences. I have experienced a typical case. A classmate has lived abroad since elementary school, and I’m nervous about our interaction for fear of offending due to these differences.
Disappointment includes Questioning Cultural Identity (22). Frustration includes Overcoming Language Barriers (15). Nervousness includes Managing Cultural Values Conflict (27). Stress includes Comparative Analysis of Cultural Phenomena (19). Depression includes Assessing Cultural Identity Uncertainty (35). According to Pekrun et al. (2017), frustration is a negative epistemic emotion like confusion. However, the findings of Study 2 reveal that these two emotions contain different epistemic activators in cross-cultural challenges. Items FCIC1, FCIC2, FCIC3, FCIC4, and FCIC5 are established in this theme.
• FCIC1. The prejudices some people have about Chinese culture depress me.
• FCIC2. I feel more relaxed when I interact with people who share the same cultural background as I do.
• FCIC3. I feel disappointed because some aspects of other cultures are not what I expected.
• FCIC4. I feel nervous when attempting to understand how people from different cultural backgrounds think.
• FCIC5. I feel frustrated when communicating in English because expressing myself is hard.
4.1.2.4 Optimism in cross cultural engagement
Table 4 and Figure 4 illustrate that Optimism in Cross-cultural Engagement (OCCE) represents the pleasure of dealing with cultural challenges, which comprises Enjoyment, Happy, Optimism, and Pride. Enjoyment includes Critical Analysis of Cultural Values (25). Happy includes Cultural Identity Recognition (26) and Learning Different Cultural Styles (19). Optimism includes Understanding Others’ Cultural Identity (28) and Embracing Cultural Diversity (25). Pride includes Cultural Awareness for Personal Growth (13). These epistemic emotions represent the participants’ delightful feeling, which reflects a sense of accomplishment and a deeper appreciation of their cultural identity. These positive experiences stem from overcoming cultural barriers in constructing cultural identity.
S8: I enjoy comparing how different cultures define friendship. My optimism about the feasibility of cross-cultural friendship directly influenced the ending of my writing. Cultural differences are not a barrier. I encourage everyone to accept the pluralistic view of friendship with an open mind.
S11. I am proud of my Eastern-style friendship, which is rich in kindness and collective strength. It demonstrates unique value and charm, making me proud of my culture. I am also optimistic that cultural differences are not the root of conflict, which fills me with confidence about cross-cultural friendships.
Items OCCE1, OCCE3, OCCE2, OCCE4, OCCE5, and OCCE6 are created based on the result. Because the epistemic emotion “Enjoyment” (Critical Analysis of Cultural Values) in this theme is aligned with “Enjoyment” (Cultural Value Evaluation) in the theme EUCC of Study 1, these two nodes are linked by the shared item OCCE6 (EUCC5).
• OCCE1. I appreciate the different values and lifestyles that arise from cultural diversity.
• OCCE2. I am proud to appreciate the values and traditions of different cultures, as they help me grow.
• OCCE3. I view cultural diversity optimistically because the differences between cultures enrich our perspectives.
• OCCE4. After critically rethinking traditional beliefs, I am happy to gain new insights into culture and tradition.
• OCCE5. I am happy to learn about different cultural lifestyles in this wonderful and interesting world.
• OCCE6. I enjoy critically analyzing challenges that arise from different cultural values.
4.2 The validation of EpiCT-CI scale
4.2.1 Content validity
The initial 52 EpiCT-CI Scale item pool consists of 30 items from Study 1 and 22 from Study 2. According to Mayer (2025), critical thinking skills and identity develop through cross-cultural conflicts, as individuals reflect on different perspectives and potential actions. Tables 1–3 in the findings of Study 1, 30 critical thinking items in the EpiCT-CI Scale are generated into three parts: ICDPS (8 items), EUCC (11 items), and OCBSS (11 items). Table 4 in the findings of Study 2 shows 24 items of cultural identity constructions that are classified into four parts: CICCI (5 items), CCIE (7 items), FCIC (5 items), and OCCE (5 items). Seven experts who had not participated in data collection or authorship evaluated the items in the content validation process. Four items (EUCC11, OCBSS9, CICCI4, CICCI5) are deleted after assessment, and 48 items are left for scale modification.
4.2.2 Scale modification
The EFA was conducted to refine the items and adjust the dimensional structure of the EpiCT-CI scale. After content validation, the initial EpiCT-CI Scale of 48 items is rated on a five-point Likert scale (1 = strongly disagree, 2 = disagree, 3 = neutral, 4 = agree, 5 = strongly agree). Three hundred and 10 questionnaires were distributed online to students of different subjects in an arts college. Females constituted the majority (n = 249, 80.3%), whereas males accounted for 19.7% (n = 61) of the sample. The distribution of respondents across nine undergraduate majors in the arts college is as follows: Product Design (n = 95, 30.6%), Fashion & Accessories Design (n = 13, 4.2%), Industrial Design (n = 18, 5.8%), Painting (n = 50, 16.1%), Science & Art (n = 37, 11.9%), Experimental Art (n = 21, 6.8%), Calligraphy (n = 9, 2.9%), Artworks Conservation and Restoration (n = 16, 5.2%), and Intelligent Interaction Design (n = 51, 16.5%).
Table 5 demonstrates that the reliability of this initial 48-item scale is excellent (Cronbach’s α = 0.955, standardized α = 0.961). Across every item, the “Cronbach’s Alpha if Item Deleted” remains within an extremely tight band, 0.954 < α < 0.956. The corrected item-total correlations span a considerably wider interval, with 24 items falling in the high-correlation band (0.60 ≤ r ≤ 0.68), 20 items in the moderate band (0.45 ≤ r < 0.60), and only four items in the lower band (r < 0.45). Thus, the scale mainly consists of items that are closely related to the total score, with no single item undermining the instrument’s high internal consistency.
Additionally, Table 5 shows that the mean scores for the items range from 2.89 to 4.26, indicating a generally positive response pattern. The skewness values for all items are within the range of −0.648 to 0.150, and the kurtosis values range from −1.011 to 0.443, indicating that the distribution of responses for each item is reasonably close to normal. The standard errors for skewness and kurtosis are 0.138 and 0.276, respectively, further supporting the stability of these descriptive statistics. Besides, the Harman single-factor method was applied to evaluate common method variance. An unrotated principal-axis factor explained 37.655% of the total variance, well below the 50% threshold (Kock et al., 2021). This indicates that common method bias is unlikely to threaten the validity of the findings.
After the reliability assessment, the data gathered from 310 samples were subjected to EFA. Given that the scale consists of 48 items, a sample size of 310 respondents is deemed adequate for EFA, adhering to the recommended guideline of 5–10 respondents per item (Rouquette and Falissard, 2011; Goretzko et al., 2021). As shown in Table 6, the Kaiser-Meyer-Olkin (KMO) (Kaiser, 1974) value remained at 0.946 after eight iterations of item refinement. Bartlett’s test of sphericity remained highly significant, χ2(528) = 6,481.942, p < 0.001. This result indicates that the questionnaire is suitable for factor analysis, confirming that the 33-item scale refinement was reasonable and robust.
The EFA was conducted using Principal Axis Factoring (PAF) with PROMAX rotation to identify underlying dimensions within a set of observed variables related to epistemic emotions. Among 48 items, 15 items (EUCC6, EUCC8, EUCC9, EUCC10, OCBSS2, OCBSS8, OCBSS11, CCIE3, CCIE5, CCIE7, FCIC1, FCIC2, FCIC5, OCEE3, OCCE4) were excluded due to having factor loadings below 0.40 and displaying high cross-loadings on multiple factors, leaving 33 items for subsequent confirmatory factor analysis (CFA). According to Finch (2013), constructing 2–4 factors in EFA is appropriate. Table 6 shows that four factors were formed in this process: Joy in Critical Cultural Inquiry (JCCI, 15 items), Boredom in Critical Cultural Reflection (BCCR, five items), Curiosity in Cultural Identity Reflection (CCIR, seven items), and Distress in Cultural Adaptation (DCA, six items). The scale demonstrates excellent internal consistency, with a Cronbach’s alpha 0.937 for the overall 33 items. The total variance explained by the four factors is 60.39%, suggesting that these factors capture a substantial portion of the variability in the observed variables. All 33 items considered for the CFA demonstrated factor loadings that exceeded 0.40. Thirty items exhibited loadings between 0.50 and 0.90, indicating their substantial contribution to the respective factors. Only three items had loadings ranging from 0.416 to 0.478, indicating that these items still meet the threshold suggested for retention when the sample size exceeds 200 (Sürücü et al., 2022). The reliability of the factors was further assessed using Cronbach’s α, with values exceeding 0.8 for Factors 1, 2, 3, and 0.748 for Factor 4, suggesting strong internal consistency across all factors.
Table 6 also illustrates that Factors 1 and 2 (JCCI, BCCR) contain most items from Study 1 (ICDPS, EUCC, OCBSS). Factors 3 and 4 (CCIR, DCA) comprise most items from Study 2 (CCIE, BCCR, FCIC, OCCE). This result indicates that Studies 1 and 2 are complementary sources for this scale. The data collection of the two studies has successfully converged into a unified four-factor structure. This alignment enhances the convergent validity of the instrument and emphasizes the complementary roles of Studies 1 and 2, which effectively capture the comprehensive range of epistemic emotions in diverse cultural contexts.
4.2.3 Confirmatory factor analysis (CFA) of the EpiCT-CI scale
The EpiCT-CI Scale of 33 items was validated through CFA. The questionnaires were distributed to another group of 486 students with different subjects, not limited to the art subjects. Two hundred thirty-one are male, accounting for 47.5%, while 255 are female, making up 52.5%. Specifically, the sample included students from both social sciences and STAM, such as law (n = 45 students, 9.3%), international relations (n = 22, 4.5%), finance (n = 132, 27.2%), art management (n = 10, 2.1%), art education (n = 13, 2.7%), product design (n = 28, 5.8%), mechanical engineering (n = 33, 6.8%), architecture (n = 17, 3.5%), educational technology (n = 29, 6.0%), computer science (n = 141, 29.0%), and visual communication design (n = 16, 3.3%). AMOS 29.0 was applied to test the 4-factor structure established in EFA (Table 6), running with a maximum likelihood estimator. Table 7 shows that the CFA yielded a four-factor structure with 19 items. Fourteen items (OCCE5, OCBSS10, OCBSS7, OCBSS6, OCBSS4, EUCC7, ICDPS2, CCIE4, OCCE2, CCIE6, CCIE3, CICCI1, ICDPS6, ICDPS8) were deleted in this process. Besides, the EpiCT-CI Scale is supposed to assess the epistemic emotions that individuals experience when actively applying critical thinking and exploring cultural identities. To ensure the scale maintains its intended directionality, the items in Factor 2 (BCCR) and Factor 4 (DCA), which reflect negative emotional valence, were reverse scored (DeVellis, 2017).
Table 7 shows that the retained items have standardized indicator loadings ranging from 0.637 to 0.803, exceeding the recommended threshold of 0.5–0.7 for strong relations with the associated constructs recommended by Hair et al. (2019). Additionally, each construct demonstrates strong internal consistency, with Cronbach’s α ranging from 0.787 to 0.909 and composite reliability (CR) from 0.790 to 0.915, all surpassing the 0.70 criterion. Average variance extracted (AVE) values range from 0.559 to 0.605, exceeding the 0.50 threshold (Hair et al., 2019), confirming convergent validity. Across all constructs, every retained indicator loaded decisively on its designated latent factor, with standardized coefficients ranging from λ = 0.637 to λ = 0.803, comfortably surpassing the 0.708 threshold Hair et al. (2019) recommended for high-quality measurement. At the construct level, JCCI (9 items, Cronbach’s α = 0.909, CR = 0.915, AVE = 0.560), BCCR (4 items, Cronbach’s α = 0.832, CR = 0.834, AVE = 0.564), CCIR (3 items, Cronbach’s α = 0.813, CR = 0.818, and AVE = 0.605) and DCA (3 items, Cronbach’s α = 0.787, CR = 0.790, and AVE = 0.559) confirm strong internal consistency and dimensional integrity. With unequal group sizes (Arts n = 67; non-arts n = 419), Tucker’s φ was additionally computed between the standardized 19-item/four-factor loadings obtained from the 310 arts students in the EFA sample and those derived from the 419 non-arts students in the CFA sample. The resulting value of 0.984 exceeds the ≥0.95 criterion for factorial congruence (Lorenzo-Seva and ten Berge, 2006), demonstrating that the basic factor structure is highly similar across the two independent, discipline-different groups despite their majors.
Table 8 shows the discriminant validity of the four-factor construction. The inter-constructed correlations among the associated factors reveal both positive (JCCI, CCIR: r = 0.617; BCCR, DCA: r = 0.473) and negative relationships (JCCI, BCCR: r = −0.624; JCCI, DCA: r = −0.581; BCCR, CCIR: r = −0.217; CCIR, DCA: r = −0.557). The square roots of the AVE for JCCI, BCCR, CCIR, and DCA range from 0.738 to 0.778, all exceeding the absolute values of the inter-construct correlations among the associated factors. This finding indicates that each dimension is distinct, confirming the discriminant validity for the CFA model.
As Table 9 demonstrated, the CFA result has a good model fit: χ2 = 385.748, df = 146, p < 0.001, χ2/df = 2.642, GFI = 0.917, RMSEA = 0.058, RMR = 0.066, SRMR = 0.0466, CFI = 0.947, NFI = 0.918, and NNFI = 0.938. With CFI ≥ 0.94, the standardized RMR (SRMR = 0.0466) is well below the 0.05 criterion for excellent fit (Hair et al., 2019). Besides, a one-factor model was specified as a stringent test of discriminant validity. The constrained solution yielded a χ2/df of 9.00, RMSEA = 0.128 (90% CI 0.122–0.135), SRMR = 0.099, and CFI = 0.731, all lying outside the thresholds recommended for adequate fit (χ2/df < 3, RMSEA ≤ 0.08, SRMR ≤ 0.08, CFI ≥ 0.90). The comparison between the one-factor and four-factor models shows compelling evidence for the discriminant validity of the scale.
A latent common-method variance (CMV) factor was also applied. The model converged successfully, yielding the following fit indices: χ2 = 250.633, df = 127, p < 0.001, χ2/df = 1.973, GFI = 0.947, RMSEA = 0.045, RMR = 0.045, CFI = 0.973, NFI = 0.947, NNFI = 0.963. All indices indicate good model fit. The CMV factor accounted for 7.2% of the total variance, below the 10% criterion commonly used to denote minimal common-method bias (Podsakoff et al., 2003).
Moreover, configural, metric, and scalar models were estimated for various groups of participants (total N = 486). For STEM (n = 236) versus non-STEM (n = 250) participants, the configural model exhibited excellent fit (CFI = 0.934, TLI = 0.923, RMSEA = 0.046); metric invariance was supported with ΔCFI = 0.002 and ΔRMSEA < 0.001. Full scalar constraints reduced CFI to 0.930 (ΔCFI = 0.004, ΔTLI = 0.004)—well below the 0.01 threshold, while RMSEA remained 0.045 (PCLOSE = 0.945), indicating close fit throughout. For male (n = 231) versus female (n = 255), the configural model exhibited excellent fit (CFI = 0.944, TLI = 0.934, RMSEA = 0.043); metric invariance was supported with ΔCFI = 0.003 and ΔRMSEA < 0.001. Full scalar constraints reduced CFI to 0.931 (ΔCFI = 0.013); after freeing the intercept of item Q19 (MI = 7.355), the partial scalar model achieved CFI = 0.934, ΔCFI = 0.010, and ΔTLI = 0.003, well below the 0.01 threshold, while RMSEA remained 0.044 with PCLOSE = 0.979. Thus, measurement invariance is further supported across gender (partial scalar) and disciplinary clusters (full scalar), demonstrating the EpiCT-CI scale’s applicability for cross-group comparisons.
Figure 5 demonstrates the CFA model that illustrates the potential relationship between factors JCCI, BCCR, CCIR, and DCA. Brown (2015) states that factor correlations less than 0.8 indicate acceptable discriminant validity. The result in Figure 5 revealed that the latent factor correlations lie between −0.22 and 0.62, and standardized item loadings range from 0.64 to 0.8, supporting both convergent and discriminant validity. Among the four latent dimensions of the EpiCT-CI scale, the strongest positive association emerges between JCCI and CCIR (r = 0.62), indicating that respondents who enjoy exploring cultural issues tend to be more inquisitive about their cultural identity. In contrast, JCCI correlates negatively with both BCCR (r = −0.62) and DCA (r = −0.58), suggesting that the more joy respondents experience during inquiry, the less boredom they feel during reflection and the less distress they report while adapting to new cultural contexts. BCCR shows a moderate positive correlation with DCA (r = 0.47), implying that boredom during reflection coincides with heightened adaptation distress, and a modest negative correlation with CCIR (r = −0.22), implying that boredom may be associated with identity-focused curiosity. Finally, CCIR correlates negatively with DCA (r = −0.56), thus greater curiosity about cultural identity is linked to lower levels of adaptation distress. All six correlations are significantly below 0.8 (Brown, 2015), confirming that the four factors encapsulate related yet distinct constructs.
4.2.4 Criterion-related validity
The EpiCT-CI Scale’s criterion-related validity is examined through the Need for Cognition Scale (NFC) (18 items, Cacioppo et al., 1984) and the dimension of Openness in the Big Five Inventory (10 items, John et al., 2008) (see Appendices A, B). The questionnaires were distributed online to 225 students from various disciplines. Cronbach’s Alpha was 0.938, indicating a high level of response consistency. Pearson correlation analysis was employed to assess the validity. Table 10 reveals that JCCI is positively related to CCIR (0.641), OPENNESS (0.599), and NFC (0.527), but negatively related to BCCR (−0.779) and DCA (−0.759), suggesting that individuals who find joy in critical cultural inquiry and cultural identity reflections are more likely to be open-minded and fond of discovery. BCCR and DCA are positively related to each other but negatively with JCCI, CCIR, OPENNESS (−0.454, −0.628), and NFC (−0.489, −0.461), indicating that higher levels of boredom and distress in cultural adaptation result in lower levels of joy, curiosity, and open-mindedness, which hinder the process of exploring cultural diversity and cultural identity development. Furthermore, discriminant validity was examined by AVE and Heterotrait-Monotrait Matrix (HTMT). All AVE values exceeded 0.48 and satisfied the Fornell–Larcker (1981) criterion (Fornell and Larcker, 1981), as the square root of each AVE was consistently greater than its highest correlation with any other construct. All HTMT ratios between the JCCI, BCCR, CCIR, DCA, OPENNESS, and NCF ranged from 0.65 to 0.75, well below the 0.85 threshold, indicating no problematic overlap (Henseler et al., 2015). The correlation coefficients are statistically significant at the 0.01 level. This robust correlation provides strong evidence supporting the EpiCT-CI Scale’s criterion-related validity.
5 Discussion and conclusion
The EpiCT-CI Scale fills the gap by integrating critical thinking and cultural identity into assessing epistemic emotions. It considers how epistemic emotions influence individuals to process cross-cultural information. Critical thinking is an important concept for decision making, but most measurements of critical thinking take it for granted that the decision-maker is hyper-rational. However, due to the multifaceted differences of individuals, the cognitive process functions with emotions together. If we shift our focus to economics, we can see that cultures and emotions play a crucial role in economic decision-making. Research conducted by Pertl et al. (2024), involving 70,000 participants across approximately 74 countries, demonstrates that specific cultural contexts influence the connection between emotions and decision-making processes. This indicates that cultural identity and critical thinking are significant for understanding the complexities of epistemic emotion in intercultural contexts. Furthermore, traditional instruments often fall short of accommodating the dynamic nature of specific emotional experiences. The self-report questionnaire for EES (Pekrun et al., 2017) significantly contributes to this field. Based on that, the EpiCT-CI Scale incorporates epistemic emotions into the specific context. It examines how emotions like curiosity drive deeper inquiry, how confusion indicates the need for perspective-taking, and how frustration may lead to defensive closure.
The development of the EpiCT-CI Scale is based on the findings of Studies 1 and 2. According to Creswell and Clark (2017), the QUAL→QUAN approach is suitable for exploring the “psychological phenomena that differ by culture,” which can produce findings that are difficult to obtain with a single method. Epistemic emotions are usually investigated after the epistemic activities by EES (Pekrun et al., 2017), such as science (Muis et al., 2015a,b) or mathematics (Muis et al., 2015a,b). However, research within education and intercultural studies seldom pays attention to the role of epistemic emotions in managing cultural issues. Furthermore, inventories for critical thinking and cultural identity often emphasize “what to do” more than “how you feel.” This research yields the measurement of epistemic emotions that can be more specific. The results of Studies 1 and 2 establish the range of epistemic emotion expressions when students apply critical thinking and deal with cultural identity constructions. The collected data in Study 1 are from students’ comments, judgments, and narration about critical thinking during COVID-19. COVID-19 is a macro angle to understand Chinese students’ views about coping with cultural dilemmas by applying critical thinking. The data of Study 2 are about the students’ emotional experiences of analyzing and writing about Western and Eastern friendship issues mentioned in the articles of intercultural expert Roger Baumgarte. Friendship is a micro angle to comprehend individuals’ cultural identity in interpersonal relationships (Peng, 2023). Additionally, epistemic activities cannot be limited to reading, and thus, Studies 1 and 2 illustrate possibilities for applying various kinds of learning activities, such as critical writing. By rooting item generation in specific cultural-critical episodes, the results of Studies 1 and 2 establish the basis of the EpiCT-CI Scale instrument that captures how individuals feel in epistemic activities, not merely how they remember feeling.
Besides, the results of Studies 1 and 2 are complementary in functioning to develop the EpiCT-CI Scale. By the automatic sentiment coding of NVivo 15.0, Figures 1, 3 demonstrate that each participant has a dynamic map that comprises mixed, neutral, positive, and negative emotions. This result indicates epistemic emotions blend neutral, positive, and negative states rather than linear or valence simple progressions. Individuals seek to validate their identities through information processing (Trevors et al., 2016). This creates a complex learning environment, where information confirming or challenging one’s identity can evoke positive or negative epistemic emotions. Therefore, developing a more nuanced inventory that reflects epistemic emotions when individuals actively apply critical thinking in cultural identity constructions is important. Tables 1–4 show the different epistemic activities in applying critical thinking and cultural identity constructions. The results of Study 1 generated 30 items that encompass various epistemic emotions in coping with cultural issues when applying critical thinking. However, the initial 30-item pilot scale derived only from Study 1 cannot yield clear and robust constructs in the EFA. Consequently, a second qualitative study (Study 2) was conducted. As Table 4 illustrates, the results of Study 2 generated 22 items. Table 6 shows that integrating the findings of Studies 1 and 2 has resulted in the stable four-factor EpiCT-CI Scale (33 items) with conceptual coherence and clarity. The result of EFA indicates that both Studies 1 and 2 contribute significantly to the scale.
The EpiCT-CI Scale reveals the epistemic emotions nature of “information-oriented appraisals (Muis et al., 2018). Naar (2025) suggests that emotions are defined as “appraisal,” indicating that various emotions interact with each other depending on the context. The results of EFA encompass four constructs: Joy in Critical Cultural Inquiry (JCCI), Boredom in Critical Cultural Reflection (BCCR), Curiosity in Cultural Identity Reflection (CCIR), and Distress in Cultural Adaptation (DCA), which identify the group of positive and negative epistemic emotions. Each construct represents the dynamic emotional experiences when individuals explore and reflect on their cultural identity. Table 6 shows that JCCI and CCIR include the positive epistemic emotions suggested by Muis et al. (2015b) (curiosity, interest, surprise, enjoyment) and those in EES (Pekrun et al., 2017) (excitement, joy, happiness). BCCR and DCA include the typical negative ones like anxiety, confusion, frustration, boredom (Muis et al., 2015b), and nervousness, fear, and worry (Pekrun et al., 2017). Additionally, Table 6 demonstrates some newly identified epistemic emotions (confidence, optimism, disappointment, shock, stress), which are still in the final version of the 19-item scale. Table 7 illustrates that the scale encompasses the positive (joy, confidence, interest, enjoyment, curiosity, desire, surprise, excitement, optimism) and negative epistemic emotions (boredom, fear, nervousness, disappointment, shock). Among these, optimism, confidence, and fear are closely associated with cultural factors (Van Hemert et al., 2007). The EpiCT-CI Scale broadens the connections between epistemic emotions, critical thinking, and cultural identity. By incorporating cultural factors into the study of epistemic emotions, this research provides a perspective that epistemic emotions do not simply accompany critical thinking but actively influence the ongoing interaction between cultural identities.
Furthermore, the EpiCT-CI scale sheds light on comprehending how epistemic emotion occurs through evaluating, assessing, and judging different cultural information in critical thinking application and cultural identity constructions. Epistemic emotions are academic emotions related to beliefs (Nakamura, 2023), but can also occur in broader contexts. Muis et al. (2015a, 2015b, 2018), Pekrun (2006, 2024), and Pekrun et al. (2017) already provide a comprehensive framework for exploring epistemic emotion. Based on that, the EpiCT-CI Scale bridges emotions, cognitive ability, and cultures. Cultures significantly influence emotions, leading to diverse responses to the same information. The identity construction is a procedure of overcoming the challenges that entail selecting from among unlimited possibilities and constructing from the elements chosen “something deemed to be of value (Waterman, 1984).” According to Muis et al. (2018), if perceived control of the information is low but value is high, learners may experience anxiety. Conversely, if both control and value of information are high, learners are more likely to experience joy. If both are low, individuals are more likely to experience boredom. Therefore, the ability to evaluate, understand, and assess the “high” or “low” value of information is significant for epistemic emotion. In Chinese cultures, The Book of Rites, a Confucian classic, defines that “Emotion is the manifestation of human nature in motion (情者, 性之动也).” This indicates that emotions are never static, but a living, kinetic concept ceaselessly shaped and re-interpreted by external and internal elements. By incorporating critical thinking skills, the EpiCT-CI scale examines how individuals engage with information, reflect on their beliefs, and navigate cultural contexts, ultimately contributing to a deeper understanding of epistemic emotions’ “appraisal” nature.
6 Limitation
This research has some limitations that should be mentioned to guide future research in this field. First, some of our participants were undergraduate students in an arts college, while others were from different subjects. These findings may not apply to other populations. Future research should validate the EpiCT-CI scale in postgraduate students or professionals who work in intercultural contexts, such as international school educators or multicultural team leaders. Second, the learning activities range from traditional classroom settings to online formats. This study’s qualitative analysis of epistemic emotions only focuses on reading and writing. However, as an academic emotion, the analysis of epistemic emotions can be more diverse, such as the discussion, presentation, or interaction online. Third, future research should validate the EpiCT-CI Scale across various cultures, as responses may differ for each item due to cultural differences. Moreover, epistemic emotions are influenced by various social and psychological factors, making them a crucial aspect of human learning. Future research should focus more on the social, cultural, and psychological aspects of the interplay between epistemic emotions, cognitive ability, and identity, which gives us a dynamic understanding of how humans evaluate and comprehend the world.
Data availability statement
The original contributions presented in the study are included in the article/Supplementary material, further inquiries can be directed to the corresponding author.
Ethics statement
The studies involving humans were approved by the Guangzhou Academy of Fine Arts Ethics Committee (KXLL2024001). The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.
Author contributions
YP: Project administration, Visualization, Supervision, Formal analysis, Methodology, Data curation, Software, Funding acquisition, Writing – review & editing, Investigation, Conceptualization, Resources, Writing – original draft, Validation.
Funding
The author(s) declare that no financial support was received for the research and/or publication of this article.
Conflict of interest
The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Generative AI statement
The author declares that Gen AI was used in the creation of this manuscript. Grammarly was used to check and correct grammatical errors in this manuscript for language refinement.
Any alternative text (alt text) provided alongside figures in this article has been generated by Frontiers with the support of artificial intelligence and reasonable efforts have been made to ensure accuracy, including review by the authors wherever possible. If you identify any issues, please contact us.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2025.1687003/full#supplementary-material
References
Abbott, O., and Burkitt, I. (2023). Moral identity, identification and emotion: a relational and interactive approach. Int. Rev. Sociol. 33, 326–348. doi: 10.1080/03906701.2023.2242648
Alhwaiti, M. (2024). Future anxiety, experience of stigma, emotion regulation and quality of life in caregivers of children with autism spectrum disorder: a cross-cultural perspective. Int. J. Dev. Disabil., 1–13. doi: 10.1080/20473869.2024.2434545
An Le, D. T. B., and Hockey, J. (2022). Critical thinking in the higher education classroom: knowledge, power, control and identities. Br. J. Sociol. Educ. 43, 140–158. doi: 10.1080/01425692.2021.2003182
Arslan, O. (2023). Investigating beginning mathematics teachers’ teacher identity development through emotion diaries. Int. J. Math. Educ. Sci. Technol. 54, 1541–1556. doi: 10.1080/0020739X.2023.2174055
Baumgarte, R. (2016). Conceptualizing cultural variations in close friendships. Online Read Psychol Cult 5, 5–8. doi: 10.9707/2307-0919.1137
Bendixen, L. D., and Rule, D. C. (2004). An integrative approach to personal epistemology: a guiding model. Educ. Psychol. 39, 69–80. doi: 10.1207/s15326985ep3901_7
Berzonsky, M. D. (2016). An exploration of personal assumptions about self-construction and self-discovery. Identity 16, 267–281. doi: 10.1080/15283488.2016.1229609
Berzonsky, M. D., and Kinney, A. (2019). Identity processing style and depression: the mediational role of experiential avoidance and self-regulation. Identity 19, 83–97. doi: 10.1080/15283488.2019.1567341
Berzonsky, M. D., and Papini, D. R. (2014). Identity processing styles and value orientations: the mediational role of self-regulation and identity commitment. Identity 14, 96–112. doi: 10.1080/15283488.2013.858228
Boellstorff, T., and Lindquist, J. (2004). Bodies of emotion: rethinking culture and emotion through Southeast Asia. Ethnos 69, 437–444. doi: 10.1080/0014184042000302290
Bogaerts, A., Claes, L., Verschueren, M., Bastiaens, T., Kaufman, E. A., Smits, D., et al. (2018). The Dutch self-concept and identity measure (SCIM): factor structure and associations with identity dimensions and psychopathology. Pers. Individ. Differ. 123, 56–64. doi: 10.1016/j.paid.2017.11.007
Bortolan, A. (2024). Epistemic emotions and self-trust. Phenomenol. Cogn. Sci. 23, 913–933. doi: 10.1007/s11097-024-10010-1
Brown, T. A. (2015). Confirmatory factor analysis for applied research. Second Edn. New York; London: The Guilford Press (Methodology in the Social Sciences).
Brown, A., Weiss, E., Suntheimer, N. M., Appiah, R., Aurino, E., and Wolf, S. (2025). Factorial and cultural validity of a social and emotional behavior measure in Northern Ghana. Appl. Dev. Sci. 29, 1–17. doi: 10.1080/10888691.2025.2474975
Bull, A. C., and De Angeli, D. (2021). Emotions and critical thinking at a dark heritage site: investigating visitors’ reactions to a first world war museum in Slovenia. J. Herit. Tour. 16, 263–280. doi: 10.1080/1743873X.2020.1804918
Cacioppo, J. T., Petty, R. E., and Feng Kao, C. (1984). The efficient assessment of need for cognition. J. Pers. Assess. 48, 306–307. doi: 10.1207/s15327752jpa4803_13
Caldwell, M. (2012). Inquiry into identity: teaching critical thinking through a study of race, class, and gender: students learn important lessons about themselves through the critical exploration of race, class, and gender. Middle Sch. J. 43, 6–15. doi: 10.1080/00940771.2012.11461815
Cameron, T. A. (2023). We are STEM: examining the significance and influence of counterspaces in the development of black girls’ STEM identity. J. Black Stud. 54, 613–634. doi: 10.1177/00219347231191228
Candiotto, L., and Slaby, J. (2022). Introduction: the role of emotions in epistemic practices and communities. Topoi 41, 835–837. doi: 10.1007/s11245-022-09839-5
Chan, J. X. M., Preece, D. A., Weinborn, M., Sauer-Zavala, S., and Becerra, R. (2024). Assessing emotion regulation across Asian and Western cultures: psychometric properties of three common scales across Singaporean and Australian samples. J. Pers. Assess. 106, 509–521. doi: 10.1080/00223891.2023.2292257
Christodoulakis, A., Kritsotakis, G., Linardakis, M., Sourtzi, P., and Tsiligianni, I. (2023). Emotional intelligence is more important than the learning environment in improving critical thinking. Med. Teach. 45, 708–716. doi: 10.1080/0142159X.2023.2193305
Churchill, G. A. (1979). A paradigm for developing better measures of marketing constructs. J. Mark. Res. 16, 64–73. doi: 10.1177/002224377901600110
Collins, K. H. (2018). Confronting color-blind STEM talent development: toward a contextual model for black student STEM identity. J. Adv. Acad. 29, 143–168. doi: 10.1177/1932202X18757958
Creswell, J. W., and Clark, V. L. P. (2017). Designing and conducting mixed methods research. Third Edn. Los Angeles: SAGE Publications, Inc.
Danvers, E. C. (2016). Criticality’s affective entanglements: rethinking emotion and critical thinking in higher education. Gend. Educ. 28, 282–297. doi: 10.1080/09540253.2015.1115469
Derakhshan, A., Karimpour, S., and Nazari, M. (2023). Making sense of emotion and identity construction through metaphors: a prompt-based study in an English as a foreign language context. J. Multiling. Multicult. Dev. 46, 2003–2017. doi: 10.1080/01434632.2023.2270951
Dervin, F., and Yuan, M. (2022). “Making sense of interculturality” in Reflecting on and with the ‘more-than-human’ in education: things for Interculturality. eds. F. Dervin and M. Yuan (Singapore: Springer Nature Singapore), 11–22.
DeVellis, R. F. (2017). Scale development: theory and applications. 4th Edn. Los Angeles: SAGE Publications.
Dickter, C. L., Chang, I., Burk, J. A., and Bravo, A. J.Cross-Cultural Addictions Study Team (2025). Autistic traits, emotion regulation, social anxiety, drinking to cope, and problematic alcohol use: a cross-cultural examination among young adults from seven countries. Subst. Use Misuse 60, 766–774. doi: 10.1080/10826084.2024.2447435
Ebrahimabadi, M., Rafiei, F., Büssing, A., and Nejat, N. (2024). Cross-cultural adaptation of the Persian version of “spiritual dryness scale” in patients with cancer: from low perception of sacredness of life to depressive symptoms and emotional exhaustion. Ment. Health Relig. Cult. 27, 150–164. doi: 10.1080/13674676.2023.2219621
Evans, R., Ribbens McCarthy, J., Kébé, F., Bowlby, S., and Wouango, J. (2017). Interpreting “grief” in Senegal: language, emotions and cross-cultural translation in a francophone African context. Mortality 22, 118–135. doi: 10.1080/13576275.2017.1291602
Facione, P. (1989). Critical thinking: a statement of expert consensus for purposes of educational assessment and instruction. (The Delphi Report). ERIC Document. 315, 1–112.
Finch, W. H. (2013). “Exploratory factor analysis” in Handbook of quantitative methods for educational research. ed. T. Teo (Rotterdam: Sense Publishers), 167–186.
Fisher, L. (2024). Language experiences, evaluations and emotions (3Es): analysis of structural models of multilingual identity for language learners in schools in England. International Journal of Multilingualism 21, 418–438. doi: 10.1080/14790718.2022.2060235
Flake, S., and Lubin, R. (2024). Proto-narrative: a critical exploration of the cultural identities held by black women in STEM. J. Ethnic Cult. Stud. 11, 178–192. doi: 10.29333/ejecs/2061
Fornell, C., and Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. J. Mark. Res. 18, 39–50. doi: 10.1177/002224378101800104
Ghorbanzadeh, D., Chandra, T., Akhmadeev, R., Yurievna Aleynikova, M., and Muda, I. (2023). Enhancing emotional culture through internal communication: impact on employee-organization relationships and employee advocacy. Int. J. Strateg. Commun. 17, 475–495. doi: 10.1080/1553118X.2023.2231435
Gip, H., The Khoa, D., Guchait, P., Fernando Garcia, R. L., and Pasamehmetoglu, A. (2022). Employee mindfulness and creativity: when emotions and national culture matter. Serv. Ind. J. 42, 383–411. doi: 10.1080/02642069.2022.2037570
Goretzko, D., Pham, T. T. H., and Bühner, M. (2021). Exploratory factor analysis: current use, methodological developments and recommendations for good practice. Curr. Psychol. 40, 3510–3521. doi: 10.1007/s12144-019-00300-2
Gottlieb, E. (2007). Learning how to believe: epistemic development in cultural context. J. Learn. Sci. 16, 5–35. doi: 10.1080/10508400709336941
Gürsoy, Y. (2023). Emotions and narratives of the spirit of Gallipoli: Turkey’s collective identity and status in international relations. Br. J. Middle East. Stud. 50, 1039–1057. doi: 10.1080/13530194.2022.2056432
Hair, J. F., Black, W. C., Babin, B. J., and Anderson, R. E. (2019). Multivariate data analysis. Eighth Edn. Andover, Hampshire: Cengage.
Halpern, D. F. (2014). Thought and knowledge: an introduction to critical thinking. Fifth Edn. New York: Psychology Press.
Haritatos, J., and Benet-Martı́nez, V. (2002). Bicultural identities: the interface of cultural, personality, and socio-cognitive processes. J. Res. Pers. 36, 598–606. doi: 10.1016/S0092-6566(02)00510-X
Heise, D. R. (1987). Affect control theory: concepts and model. J. Math. Sociol. 13, 1–33. doi: 10.1080/0022250X.1987.9990025
Henseler, J., Ringle, C. M., and Sarstedt, M. (2015). A new criterion for assessing discriminant validity in variance-based structural equation modeling. J. Acad. Mark. Sci. 43, 115–135. doi: 10.1007/s11747-014-0403-8
Hogan, A., and Barnes, N. (2024). ‘The cultural politics of emotion and mothers’ responsibility for school choice’. Gend. Educ. 36, 716–729. doi: 10.1080/09540253.2024.2354842
Ilyas, H. P. (2018). “The quest for critical thinking framework in ELT,” CELT: A Journal of Culture, English Language Teaching & Literature 18, 143–158. doi: 10.24167/celt.v18i2.685
Jameson, D. A. (2007). Reconceptualizing cultural identity and its role in intercultural business communication. J. Bus. Commun. 44, 199–235. doi: 10.1177/0021943607301346
John, O. P., Naumann, L. P., and Soto, C. J. (2008). “Paradigm shift to the integrative big-five trait taxonomy” in Handbook of personality: theory and research. eds. O. P. John, R. W. Robins, and L. A. Pervin. 3rd ed (New York: Guilford Press), 114–158.
Kaiser, H. F. (1974). An index of factorial simplicity. Psychometrika 39, 31–36. doi: 10.1007/BF02291575
Kang, D.-M. (2024). In the game of the name: Korean tertiary-level students’ English names in relation to native speakerism, identity, and emotions. J. Multiling. Multicult. Dev. 45, 1566–1580. doi: 10.1080/01434632.2021.1999964
Karimpour, S., De Costa, P., and Nazari, M. (2024). ‘Emotions in switching the code: contributions for English language teachers’ identity construction’. J. Multiling. Multicult. Dev., Forthcoming 1–13. doi: 10.1080/01434632.2024.2429413
Kassis-Henderson, J., Cohen, L., and McCulloch, R. (2018). Boundary crossing and reflexivity: navigating the complexity of cultural and linguistic identity. Bus. Prof. Commun. Q. 81, 304–327. doi: 10.1177/2329490618784893
Kettunen, A., Lassila, E. T., Lutovac, S., and Uitto, M. (2023). ‘Becoming a safe adult for pupils: emotions as part of first-year student teachers’ narrative identities told with photographs’. Eur. J. Teach. Educ. 48, 526–543. doi: 10.1080/02619768.2023.2211730
Kock, F., Berbekova, A., and Assaf, A. G. (2021). Understanding and managing the threat of common method bias: detection, prevention and control. Tour. Manag. 86:104330. doi: 10.1016/j.tourman.2021.104330
Kotchemidova, C. (2010). Emotion culture and cognitive constructions of reality. Commun. Q. 58, 207–234. doi: 10.1080/01463371003717892
Lively, K. J., and Heise, D. R. (2014). “Emotions in affect control theory” in Handbook of the sociology of emotions: Volume II. eds. J. E. Stets and J. H. Turner (Dordrecht: Springer Netherlands), 51–75.
Lorenzo-Seva, U., and ten Berge, J. M. F. (2006). Tucker’s congruence coefficient as a meaningful index of factor similarity. Methodology 2, 57–64. doi: 10.1027/1614-2241.2.2.57
Lu, M., Hamamura, T., Doosje, B., Suzuki, S., and Takemura, K. (2017). Culture and group-based emotions: could group-based emotions be dialectical? Cognit. Emot. 31, 937–949. doi: 10.1080/02699931.2016.1185394
Mackenzie, C. (2002). Critical reflection, self-knowledge, and the emotions. Philos. Explor. 5, 186–206. doi: 10.1080/10002002108538732
Maehler, D. B., Bhaktha, N., Pötzschke, S., and Ramos, H. (2025). Cultural identity development in adult forced migrants: the psychometrics of a measure in Arabic, Spanish, and Ukrainian. Int. J. Intercult. Relat. 105:102134. doi: 10.1016/j.ijintrel.2024.102134
Maehler, D. B., Zabal, A., and Hanke, K. (2019). ‘Adults’ identity in acculturation settings: the Multigroup Ethnic & National Identity Measure (MENI)’. Identity 19, 245–257. doi: 10.1080/15283488.2019.1641408
Manassero-Mas, M. A., Moreno-Salvo, A., and Vázquez-Alonso, Á. (2022). Development of an instrument to assess young people’s attitudes toward critical thinking. Think. Skills Creat. 45:101100. doi: 10.1016/j.tsc.2022.101100
Manzi, F., Peretti, G., Di Dio, C., Itakura, S., Kanda, T., Ishiguro, H., et al. (2025). Cross-cultural moral judgments and emotions in preschoolers: human and robot transgressions in Japan and Italy. Behav. Inf. Technol., 44, 3484–3500. doi: 10.1080/0144929X.2025.2477779
Marabini, A. (2022). “Critical thinking and epistemic value” in Critical thinking and epistemic injustice: an essay in epistemology of education. ed. A. Marabini (Cham: Springer International Publishing), 105–134.
Mato, D. (1996). On the theory, epistemology, and politics of the social construction of “cultural identities” in the age of globalization: introductory remarks to ongoing debates. Identities 3, 61–72. doi: 10.1080/1070289X.1996.9962552
Mayer, C.-H. (2025). “Emotions in intercultural conflicts in a study-abroad programme: experiences at semester at sea (SAS)” in International handbook of emotions: resourceful cultural perspectives. eds. C.-H. Mayer and E. Vanderheiden, vol. 2 (Cham: Springer Nature Switzerland), 221–234.
Mendonça, D. (2024). “A layered theory of emotion” in A Deweyan philosophical take on emotions: a layered theory. ed. D. Mendonça (Cham: Springer Nature Switzerland), 3–21.
Mesana, J. C. B., de Guzman, A. B., Valencia, C. Q., and Basister, J. P. C. (2024). Mapping online viewers’ social and non-social emotions using the lens of watching UNESCO cultural heritage sites’ travel vlogs. J. Herit. Tour. 19, 696–713. doi: 10.1080/1743873X.2024.2327433
Mesquita, B., Boiger, M., and De Leersnyder, J. (2017). Doing emotions: the role of culture in everyday emotions. Eur. Rev. Soc. Psychol. 28, 95–133. doi: 10.1080/10463283.2017.1329107
Morgan, T. L., and Cieminski, A. B. (2023). Critical reflection to develop transformative consciousness of racial differences. Prof. Dev. Educ. 49, 634–650. doi: 10.1080/19415257.2023.2178482
Morton, T. R., and Parsons, E. C. (2018). #BlackGirlMagic: the identity conceptualization of black women in undergraduate STEM education. Sci. Educ. 102, 1363–1393. doi: 10.1002/sce.21477
Muis, K. (2007). The role of epistemic beliefs in self-regulated learning. Educ. Psychol. 42, 173–190. doi: 10.1080/00461520701416306
Muis, K. R., Chevrier, M., Denton, C. A., and Losenno, K. M. (2021). Epistemic emotions and epistemic cognition predict critical thinking about socio-scientific issues. Front. Educ. 6:669908. doi: 10.3389/feduc.2021.669908
Muis, K. R., Chevrier, M., and Singh, C. A. (2018). The role of epistemic emotions in personal epistemology and self-regulated learning. Educ. Psychol. 53, 165–184. doi: 10.1080/00461520.2017.1421465
Muis, K. R., Pekrun, R., Sinatra, G. M., Azevedo, R., Trevors, G., Meier, E., et al. (2015a). The curious case of climate change: testing a theoretical model of epistemic beliefs, epistemic emotions, and complex learning. Learn. Instr. 39, 168–183. doi: 10.1016/j.learninstruc.2015.06.003
Muis, K. R., Psaradellis, C., Lajoie, S. P., Di Leo, I., and Chevrier, M. (2015b). The role of epistemic emotions in mathematics problem solving. Contemp. Educ. Psychol. 42, 172–185. doi: 10.1016/j.cedpsych.2015.06.003
Naar, H. (2025). “Are emotions events, processes, states, or dispositions?” in Emotion theory: the Routledge comprehensive guide: Volume I: history, contemporary theories, and key elements. ed. A. Scarantino. 1st ed (London: Routledge), 734.
Nakamura, S. (2023). “Emotions in learning” in Emotion regulation and strategy instruction in learning. ed. S. Nakamura (Cham: Springer International Publishing), 7–47.
O’Keeffe, E. (2024). Radical histories, emotional legacies, and everywhere in between? Exploring everyday responses to the traumas of war in Blood Swept Lands & Seas of Red. (2014). Mortality 29, 306–329. doi: 10.1080/13576275.2024.2310102
Odebiyi, O. M., and Choi, Y.-J. (2022). The challenges of measuring epistemic beliefs across cultures: evidence from Nigerian teacher candidates. Teach. Educ. 33, 214–236. doi: 10.1080/10476210.2020.1844650
Padilla Cruz, M. (2024). “Reshaping epistemic identity on X/Twitter: a Spanish-English contrast” in Evaluating identities online: case studies from the Spanish speaking world. eds. P. Garcés-Conejos Blitvich and P. Bou-Franch (Cham: Springer International Publishing), 53–90.
Pekrun, R. (2006). The control-value theory of achievement emotions: assumptions, corollaries, and implications for educational research and practice. Educ. Psychol. Rev. 18, 315–341. doi: 10.1007/s10648-006-9029-9
Pekrun, R. (2024). Control-value theory: from achievement emotion to a general theory of human emotions. Educ. Psychol. Rev. 36:83. doi: 10.1007/s10648-024-09909-7
Pekrun, R., Vogl, E., Muis, K. R., and Sinatra, G. M. (2017). Measuring emotions during epistemic activities: the epistemically-related emotion scales. Cognit. Emot. 31, 1268–1276. doi: 10.1080/02699931.2016.1204989
Peng, Y. (2023). Understanding the cultural identity of EFL learners from the eco-linguistics perspective: evidence from students in arts college before and after the COVID-19 epidemic period. Front. Psychol. 14:1249334. doi: 10.3389/fpsyg.2023.1249334
Peng, Y. (2024). Enhancing cross-cultural well-being: a mixed methods study on critical thinking, cultural intelligence, and eudaimonic well-being in arts students’ cultural identity development. Front. Psychol. 15:1425929. doi: 10.3389/fpsyg.2024.1425929
Pertl, S. M., Srirangarajan, T., and Urminsky, O. (2024). A multinational analysis of how emotions relate to economic decisions regarding time or risk. Nat. Hum. Behav. 8, 2139–2155. doi: 10.1038/s41562-024-01927-3
Pettersson, H. (2020). De-idealising the educational ideal of critical thinking. Theory Res. Educ. 18, 322–338. doi: 10.1177/1477878520981303
Phinney, J. S., and Ong, A. D. (2007). Conceptualization and measurement of ethnic identity: current status and future directions. J. Couns. Psychol. 54, 271–281. doi: 10.1037/0022-0167.54.3.271
Phinney, J. S. (1992). The multigroup ethnic identity measure. J. Adolesc. Res. 7, 156–176. doi: 10.1177/074355489272003
Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., and Podsakoff, N. P. (2003). Common method biases in behavioral research: a critical review of the literature and recommended remedies. J. Appl. Psychol. 88, 879–903. doi: 10.1037/0021-9010.88.5.879
Quansah, F., Srem-Sai, M., Agormedah, E. K., Quansah, N., Tannoubi, A., Hagan, J. E.Jr, et al. (2024). Cross-cultural validation of the sport emotion questionnaire using elite hockey players: psychometric evidence from seven African countries. Int. J. Sport Exerc. Psychol., 1–19. doi: 10.1080/1612197X.2024.2443634
Quinn, S., Hogan, M., Dwyer, C., Finn, P., and Fogarty, E. (2020). Development and validation of the student-educator negotiated critical thinking dispositions scale (SENCTDS). Think. Skills Creat. 38:100710. doi: 10.1016/j.tsc.2020.100710
Robinson, D. T., Smith-Lovin, L., and Wisecup, A. K. (2006). “Affect control theory” in Handbook of the sociology of emotions. eds. J. E. Stets and J. H. Turner (Boston, MA: Springer US), 179–202.
Rouquette, A., and Falissard, B. (2011). Sample size requirements for the internal validation of psychiatric scales. Int. J. Methods Psychiatr. Res. 20, 235–249. doi: 10.1002/mpr.352
Sato, K., and Horn, B. (2023). Promoting higher order thinking skills in a cross-cultural communication project. World J. Educ. Res. 10:39. doi: 10.22158/wjer.v10n2p39
Scarantino, A. (2025). Introduction to Volume II: Theories of specific emotions, a master table of case studies, and some key challenges. In: Scarantino A. ed. Emotion Theory: The Routledge Comprehensive Guide. 1st edn. London: Routledge, pp. 683. Available at: https://doi.org/10.4324/9781315559940
Sheybani, M., and Miri, F. (2019). The relationship between EFL teachers’ professional identity and their critical thinking: a structural equation modeling approach. Cogent Psychol. 6:1592796. doi: 10.1080/23311908.2019.1592796
Shinogaya, K. (2008). Effects of preparation on learning. Jap. J. Educ. Psychol. 56, 256–267. doi: 10.5926/jjep1953.56.2_256
Shinogaya, K. (2011). Preparation for meaningful learning: effects of a method involving answering pre-questions and judging confidence in the answers. Jpn. J. Educ. Psychol. 59, 355–366. doi: 10.5926/jjep.59.355
Shinogaya, K. (2018). Motives, beliefs, and perceptions among learners affect preparatory learning strategies. J. Educ. Res. 111, 612–619. doi: 10.1080/00220671.2017.1349074
Stanovich, K. E., and West, R. F. (2000). Individual differences in reasoning: implications for the rationality debate? Behav. Brain Sci. 23, 645–665. doi: 10.1017/S0140525X00003435
Steinert, S., Marin, L., and Roeser, S. (2025). Feeling and thinking on social media: emotions, affective scaffolding, and critical thinking. Inquiry 68, 114–141. doi: 10.1080/0020174X.2022.2126148
Stupple, E. J. N., Maratos, F. A., Elander, J., Hunt, T. E., Cheung, K. Y. F., and Aubeeluck, A. V. (2017). Development of the critical thinking toolkit (CriTT): a measure of student attitudes and beliefs about critical thinking. Think. Skills Creat. 23, 91–100. doi: 10.1016/j.tsc.2016.11.007
Sürücü, L., Yikilmaz, İ., and Maslakçi, A. (2022). Exploratory factor analysis (EFA) in quantitative researches and practical considerations. Center Open Sci. doi: 10.31219/osf.io/fgd4e
Tisdell, E. J. (2006). Spirituality, cultural identity, and epistemology in culturally responsive teaching in higher education. Multicult. Perspect. 8, 19–25. doi: 10.1207/s15327892mcp0803_4
Trevors, G. J., Muis, K. R., Pekrun, R., Sinatra, G. M., and Winne, P. H. (2016). Identity and epistemic emotions during knowledge revision: a potential account for the backfire effect. Discourse Process. 53, 339–370. doi: 10.1080/0163853X.2015.1136507
Umaña-Taylor, A. J., Yazedjian, A., and Bámaca-Gómez, M. (2004). Developing the ethnic identity scale using Eriksonian and social identity perspectives. Identity 4, 9–38. doi: 10.1207/S1532706XID0401_2
Van Hemert, D. A., Poortinga, Y. H., and Van De Vijver, F. J. R. (2007). Emotion and culture: a meta-analysis. Cogn. Emot. 21, 913–943. doi: 10.1080/02699930701339293
Wang, R., Elahi Shirvan, M., and Taherian, T. (2021). An ecological study of identity in teaching English as a foreign language in light of the dynamic systems model of role identity. Front. Psychol. 12:799418. doi: 10.3389/fpsyg.2021.799418
Waterman, A. S. (1984). Identity formation: discovery or creation? J. Early Adolesc. 4, 329–341. doi: 10.1177/0272431684044004
Waterman, A. S. (2015). What does it mean to engage in identity exploration and to hold identity commitments? A methodological critique of multidimensional measures for the study of identity processes. Identity 15, 309–349. doi: 10.1080/15283488.2015.1089403
Watson, G., and Glaser, E. M. (1985). Critical thinking appraisal. San Antonio, TX: The Psychological Corporation.
Whissell, C. (2023). “Defining emotion” in Engaging with emotion. ed. C. Whissell (Cham: Springer International Publishing), 5–22.
Yang, D., and Liu, Y. (2025). A tale of three advantages: cross-cultural recognition of basic emotions through virtual stickers. Int. J. Hum. Comput. Interact. 41, 3940–3956. doi: 10.1080/10447318.2024.2344151
Yazan, B. (2023). Incorporating teacher emotions and identity in teacher education practices: affordances of critical autoethnographic narrative. Lang. Learn. J. 51, 649–661. doi: 10.1080/09571736.2023.2239843
Yoshida, R. (2024). Emotions and identities in teaching in higher education: an autoethnographic approach. Teach. High. Educ. 30, 1221–1234. doi: 10.1080/13562517.2024.2430661
You, Y. (2025). Measuring social and emotional development with a “Western ruler”: problematising the “cross-cultural comparability” of the study on social and emotional skills. Comp. A J. Comp. Int. Educ., 1–18. doi: 10.1080/03057925.2025.2452460
Keywords: epistemic emotion, critical thinking, cultural identity, scale development, cultures
Citation: Peng Y (2025) When emotion meets reason: the development and validation of EpiCT-CI scale to measure epistemic emotions in critical thinking application and cultural identity constructions. Front. Psychol. 16:1687003. doi: 10.3389/fpsyg.2025.1687003
Edited by:
Enrique H. Riquelme, Temuco Catholic University, ChileReviewed by:
Eric A. Ambele, Mahasarakham University, ThailandMohammad Hossein Arefian, Imam Khomeini International University, Iran
Copyright © 2025 Peng. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Yue Peng, eXVlX3BlbmdAZ3phcnRzLmVkdS5jbg==