The School Climate and Academic Mindset Inventory (SCAMI): Confirmatory Factor Analysis and Invariance Across Demographic Groups

School climate is a multidimensional construct of the quality of a student’s academic environment, often subsuming dimensions such as safety, instructional practices, social relationships, school facilities, and school connectedness. Positive school climate has beneficial effects on a wide range of adjustment variables in youth, including academic achievement, mental health, school attendance and graduation, and school-based behavior. Studies regarding school climate assessment have burgeoned in recent years but remain marked by limited sample sizes, narrow developmental levels, restricted items, unclear psychometric strength across multiple demographic groups, and lack of integration with key student education contextual factors such as academic mindset and social emotional learning. The present study evaluated a comprehensive measure of aspects of school climate, academic mindset, and social emotional learning in a sample of 105,379 diverse students (Mage = 13.47 years; SD = 2.47). The 9-factor structure of the School Climate and Academic Mindset Inventory was supported via confirmatory factor analysis. A trimmed model displayed adequate goodness-of-fit for males and females, younger age groups, and European American, biracial/multiracial, Hispanic, Native American, and Native Hawaiian/Pacific Islander students. The trimmed model was slightly less strong for older age groups as well as for African American and Asian American students. The scale may be useful for assessing school climate interventions, longitudinal climate patterns, and school-based algorithms of future performance, though additional validation of the scale remains necessary.


INTRODUCTION
School climate is a multidimensional construct of the "quality and character of school life" that reflects "norms, goals, values, interpersonal relationships, teaching and learning practices, and organizational structures" in a youth-based academic environment (Cohen et al., 2009;Thapa and Cohen, 2017, pp. 303-304). Key dimensions of school climate include safety, instructional practices, social relationships, school facilities, and school connectedness (Zullig et al., 2010). Other, related dimensions of school climate include community, equity, institutional or academic environment, leadership, and shared beliefs (Uline et al., 2010;Wang and Degol, 2016).
Dimensions of school climate have been further explicated in the literature. Safety refers to actual and perceived degree of relational aggression as well as respect for others, supportive environments, and clear rules and norms (Goldstein et al., 2008;Capp et al., 2020). Teaching and learning practices refer to quality of instruction, social emotional learning, and support for academic achievement (Gage et al., 2016). Social relationships refer to parent involvement, supportive relationships with important others such as peers and teachers at school, and respect for diversity (Bradshaw et al., 2014b;Gage et al., 2014). School facilities refer to the condition of the physical environment of an academic setting as well as availability of resources and supplies (Gislason, 2010). School connectedness refers to student affective attachment to the academic community, commitment to social and academic goals, and involvement in social and academic activities (García-Moya et al., 2019). Several of these dimensions overlap in definition and scope, most notably degree of support from the academic environment (Thapa et al., 2013;McMillan et al., 2017).
School climate has been linked to improved child and adolescent socioemotional and academic adjustment in many ways. Positive school climate has been associated with enhanced academic achievement, particularly among students from lower socioeconomic backgrounds (Berkowitz et al., 2017;Maxwell et al., 2017). In addition, positive or authoritative school climate is associated with various mental health benefits that include increased self-esteem, psychosocial wellbeing, and perceived quality of life as well as less depression, suicidal thoughts and behavior, substance use, and psychiatric problems (Thapa et al., 2013;Cornell and Huang, 2016;Aldridge and McChesney, 2018;Zullig et al., 2018). Positive school climate is also linked to academic behavioral outcomes such as less absenteeism, school dropout, suspensions, disciplinary referrals, and bullying and other violent school-based incidents (Kutsyuruba et al., 2015;Hendron and Kearney, 2016;Jia et al., 2016;Reaves et al., 2018). More broadly, positive school climate relates to enhanced teacher satisfaction, retention, efficacy, and productivity as well as less burnout (Berkowitz et al., 2017).
School climate enhancement has thus become a central aspect of broad-based school improvement strategies. Such efforts prominently include, for example, Positive Behavioral Interventions and Supports (PBIS), a systemic intervention to promote a positive school environment that includes appropriate student and teacher behavior (Sugai and Horner, 2002). Key aspects of PBIS include clearly articulated behavioral expectations, student incentives, positive student-teacher interactions, effective classroom management, and empirically based decision making (Bradshaw et al., 2014a). Efforts to improve school climate are typically integrated into multi-tiered systems of support models that focus in part on primary prevention practices to promote adaptive behavior and to deter maladaptive behavior (Lewis et al., 2017). PBIS implemented with fidelity relates to improvements in academic performance, bullying, office discipline referrals, social emotional competencies, and student suspensions and expulsions (Bradshaw et al., 2010;Horner and Sugai, 2015;Freeman et al., 2016).
The importance of school climate to child and adolescent adjustment as well as to overall academic and behavioral outcomes mandates the need for comprehensive and psychometrically strong assessment measures for this construct, particularly for schools . A full review of school climate assessments is beyond the scope of this article (for reviews, see Ramelow et al., 2015;Olsen et al., 2018). These measures focus primarily on various dimensions of school climate described earlier in addition to ancillary variables such as substance use, school-community relations, and school identification (e.g., Lee et al., 2017). Substantial variability exists across the measures with respect to school climate domains and how these domains are labeled .
Despite the availability of instruments to measure school climate, researchers have noted shortcomings with respect to many of these measures and their associated psychometric properties (Ramelow et al., 2015;Olsen et al., 2018). First, many measures in this area are not particularly comprehensive, instead focusing on limited numbers of constructs and items related only to safety, student-teacher relationships, and connectedness (Berkowitz et al., 2017). Second, psychometric support for most school climate assessments is limited and is often based on restricted sample sizes and developmental levels (Wang and Degol, 2016). Third, important student-based contextual variables related to school climate are often neglected in these measurements (Konold, 2018). Examples include key academic mindset and social emotional learning competencies utilized by students in their academic endeavors (Rattan et al., 2015;Lawson et al., 2019). Theories of optimal school performance in children often integrate student-based contextual factors with school climate (Lee and Shute, 2010;Rudasill et al., 2018).
Academic mindsets refer to "beliefs, attitudes, or ways of perceiving oneself in relation to learning and intellectual work that support academic performance" (Farrington et al., 2012, p. 28). Such intrinsic motivational or non-cognitive factors, including academic tenacity or self-efficacy, relate closely to improved academic achievement across many demographic groups (Yeager and Dweck, 2012;Dweck et al., 2014). Organizational learning variables that can include a positive school climate correlate significantly with a growth mindset culture among students (Hanson et al., 2016). Mechanisms for this relationship may include enhanced student sense of contextual fairness as well as solidarity or belongingness at school, incentives for academic performance, trust in authorities, and transmission of mindset beliefs by teachers (Thomas et al., 2019).
Social emotional learning competencies, sometimes integrated with the teaching and learning practices domain of school climate, refer broadly to skills regarding self-awareness, selfmanagement, social awareness, relationships, and responsible decision-making (Durlak et al., 2015). Social emotional learning practices can help produce adaptive academic mindsets via (1) explicit instruction in interpersonal, emotional, and cognitive skills, (2) ample school-based opportunities to use these skills, and (3) effective classroom management and discipline approaches (Darling-Hammond and Cook-Harvey, 2018). Efforts to enhance school climate often include social-emotional learning practices to promote safe contexts to develop these skills and to boost student engagement (Corcoran et al., 2018).
The aim of the present study was to evaluate a comprehensive measure of aspects of school climate, academic mindset, and social emotional learning in a very large sample of diverse students. The study was designed in part to help address drawbacks associated with extant measures in this area such as restricted comprehensiveness and sample size, limited psychometric strength across multiple demographic groups, and lack of integration with key contextual factors related to student learning. Specifically, the present study examined the adjustment and reliability of a districtwide 9-factor, 66-item measure of school climate and academic mindset (School Climate and Academic Mindset Inventory; SCAMI) among tens of thousands of elementary, middle, and high school students. The primary hypothesis was that the original 9-factor model representing these constructs (i.e., parent involvement and support, academic mindset, social emotional learning, safety, physical safety, bullying, physical environment and resources, respect for diversity, and perceptions of school performance) would be supported via confirmatory factor analysis. In addition, factorial invariance across multiple demographic groups was expected. Model trimming was implemented as needed.

Measure and Data Analyses
Original subscales and associated items are in Table 1. Subscales (n = 9) included Parent Involvement and Support, Academic Mindset, Social Emotional Learning, Safety, Physical Safety, Bullying, Physical Environment and Resources, Respect for Diversity, and Perceptions of School Performance. Items were derived by the school district via original development, a state department of education, and the University of Chicago Consortium on School Research (academic mindset questions). Items are scored in variable fashion ( Table 1).
The subscales had different Likert-type scales, so raw data were lineally transformed to obtain scores on a 0-100 scale (see Vilagut et al., 2005). Items were reversedscored as needed. Confirmatory factor analyses (CFA) were then performed to analyze models that could be adjusted to the data: 0-factor model, 1-factor model, original 9-factor model (with correlated and uncorrelated factors), a trimmed 9-factor model (with correlated and uncorrelated factors), and a trimmed 9-factor model with a second-order factor (with correlated and uncorrelated factors). A trimmed 9-factor model was obtained by analyzing item saturation in each of the factors, keeping the theoretical meaning of the items inside the respective factors and the modification indices (Leung et al., 2013;Gonzálvez et al., 2016;Gómez-Núñez et al., 2020). Mardia's coefficient of the total sample was above the 5 points established as multivariate normality in the data (1,122.76), so the Robust Maximum Likelihood (RML) and Satorra-Bentler χ 2 scaled (S-Bχ 2 ) were applied (Bentler, 2005). To identify extreme cases with respect to multivariate kurtosis, the method that was employed was the analysis of the five cases automatically provided by EQS that contribute most to the normalized multivariate kurtosis estimate. The criterion used was the comparison between the estimate presented for one case relative to the estimate of the other four cases. This method was implemented until the five estimates of the final sample were included in the same range of values and none was distinctively different from the others (Byrne, 2008).
Four goodness-of-fit indices were examined for the models: robust root mean square error of approximation (R-RMSEA), standardized root mean square residual (SRMR), robust comparative fit index (R-CFI), and Tucker Lewis index (TLI). Acceptable goodness-of-fit in this study was defined as rounded SRMR and R-RMSEA values of <0.08 and R-CFI and TLI values of 0.90+ (Hu and Bentler, 1999;Brown, 2006). In addition, the upper end of the R-RMSEA 90% confidence interval should be <0.10 (Kline, 2005). Subscale reliability of the best-fitting model was evaluated via Cronbach's alpha and Omega coefficients (McDonald, 1999).
Multigroup confirmatory factor analyses were performed to test factorial invariance of the chosen model (configural, measurement, and structural invariance) across gender, age group (9-11, 12-14, 15-16, 17-18, 18+ years) and ethnic group (Hispanic/Latino, European American, African American, Asian, Biracial/Multiracial, Native Hawaiian/Pacific Islander, and American Indian/Alaska Native). Mardia's coefficients were elevated, so the S-Bχ 2 and the robust indices mentioned above were used to include certain groups in the invariance analyses and determine the adequacy of the nested models that are part of the invariance analyses. An invariance criterion ( R-CFI > −0.01) was also utilized to accept nested models (Byrne, 2008). Statistical analyses were calculated using SPSS, Amos 23, and EQS 6.1.

Confirmatory Factor Analyses and Reliability
Results from the CFAs are in Table 3. The 0-factor, 1-factor, and original 9-factor model with and without correlated factors did not meet criteria for adequate goodness-of-fit. Model trimming then consisted of removing 15 items whose factor loadings were <0.40 (noted in Table 1). These items included 2 from academic mindset, 11 from social emotional learning, and 2 from perceptions of school environment. Errors were correlated to improve model fit. No items were removed from the other subscales, and no items were moved from one subscale to another ( Table 2). Removal of these 15 items produced a trimmed 9-factor 51-item model for the SCAMI with and without correlated factors that was not supported by all goodness-offit indices. A new trimmed 9-factor model dividing factor 2 (academic mindset) into a second-order factor was proposed ( Table 3)

Factorial Invariance Across Demographic Groups
Factorial invariance of the trimmed 9-factor model with one second-order factor was examined across several demographic groups. A baseline model (Model 0) without constraints was initially established; factor loadings of first order (Model 1) and second order (Model 2) models were then imposed to obtain metric invariance. In addition, intercept constraints were added to Model 2 and the strong or scalar invariance (Model 3) was obtained. Factor loadings (first and second order), intercepts, and variances and covariances of errors were constrained to test strict invariance (Model 4). Finally, covariances of the factors were constrained in Model 2 to test structural invariance (Model 5).

DISCUSSION
The present study examined the adjustment and reliability values of a 9-factor, 66-item measure of school climate and academic mindset among a very large sample of elementary, middle, and high school students. Confirmatory factor analysis supported the proposed factor structure of the School Climate and Academic Mindset Inventory (SCAMI) (i.e., Parent Involvement and Support, Academic Mindset, Social Emotional Learning, Safety, Physical Safety, Bullying, Physical Environment and Resources, Respect for Diversity, and Perceptions of School Performance). Coefficient values were adequate for all subscales (Taber, 2018). Model trimming to arrive at satisfactory goodness-of-fit indices included the removal of items from academic mindset (2 items), social emotional learning (11 items), and perceptions of school environment (2 items). Six other subscales retained their full item integrity and no items shifted from one factor to another. Removed items may constitute supplementary items to be used Model 0 = free model; Model 1 = Model 0 with factor loadings of first-order; Model 2 = Model 1 with factor loadings of second order; Model 3 = Model 2 with intercepts; Model 4 = Model 3 with error variances and covariances; Model 5 = Model 3 with factor covariances; S-Bχ 2 = Satorra-Bentler χ 2 scaled; df = degrees of freedom; TLI = the Tucker-Lewis Index; R-CFI = robust comparative fit index; R-RMSEA = robust root mean square error of approximation; SRMR = standardized root mean square residual; R-CFI = robust comparative fit index difference test. Model 0 = free model; Model 1 = Model 0 with factor loadings of first-order; Model 2 = Model 1 with factor loadings of second order; S-Bχ 2 = Satorra-Bentler χ 2 scaled; df = degrees of freedom; TLI = the Tucker-Lewis Index; R-CFI = robust comparative fit index; R-RMSEA = robust root mean square error of approximation; SRMR = standardized root mean square residual; R-CFI = robust comparative fit index difference test.
with caution. The subscale of Parent Involvement and Support demonstrated lower internal consistency and should also be used with caution.
In addition, the trimmed model displayed adequate goodnessof-fit for males and females, younger age groups, and European American, biracial/multiracial, Hispanic, Native American, and Native Hawaiian/Pacific Islander students. The trimmed model was slightly less strong for older age groups as well as for African American and Asian American students. School climate may be impacted by less social trust in later adolescence as well as differential discrimination among racial groups and percentage of minority students at a given school, which may have affected the results (Flanagan and Stout, 2010;Wang et al., 2014;Wang and Atwal, 2015). Factorial invariance analyses revealed that the SCAMI had an equivalent factor structure by gender and younger age groups. The constructs that the SCAMI is assessing can thus be viewed as comparable between males and females and individuals aged 9-11 and 12-14 years.
The assessment of school climate continues to evolve, and one advantage of the SCAMI is the inclusion of contextual variables utilized by students in their school-based endeavors, most notably academic mindset and social emotional learning factors. The scale allows researchers and school officials to more compactly study the relationship between various aspects of school climate and these associated variables, which is a burgeoning focus of the climate literature (Allbright et al., 2019).
Researchers, for example, can use the scale in conjunction with grades and standardized test scores to better understand the specific mechanisms by which school climate leads to improved academic achievement . In addition, educators and school-based mental health professionals could use the scale to identify schools, classrooms, and even individual students that may require additional support or services to enhance climate and, by extension, academic performance and well-being (Cleveland and Sink, 2017). The scale could be used to identify non-instructional targets of change in an academic environment (Zullig et al., 2010). The SCAMI could also be utilized as part of school climate improvement efforts within the context of multi-tiered systems of support models (James et al., 2018). In these models, Tier 1 system-wide strategies focus heavily on universal or primary prevention practices to promote adaptive behavior and deter maladaptive behavior, often via enhancement of positive school climate, adaptive mindsets, social-emotional competencies, well-managed and engaged classroom behavior, and successful academic performance (Voight and Nation, 2016). The SCAMI can be a practical tool for evaluating many aspects of Tier 1 intervention. In addition, the scale could help districts leverage limited resources by serving as a needs assessment to identify schools most in need of Tier 1 intervention to enhance school climate (Wang and Degol, 2016). This process could occur longitudinally as well to examine patterns of change over time or across grade and developmental levels (László et al., 2019).
Other tiers in a multi-tiered systems of support model include escalating interventions to address emerging (Tier 2) and later chronic and severe (Tier 3) academic, behavioral, social, and emotional problems (McIntosh and Goodman, 2016). The SCAMI may be utilized to help identify demarcations between these tiers so that schools have better benchmarks for shifting and intensifying the use of resources (Berkowitz, 2019). In addition, the scale may be helpful as part of an algorithm with other known benchmarks such as absenteeism, office discipline referrals, and course grades to help predict long-term outcomes such as school dropout (Kotok et al., 2016;Kearney et al., 2019).
Results from the present study also help confirm the substance of domains commonly ascribed to school climate. Dimensions of school climate are generally considered to be malleable in nature, with little agreement on specific labels among researchers except for wide-ranging relational and safety components (Grazia and Molinari, 2020). Several of the SCAMI school climate subscales can be broadly grouped into relational (parent involvement and support, respect for diversity, perceptions of school performance) and safety (physical safety, bullying) domains. Condition of school facilities, another common element of school climate assessment, is represented as well (Berman et al., 2018). A key advantage of the SCAMI is the presence of multiple items for each of these specific domains.
Limitations of the present study should be noted. First, the measure evaluated here (SCAMI) was derived from a prefabricated survey utilized by the school district involved in the present study. As such, the evaluation of the measure is more data-based than theory-based, and one primary geographical location was involved. In addition, less control was exercised over its distribution, with an unknown number completing the measure at home or school, which may have affected the internal consistency of some of the subscales. Second, the scale was based on student report despite the fact that school climate can affect youth, parents, and teachers, each of whom may evaluate climate differently (Ramsey et al., 2016). Student-based reports and inventories do have advantages, however, including practicality, compliance, and assessment of internalizing variables such as mindset (Yeager et al., 2016). Third, deeper student groupings, such as those with disabilities or mental health problems, were not feasible. Perceptions of school climate may differ among these student groups (La Salle et al., 2018). Finally, the scale was administered only in English; measuring school climate among Spanishspeaking and other-language students should be a future priority (Rocha et al., 2019).

CONCLUSION
Despite these limitations, the evaluation of the SCAMI represents one of the largest and most diverse sample sizes with respect to school climate assessment. The results illustrated the adjustment and reliability values of the measure as well as factorial invariance across multiple demographic groups. Future work should focus on expansion of psychometric testing in other geographical regions, further validation, and multilevel modeling to explore individual and collective perceptions of school climate. In addition, the scale's utility for assessing school climate interventions and longitudinal patterns, as well as its value within a multi-tiered systems of support model, should be fully evaluated. Finally, linking findings from the scale to other key school variables such as absenteeism, academic performance, social-emotional competency development, and relational aggression may be instructive.

DATA AVAILABILITY STATEMENT
The datasets generated for this study are available on request to the corresponding author.

ETHICS STATEMENT
The studies involving human participants were reviewed and approved by UNLV IRB. Written informed consent from the participants' legal guardian/next of kin was not required to participate in this study in accordance with the national legislation and the institutional requirements.