Psychometric Examination of the Abbreviated Version of the Dual School Climate and School Identification Measure-Student (SCASIM-St15) in a Sample of Chilean Adolescents

School climate is a multidimensional construct that has been related to a series of psychological, social, and school variables. The dual school climate and school identification measure-student (SCASIM-St) is a measure that has a multidimensional factor structure, with four first-order factors and a second-order factor, plus an independent factor that evaluates school identification. However, the SCASIM-St is long, with 38 items measuring school climate. The first objective of this study was to examine the psychometric properties of reliability and validity of the abbreviated version of the dual school climate and school identification measure-student (SCASIM-St-15), for use in contexts with time limitations or for explanatory studies that need to apply multiple instruments simultaneously. The second objective was to analyze the degree of invariance for the groups: sex, type of education, and age. The sample was made up of 2,044 students of both sexes (49.1% women and 50.9% men), with a mean age of 14.64 (SD = 0.718), representing 27 secondary schools in Chile. The results indicated that the SCASIM-St15 presents adequate indicators of reliability and construct validity. Evidence of external criterion validity confirmed significant associations with the Attitudes to Institutional Authority in Adolescence Scale measure. The results of the factorial invariance analysis indicate that the SCASIM-St15 remains stable up to the level of metric invariance for the variable sex and the level of scalar invariance for the variables type of education and age. The study concluded that despite the significant decrease in the number of items, the SCASIM-St15 measures school climate in a reliable and valid way, without losing its theoretical and conceptual robustness.


INTRODUCTION
School climate is a very relevant construct in the academic environment and in society in general. Various studies have shown that positive school climate significantly contributes to psychosocial adjustment and decreased risk behaviors (Thapa et al., 2013). A global definition of school climate defines it as the "quality and character of school life. School climate is based on patterns of people's experiences of school life and reflects norms, goals, values, interpersonal relationships, teaching and learning practices, and organizational structures" (Cohen et al., 2009, p. 182).
School climate is a very relevant construct since a positive climate promotes better academic performance Trinidad, 2020), prosocial behavior (Villardón-Gallego et al., 2018), self-esteem (Coelho et al., 2020), and identification with the school (Carroll et al., 2017). On the other hand, a toxic school climate is associated with bullying, for example, conflictive teacher-student relationships have a positive effect on bullying, regardless of students' social level (Longobardi et al., 2018), likewise, low levels of school safety and deteriorated student-student good relationships are positively associated with bullying (Xu et al., 2020). Another study indicates that school climate, through its dimensions, student-student relationships and teacher-student relationships, is indirectly related to bullying, through mediating effects of bystanders' responses (Cui and To, 2020). In another line of research, deteriorated school climate is a risk factor for school discriminatory bullying in homeless students (Moore et al., 2020). A cross-sectional study applied to 2,560 schools in the United States (Sulak, 2018), related school climate problems to structural factors such as the geographic location and size of the school.
School climate is related to respect for the rules and good relationships with teachers. This study evaluated as a convergent measure the attitude toward authority, which is defined as the degree of importance that adolescents attribute to formally established authority figures, school regulations, and authority figures such as the police (Bonilla et al., 2017). Respect for authority figures inside and outside of educational establishments is related to favorable behavior in other social contexts in which students participate (Garaigordobil, 2016), such as positive relationships between teachers and students (Gálvez-Nieto et al., 2020a) and prevention of school violence (Bonilla et al., 2017). Students who present transgressive attitudes toward authority figures are more likely to engage in cyberbullying (Ortega-Barón et al., 2017) and filioparental violence (Martínez-Ferrer et al., 2018;Del Moral et al., 2019).

SCHOOL CLIMATE: A MULTIDIMENSIONAL CONSTRUCT
Before defining school climate, it is important to point out that the international literature presents a wide variety of conceptualizations. For example, Ramelow et al. (2015) conducted a substantial literature review of 4,967 articles between 2003 and 2013, revealing that only four instruments that measured school climate had theoretical foundations. Meanwhile, a literature review conducted by Rudasill et al. (2018) revealed a lack of consistent conceptual and theoretical approaches to the study of school climate. Another literature review (Wang and Degol, 2016), indicated that researchers adopt a large number of conceptualizations that range from theoretical and abstract definitions to very concrete and operational definitions, highlighting that the diversity of definitions makes it difficult to identify the correct measurement factors. After focusing on the reviews that incorporated more evidence and had more methodological robustness (Cohen et al., 2009;Thapa et al., 2013;Wang and Degol, 2016;Rudasill et al., 2018), it was concluded that school climate is a complex construct, which must be measured from a multidimensional perspective.
Given the literature and theoretical framework that supported this study, school climate was defined as the relationship between social and organizational factors. Some of these factors included the relationships between school community members, shared values and standards, personal development through school connection and the emotional growth of the educational community members (Lee et al., 2017). In this definition, school identification is of vital importance because it allows students and the rest of the educational community to develop a sense of belonging and connection with their school (Konold et al., 2017;Lee et al., 2017).

MEASUREMENT OF SCHOOL CLIMATE
Measuring the school climate is a desirable goal both for academic research and for educational establishments, as this idea focuses on the possibility of intervening and improving the school environment. According to a recent systematic review (Lewno-Dumdie et al., 2019;Grazia and Molinari, 2020;Marraccini et al., 2020), the literature on school climate measurement includes a variety of definitions, dimensions, and measures that do not permit a general consensus. For example, the study by Marraccini et al. (2020) conducted a full-text review of 446 articles that identified 26 instruments for measuring school climate and concluded that the identified measures of school climate came from a variety of theoretical backgrounds that captured various constructs and were adapted to different educational levels. According to the review study carried out by Grazia and Molinari (2020), most of the validated school climate scales were only used in one study, showing a fragmented field of study that offers low comparability of results. They also note that among the most widely used instruments are My Class Inventory (Cance et al., 2015;Batanova and Loukas, 2016;Mucherah et al., 2018) and the School Climate-Revised (Suldo et al., 2013;Hendron and Kearney, 2016;Holfeld and Leadbeater, 2017).
The scales with the greatest psychometric evidence to measure the school climate in Chile are the Questionnaire to Evaluate the Social Climate of the School Center (Gálvez-Nieto et al., 2015 and the school climate scale (López et al., 2014). Although these instruments are linked to psychometric studies that support their relevance and use, their theoretical structures are not very adequate in terms of coverage and content of dimensions. According to what has been discussed in most robust review studies, school climate constructs must present multidimensional structures (Thapa et al., 2013;Wang and Degol, 2016;Rudasill et al., 2018;Lewno-Dumdie et al., 2019;Grazia and Molinari, 2020).
The present study is based on the measure of the dual school climate and school identification measure -student (SCASIM-St). This instrument has a second-order factor called School Climate which groups five first-order factors, four of them which evaluate the school climate: Student-Student Relations, Student-Staff Relations, Academic Emphasis, Shared Values and Approach. It also presents a fifth factor of the first order -independent of the common factor of the second ordercalled School Identification (Lee et al., 2017). The SCASIM-St has presented a stable factorial structure in the three countries where it has been applied: Australia, where it was originally designed and applied (Lee et al., 2017), and in Turkey and Chile, respectively (Demirtas-Zorbaz and Hoard, 2019; Gálvez-Nieto et al., 2020b).
The dual measure of school climate and school identification is a self-report measure focused on interpersonal relationships within an educational community that also assesses school identification. This instrument could be a useful measure for socio-educational evaluation and intervention in areas such as individual school adaptation, improvement of school performance and school management. The theoretical structure of SCASIM-St is based on the ecological theoretical model of Bronfenbrenner (2002), who states that individual behaviors are explained by the various social subsystems in which an adolescent develops. The SCASIM-St provides a theoretical framework that integrates the measurements of school climate and school connectedness (Lee et al., 2017) from inputs derived from Tajfel and Turner's (1979) theory of social identity.
Considering the importance of evaluating the school climate, the scarcity of instruments to measure it and the need to develop an abbreviated version of SCASIM-St, the first objective of this article was to examine the psychometric properties of reliability and validity of the abbreviated version of the dual school climate and school identification measure-student (SCASIM-St-15). The second objective is to analyze the degree of invariance for the groups: sex, type of education, and age.

Participants
The investigated population included students from public institutions, subsidized private schools and non-subsidized private schools. All participants were secondary education students that lived in one of five macro-zones of Chile, which contain a total of 47,714 students (Ministerio de Educación de Chile, 2019).
Participants were selected through stratified probability sampling with a 95% confidence interval, a variance of p = q = 0.50 and a standard error of 3% (Scheaffer et al., 1987). The region, the type of education and the administrative dependency of the schools were considered as strata. The sample consisted of 2,044 students (49.1% women and 50.9% men), with an average age of 14.64 (SD = 0.718), representing 27 secondary schools in Chile. While the selected schools included students from various socioeconomic backgrounds, the majority represented low and medium socioeconomic levels.

Instruments
To achieve the objectives of the study, a sociodemographic questionnaire was applied that collected information about the students' age, sex, school level, and type of school, among other information.
Simultaneously, the adapted version of the SCASIM-St was applied (Gálvez-Nieto et al., 2020b). The SCASIM-St is a self-report scale that measures school climate and school identification (Lee et al., 2017) based on 38 items written in a positive way (Vigil-Colet et al., 2020) that are answered using a five-point ordinal scale (1 = strongly disagree, 5 = strongly agree). The SCASIM-St has the following factor structure: four first-order factors called Student-Student Relations (seven items, e.g., "Students are friendly to each other"), Student-Staff Relations (nine items, e.g., "Staff care about students"), Academic Emphasis (eight items, e.g.," Teachers challenge students to do better"), and Shared Values and Approach (eight items, e.g.," The school values and goals are well understood"). These four factors are grouped into a common factor called School Climate. The SCASIM-St also presents a fifth factor, School Identification (six items, e.g., "I feel a strong connection with this school"), which is related to the second order factor.
In addition, the adapted version of the Attitudes to Institutional Authority in Adolescence Scale (AIA-A) was applied (Gálvez-Nieto et al., 2018). The AIA-A is a self-report scale that assesses adolescent attitudes toward authority figures, has nine items and is answered using a five-point ordinal scale (1 = Never, 5 = Always). The factorial structure of the AIA-A is made up of two factors: Positive Attitude to Authority (five items e.g., "The police are there to make a better society for all"), referring to the degree of respect toward teachers and the police; and Positive Attitude to Transgression (four items e.g., "It is normal to break the law if no one is harmed"), referring to positive attitudes toward transgression of school rules. In this study, the AIA-A factors presented adequate reliability indices. The factor Positive Attitude to Authority obtained a Cronbach's alpha of 0.745 (McDonald's omega = 0.759) and an average variance extracted equal to 0.443. The factor Positive Attitude to Transgression obtained a Cronbach's alpha of 0.762 (McDonald's omega = 0.777) and an average variance extracted equal to 0.556. The confirmatory factor analysis presented adequate goodnessof-fit indices: WLSMV χ 2 (df = 26) = 417.164, p < 0.001; CFI = 0.958; TLI = 0.941; RMSEA = 0.064. All factor loadings were statistically significant (p < 0.001).

Process
To create the abbreviated version of the SCASIM-St and maintain the reliability and validity properties, a subset of items was selected considering the following criteria; (a) high statistical performance, that is, high factor loadings, high fullscale item correlation and maximal variability in responses and (b) conceptual considerations such as high face validity, that is, high item-dimension conceptual coherence (Stanton et al., 2002).
Before the application of the surveys, the school directors were contacted and asked to sign an agreement to access the sample of students. Subsequently, informed consents were sent to the parents of the students. Once the parental authorizations were obtained, the students responded to an informed consent. After the ethical principles of the project were approved, the surveys were administered during the first hour of class.

Analysis of Data
The missing values were less than 5% of the sample and were treated using the multiple imputation method available in MPLUS v.8.1 software (Muthén and Muthén, 2017). Descriptive statistics were analyzed for each of the items. In order to properly select the analysis approach, Kolmogorov-Smirnov univariate normality tests (see Table 1, p < 0.001) and multivariate tests (Skewness-test = 406.590; Kurtosis-test = 147.716) were performed. In both cases the tests were statistically significant (p < 0.001), suggesting the use of robust estimators in the absence of normality in the data ( Table 1).
The CFA models used the polychoric correlations matrix and the weighted least squares means and variance adjusted (WLSMV) estimation method. Several goodness-of-fit indexes were used to evaluate the CFA models: WLSMV-χ 2 , comparative fit index (CFI), Tucker-Lewis index (TLI) and root mean square error of approximation (RMSEA). For CFI and TLI, values equal to or greater than 0.90 were considered reasonable (Schumacker and Lomax, 2016). For RMSEA, values less than or equal to 0.080 were considered a reasonable adjustment (Browne and Cudeck, 1993). Subsequently, a factorial invariance analysis was carried out for the variables sex, type of education, and age. This analysis considers the following models (Vandenberg and Lance, 2000): M0 configural (equal number of factors), M1 metric (equal factor loadings), and M2 scalar (equality of intercepts). The corrected item-total correlation method and the McDonald's ω and Cronbach's α coefficients were used to estimate reliability (Green and Yang, 2015;Trizano-Hermosilla and Alvarado, 2016).

Descriptive Analysis
The descriptive results considering the mean value of each item showed the highest value for item 22 "Teachers want every student to do their best, " with a mean of 4.29 (SD = 0.812). The item with the lowest mean value was item 4 "Students treat each other with respect, " with a mean of 2.98 (SD = 0.960). In addition, in order to identify the items that would make up the abbreviated version of the SCASIM-St, the results of the corrected item-total correlation, confirmatory factor analysis and a high face validity were analyzed. In Table 1, the items with the highest statistical performance and conceptual representativeness of the dimension are marked in bold. For example, for the first factor, Student-Student Relations, the selected items were 4four, five, and six.

Full SCASIM-St Validity and Reliability
With the aim of evaluating the factorial structure of the SCASIM-St, a confirmatory factorial analysis was performed with the full 38 item scale. For this, a second-order model was estimated that grouped four factors, plus an independent factor. Goodness of fit indices gave satisfactory results: WLSMV χ 2 (660) = 3,528.580, p < 0.001; CFI = 0.964; TLI = 0.961; RMSEA = 0.049 (CI90% = 0.048-0.051). The factor loadings presented satisfactory and statistically significant results ( Table 1). These results provided evidence that the model fit the data adequately, confirming the original theoretical structure of the scale. Finally, the average variance extracted (AVE) was estimated, obtaining values that ranged from 0.49 to 0.72 (Table 1).
Once the factorial structure of the SCASIM-St was confirmed, the instrument's reliability levels were estimated. As can be seen in Table 2, the reliability estimators for the full scale (38 items) presented satisfactory results.

Evidence of Validity of the SCASIM-St15
To assess whether the abbreviated structure of the SCASIM-St provided adequate psychometric indicators, a CFA model was estimated with the 15 items on the scale. A second-order model that grouped four first-order factors, plus an independent factor (Figure 1) was evaluated. This model provided an excellent fit: WLSMV χ 2 (df = 85) = 611.596, p < 0.001; CFI = 0.984; TLI = 0.981; RMSEA = 0.058 (C.I. 90% = 0.054-0.063).

External Validity Criteria for the Abbreviated SCASIM-St
To evaluate the relationships between SCASIM-St15 and AIA-A, a structural equation model was evaluated (Figure 2). The results of this model provided satisfactory goodness-of-fit indices WLSMV χ 2 (df = 242) = 61,306.242, p < 0.001; CFI = 0.973; TLI = 0.969; RMSEA = 0.052 (C.I. 90% = 0.050-0.055) and confirmed that both scales presented significant and positive correlations between School Climate, School Identification, and Positive Attitude to Authority. The School Climate and School Identification factors presented significant and negative correlations with the factor Positive Attitude to Transgression.
Frontiers in Psychology | www.frontiersin.org   In addition, the degree of scalar invariance (M2) was evaluated, including restrictions in the intercepts of the items.
Subsequently, differences in latent means were evaluated. The first hypothesis test was carried out using type of education as the grouping variable, and the results showed statistically significant differences for the variable Student-Student Relations [t-test (2038)   that is, there are no statistically significant differences for the variable age.

Evidence of Reliability of the SCASIM-St-15
In relation to the evidence of reliability of the abbreviated SCASIM-St15, all indicators presented satisfactory values ( Table 2). The factor School Identification had the highest reliability (ω = 0.902), while the factor Shared Values and Approach had the lowest reliability (ω = 0.781).

DISCUSSION
This study had two objectives. The first objective examined the psychometric properties of reliability and validity of the abbreviated version of the School Climate and School Identification Scale (SCASIM-St15). The second objective was to analyze the degree of invariance for the groups: sex, type of education, and age.
Regarding the first objective, the results indicated that the SCASIM-St15 maintained a second order structure that grouped four factors, plus an independent factor, as well as maintained adequate levels of reliability. These results suggest that indicated that despite having significantly decreased the number of items, the factor structure of SCASIM-St remained stable and was consistent with previous studies (Lee et al., 2017;Demirtas-Zorbaz and Hoard, 2019;Gálvez-Nieto et al., 2020b). To assess the validity of external criteria, the SCASIM-St15 scores were correlated with the AIA-A. The results of this investigation showed that the general factor of the SCASIM-St15 called School Climate and the School Identification factor presented significant and negative correlations with the Positive Attitude to Transgression factor, but significant and positive correlations with the Positive Attitude to Authority factor. These results are consistent with previous studies which suggest that students who present high levels of transgression of norms, in turn present relational problems in schools (Gálvez-Nieto et al., 2018), and violence toward their parents (Martínez-Ferrer et al., 2018;Del Moral et al., 2019). On the other hand, a positive attitude toward the norms of institutions such as the school or the police favors academic success (Trinidad, 2020) and psychosocial adjustment in other social contexts (Bonilla et al., 2017).
Regarding the results of the second objective, this study shows that the factorial structure of the SCASIM-St15 remains stable up to the level of metric invariance for the variable sex and the level of scalar invariance for the variables type of education and age. In addition, differences in latent means were evaluated for type of education and age, and statistically significant differences were found for the variable type of education. Students from public schools obtained lower scores in the Student-Student Relations and School Identification factors. These differences could be explained given that public schools are generally large, an aspect that makes school identification difficult (Carroll et al., 2017), and that they are often located in high crime areas (Sulak, 2018) and unsafe neighborhoods (Gálvez-Nieto et al., 2020a).
The abbreviated version of SCASIM-St15 offers a complete measure of school climate. In terms of coverage, it provides a theoretically robust construct which will facilitate its application in educational contexts. It can also be used by researchers who require the simultaneous application of several instruments in order to lower the response burden on students and considerably decrease resource requirements.
In relation to the implications for educational practice, the SCASIM-St15 is a brief tool for measuring school climate, it provides a valid and reliable instrument that will allow evaluating psychosocial interventions in educational settings. Likewise, the SCASIM-St-15, through its five dimensions, provides a work guide that can help the selection and implementation of pertinent interventions to improve school climate and also reduce the incidence of relevant problems that affect a significant proportion of students, such as bullying. In this line of research, it is necessary to strengthen the capacity of students to understand and deal with bullying, strengthening key dimensions of school climate, such as the relationships between teachersstudents and students-students (Longobardi et al., 2018;Xu et al., 2020), from a systemic perspective, include parents in prevention programs, stimulating greater parental supervision, and strengthening positive values to improve the school climate.
The results of this investigation should be interpreted with caution. Although the selected sample represented a wide variety of zones and regions in Chile, it only provided evidence through a cross-sectional design. In this sense, new research should provide more robust psychometric evidence using longitudinal designs. Another limitation of this research is that self-reported instruments were only measured from the perspective of the students. Future studies should consider including new hypotheses about the dimensionality of the scale, considering recent literature and new approaches to data analysis (Garrido et al., 2019).

DATA AVAILABILITY STATEMENT
The datasets generated for this study are available on request to the corresponding author.

ETHICS STATEMENT
The studies involving human participants were reviewed and approved by Comité de ética de la Universidad de La Frontera. Written informed consent to participate in this study was provided by the participants' legal guardian/next of kin.

AUTHOR CONTRIBUTIONS
JG-N created the research question, conducted bibliographic search, methodological design, contributed to analysis, results, and discussion. KP-L conducted the bibliographic search, theoretical framework, integrated results, and contributed to the discussion. JB-V performed the data collection, contributed to analysis, results, and discussion. All authors contributed to the article and approved the submitted version.

FUNDING
This work was produced within the framework of FONDECYT Project No. 1190844.