Skip to main content

ORIGINAL RESEARCH article

Front. Psychol., 03 December 2018
Sec. Educational Psychology

Factor Analysis of EMA-Scale on Adolescent Adjustment From a Developmental Perspective: A Short Form

\r\nLucía Jimnez*Lucía Jiménez1*Susana MenndezSusana Menéndez2Victoria HidalgoVictoria Hidalgo1
  • 1Department of Developmental and Educational Psychology, University of Seville, Seville, Spain
  • 2Department of Social, Developmental and Educational Psychology, University of Huelva, Huelva, Spain

Many published instruments for assessing adolescent adjustment can be implemented in the school context. However, most of them fail to include a comprehensive and positive theoretical perspective of adolescent development and, even when they do, priority is often given to the clinical perspective, or problems with ecological validity and cost-effectiveness emerge. The Magallanes Adaptation Scale is a 90-item Likert-instrument designed for Spanish-speaking adolescents in order to screen several adjustment areas from a holistic and positive perspective of development. Although some evidence of its psychometric robustness has been tested, no confirmatory analysis of its structure has been published. This paper analyzes the items and the factor structure (exploratory factor analysis and confirmatory factor analysis, using the split-half method) of the scales. Participants were 948 Spanish adolescents (49.84% girls) aged between 11 and 17 and stratified sampled. Thirty-six items were removed from the item analysis. The results of the exploratory factor analysis revealed five factors, excluding mother's adaptation. Several models were tested during the confirmatory factor analyses, with a 24-item second-order four-factor solution being found to have the best adjustment indicators. The short version proposed in this paper can constitute a helpful tool with screening purposes to help school teachers to assess students' overall development beyond mere academic performance, although further validity research is needed.

Introduction

Formal educational systems have evolved from an industrialization project focusing on literacy, to a more encompassing view of education aimed at promoting child development from an integrated perspective (Delors et al., 1996). Formal education in knowledge society needs to promote minds able to understand and transform a global world (OEI, 2010). This means that besides “learning to know,” schools should prepare children and adolescents for “learning to do,” “learning to be”, and “learning to live together” (Delors et al., 1996). Consequently, there is a wide consensus about not just academic, but also professional and civic competences need to be integrated into the school curriculum (Ortega, 2005; Hartley and Soo, 2009). In this arena, those competences related to social cognition adquires a salient role (Herschbach, 2012; Brizio et al., 2015).

This integrated view of formal education is in consonance with the current perspective on adolescent development. From developmental psychology, development is nowadays described from both comprehensive and organizational assumptions. A comprehensive or organizational view on development is based on the idea that children and adolescents constitute dynamic and integrated systems in which all development domains mutually interact (Wenar and Kerig, 2000). Consequently, child and adolescent performance is a multi-dimensional process in which the adaptive or non-adaptive resolution of developmental tasks influences other developmental domains. Considering school as a developmental context, we count on empirical evidence supporting this assumption. For example, behavioral problems have been negatively related to academic competence and classroom adjustment (Lane, 2003; Smokowski et al., 2004; Frazier et al., 2007), and social skills and social performance have been linked to academic competence and school behavior (Dishion and Piehler, 2007; Wentzel and Looney, 2007). Alongside this organizational perspective of development, probabilistic but not deterministic principles should also be considered (Cicchetti and Toth, 1997).

In addition to a comprehensive or organizational perspective, developmental contextualism suggest to regard the whole pattern of dynamic person-contexts interactions as the key phenomenon of psychological development (Lerner and Steinberg, 2004). This perspective is particularly important during adolescence, which is a transition period from both an educational and a developmental point of view. Importance of person-context fit is heightened during this period due to the normative physical and psychological changes undergone by adolescents (Lerner and Steinberg, 2004), as well as the educational challenges they are faced with in high-school (e.g., diversification of teachers, departmental organization, fluctuation in their peer group and larger schools) (Eccles and Roeser, 2003). It should be highlighted that, despite the named vulnerability, adolescent development is nowadays conceptualized from a positive perspective aimed at promoting adolescents' social, cognitive and emotional competencies (Oliva et al., 2010).

The developmental contextualism has led to consider adaptation to school context as a key developmental task in adolescence. The integrated view of formal education, together with an organizational and positive comprehension of development, has translated school adaptation into a multi-domain adjustment construct that encompasses not only academic, but individual and social performance (Flammer and Alsaker, 2006; Wentzel and Looney, 2007). We do not count on one single model that guides what healthy school adjustment entails, but besides academic achievement, social competence has been emphasized (Wentzel, 2003). On this regard there is a wide scope of dimensions that have been examined, although peers interactions, relationships with teachers, and belonging with the school stand out (e.g., Zettergren, 2003; Murdock and Bolch, 2005; Määttä et al., 2007; Oramah, 2014). Even for these components, diverse indicators have been described in scientific literature: for example, frequency of interactions, satisfaction or perceived support concerning relationships with peers and teachers; as well as knowledge and respect from school institution, acceptation of norms and values, or attachment. Despite this diversity, a person-environment fit approach remains. Thus, both individual and contextual influences are considered from an interactive framework (Wentzel, 2003). As a result, current integrated views of adolescent adjustment from school context also take into consideration individual, family, and community influences on adjustment (Eccles and Roeser, 2003; Eccles, 2004; Dowrick and Crespo, 2005; Jiménez et al., 2009).

Within this framework, an integrated and contextualist view of adolescent adjustment from school context requires a comprehensive analysis of different facets. As a conclusion, teachers are required to focus not just on students' academic progress but also on other domains (Pozo and Pérez, 2009). To do this, teachers need assessment instruments to provide them with a holistic view of students' progress and development, beyond mere academic performance. To this purpose, there are several instruments for assessing students' performance from a developmental perspective, although concerns have been raised regarding their developmental sensitivity, their comprehensive perspective and the ability to capture person-context interactions (Jiménez et al., 2013). This paper analyzes, from a psychometric viewpoint, a Spanish measure of adolescent adjustment to be applied at school context from a positive, integrated, and contextualist developmental perspective.

There are many published instruments for assessing adolescent adjustment that can be implemented in the school context. In accordance with the classic view of formal education, there are many measures that focus on academic variables such as school performance or intelligence (e.g., Schaefer and Edgerton, 1978; Wechsler Psychological Corporation, 2003), and while several instruments do include a more comprehensive view, a clinical perspective not appropriate for the school context tends to dominate (e.g., Achenbach, 1991). A few measures designed specifically for the school context remain but they usually include a large number of questions, while screening options are not always available (e.g., Wingenfeld et al., 1998). Moreover, sophisticated and expensive computer procedures are sometimes required (e.g., Reynolds and Kamphaus, 2004), making it harder for teachers to administer them for screening purposes. In relation to ecological validity, most of these instruments have been tested with American samples (e.g., Gresham and Elliot, 1990), despite cultural disparities with Spain.

The Magallanes system of assessment developed in the Spanish context that offer several insturments aimed at assessing child and adolescent adjustment (i.e., anxiety, impulsivity, attention an so on). Specifically, the Escalas Magallanes de Adaptación [Magallanes Adaptation Scale] (EMA, García and Magaz, 1998) is a specific instrument that defines adaptation as those developmental processes that allow adolescents to adjust their behavior both to their own needs as well as contextual requirements. Therefore, the EMA reflects a holistic view of adolescent adjustment based on a developmental approach. This measure takes into account a comprehensive view of adaptation at school (at an academic, institutional, and social level), and also includes other indicators that have been pointed out in literature because its influence on adjustment at school (personal and family-related). The EMA refers to different adaptation areas relevant to adolescents, and is congruent with a positive development framework as includes positive indicators of performance and adaptation (Brooks et al., 2012). Moreover, this instrument is respectful with an interactive perspective of adolescent development, as includes indicators concerning student's behavior, as well as contextual influences. This measure offers relevant information at a screening and descriptive level with a Spanish-speaking population both at scale (Aragón and Bosques, 2012) and item level (Suárez et al., 2012).

The manual for the EMA offers evidence of its psychometric robustness (García and Magaz, 1998), although no confirmatory analysis of its structure has yet been published by either the original authors or others. However empirical validations of other Magallanes instruments have recently been published with Spanish-speaking populations, including reliability, and validity testing (Servera et al., 2009), and dimensionality analysis (Sandín et al., 2005; Martínez-Monteagudo et al., 2013), with satisfactory results. Rating information for a Spanish-speaking population has also been reported (Ison and Carrada, 2011).

In order to provide evidence of the psychometric soundness of the EMA, this paper analyzes EMA both at item and scale level (exploratory factor analysis and confirmatory factor analysis, with the split-half method).

Materials and Methods

Participants

Nine hundred and forty-eight adolescents from the general population in southern Spain (Seville) participated in the study. The sample was equally distributed by gender (50.16% boys and 49.84% girls) and ages ranged from 11 to 17 years old (M = 12.88, SD = 1.41). Of the total group, 19.57% of participants received educational support at school. Most lived with both parents (92.72%), although there was a high degree of variability concerning parents' educational level: 37.08% of parents were illiterate or had attended primary school, 38.76% had completed high school and 24.16% had a university degree.

Measures

The EMA (García and Magaz, 1998) instrument is a self-administered test that evaluates adolescent adjustment at school in several domains. This measure includes several indicators for school adaptation (teacher-related, peers-related, and to the school as an institution) and it considers individual and family influences. It is designed for helping school teachers to screen the level of adaptation to the following domains: adaptation to teachers (14 items), to peers (11 items), to the school as an institution (6 items), to the mother (20 items), to the father (20 items), and personal adaptation (19 items). Teachers- and peers-related adaptation refer to the frequency of the interaction, the satisfaction with the relationship, and the perceived support (e.g., “I talk with my teachers/classmates,” “I like my teachers/classmates,” “My teachers/classmates support me if I ask for help”). Adaptation to the school as an institution includes commitment with school values and norms, as well as satisfaction (e.g., “Even I dislike school rules, I comply with them,” “I feel satisfy with my school”). Mother- and father-related adaptation refer to the quality of the interaction, as well as the perceived support (e.g., “I listen to my mother/father, when she/he talks to me,” “My mother/father take an interest on my concerns”). Personal adaptation refers to internalization issues (e.g., “I feel sad and boring”) and scores from this domain need to be reversed. In total, it comprises 90 items rated on a five-point Likert-type scale (from 0 = never to 4 = always) and takes about 15 min to complete. This instrument is a tool that can be used by school teachers for diverse purposes. For example, the EMA can be applied in order to identify vulnerable domains of adjustment, as an initial evaluation, or as progress indicator of students' adjustment at school in aforementioned areas.

Data Collection Procedure

Within the framework of a larger research project, a stratified sampling procedure was followed taking into account the different districts of Seville (southern Spain). Thus, a number of schools was selected from each district according to their size in terms of population (n = 21 districts). The result was a representative sample of schools in Seville, including both public and private schools (73.84 and 26.16%, respectively). The management teams at the schools were contacted and asked to participate in the study, with an agreement rate of 100%. Respondents were selected from the following year groups within the Spanish education system: the final 2 years of primary school (28.37% of the sample), the first (63.01%) and second 2 years of secondary school (6.54%), and both years of the Baccalaureate (2.00%). Management teams asked for written and informed consent from the parents/legal guardians of the participants. Two researchers collected the data in a self-administered format. Every informant participated in the study voluntarily, after signing an informed consent form in accordance with the Declaration of Helsinki. The aims of the research project were explained and all participants were assured that their anonymity would be protected. Ethics approval was obtained from the ethics committee of the Andalusian Government.

Data Analysis

First, preliminary analyses were performed in order to check assumptions for linearity (through inspection of scatterplots among pairs of variables), non-multicollinearity and non-singularity (SMC < 1) at item level (Tabachnick and Fidell, 2007). The possible influence of both univariate and multivariate outliers was examined attending to the inter-quartile and Mahalanobis distance, respectively, (Tabachnick and Fidell, 2007).

Second, a double process of item analysis was conducted using SPSS vs. 20, with the aim of selecting items that would maximize the variance in the instrument and correlate highly with the true score of the latent variable (DeVellis, 2003). First, optimum difficulty was examined through the following criteria: (a) mean between 1.5 and 3.5, (b) SD above 0.5, (c) minimum range of 4, and (d) skewness and kurtosis between ±1 and ±2, respectively, (Ferrando and Anguiano-Carrasco, 2010). Second, internally consistent items were retained through significant positive corrected item-total correlations (>0.35), along with the absence of variation in reliability if the item was deleted (Barbero et al., 2006; Hair et al., 2008).

Third, in order to examine the factorial structure of the scale, we developed a combination of exploratory (EFA) and confirmatory (CFA) factor analyses using the two-half method (Floyd and Widaman, 1995). To do so, the sample was randomly split into two equivalent halves. Equivalence between the two halves was probed as no significant differences were found regarding child's gender, age, and parents' educational level. Moreover, similar distribution on grade level and type of center (public/private) was tested.

With the first half (n = 474), an EFA was conducted using the statistical package FACTOR vs. 9.2 (Lorenzo-Seva and Ferrando, 2006). Due to the ordinal nature of the items, the polychoric correlations matrix was used (Elosua and Zumbo, 2008). The Unweighted Least Squares method was chosen for factor extraction and the oblique Promin rotation method was used to increase interpretability, given the expected relationship between the underlying matrix factors. The EFA was developed following the recommendations of Ferrando and Anguiano-Carrasco (2010). Therefore, Timmerman and Lorenzo-Seva's (2011) parallel analysis (that combines Kaiser criteria and scree-plot test) was conducted for factor retaining decision. Moreover, the following criteria were considered for excluding items: (a) loadings lower than 0.63; (b) similar loadings in two or more factors (< 0.10); (c) substantive conceptual incoherence intra-factor; (d) excessively low communalities (< 0.20); and (e) item-total-correlation lower than 0.30 (Comrey and Lee, 1992; Tabachnick and Fidell, 2007). A minimum of three items per factor was also required (Stevens, 2002). In order to validate the correlation matrix structure, we conducted Bartlett's sphericity test (adequate if p < 0.05) and calculated the Kaiser-Meyer-Olkin (good if KMO >0.60) (Tabachnick and Fidell, 2007). Ordinal alpha by factor (>0.70) and McDonald's Omega for the total scale (>0.70) were examined (Elosua and Zumbo, 2008; Ferrando and Anguiano-Carrasco, 2010).

With the second half (n = 474), we performed several CFA using EQS vs. 6.1 (Bentler and Wu, 2002), following both statistical and theoretical parameters. Following the same strategy than for the EFA, for the computed CFAs the polychoric correlations matrix was used taking into account the ordinal nature of the variables. The Maximum Likelihood Estimation method was used with robust statistics (MLR), as a preferred method for normality violations (Mardia > 5 according to Bentler, 2006) with medium-size samples (Satorra and Bentler, 2001; DiStefano and Hess, 2005). Robust tests for standard errors were considered (Bentler, 2006). Several goodness-of-fit indexes were examined: Satorra-Bentler χ/fd statistic (< 5), NNFI and CFI indexes (values above 0.90 indicate an adequate model fit), and RMSEA index (with values of ≤ 0.06 indicating good model fit, around 0.08 indicating adequate fit, and ≥0.10 a poor fit) (Hu and Bentler, 1999; Barrett, 2007; Hair et al., 2008). As several rival models were tested with the CFA strategy, we performed a significance test on the difference between Satorra-Bentler scaled chi square statistics (Satorra and Bentler, 2001; Crawford and Henry, 2003). For the best model, statistical contribution and regression coefficients of the variables (Hair et al., 2008), as well as standardized errors were examined (Batista and Coenders, 2000) in order to refine the final solution. The Heise and Bohrnstedt's (1970) Omega coefficient was examined.

Results

We probed normality, linearity, non-multicollinearity, and non-singularity assumptions with satisfactory results, identifying any univariate or multivariate outliers. Item analysis is summarized in Table 1. This procedure led us to retain those items with high discrimination power, high SDs, average scores around the medium point of the scale, and low skewness and kurtosis. Considering the criteria described in the method section, we excluded 34 items from subsequent analyses. Due to low corrected item-total correlations and an increasing in reliability if the item was deleted, three items were consequently removed. The items retained guaranteed that latent variables were preserved from this analysis.

TABLE 1
www.frontiersin.org

Table 1. Descriptives about optimum difficulty and internally consistency at item level.

An EFA was conducted with the first half, and Bartlett's sphericity test (χ2 = 12473.90; p < 0.001) and the Kaiser-Meyer-Olkin (KMO = 0.91) showed satisfactory results. The initial EFA indicated 10 factors with eigenvalues of above 1, although Timmerman and Lorenzo-Seva's (2011) parallel analysis recommended considering five factors. Subsequently, a 5-factor solution was forced that explained 53.02% of the variance. Items that did not comply with the criteria described in the method section were removed. The original 6-factor structure was not replicated, as any item from the original mother-related adaptation factor was retained in this sample. We observed acceptable reliability indexes by factor as well as for the global scale (ω = 0.900). The results are summarized in Table 2.

TABLE 2
www.frontiersin.org

Table 2. Summary of information about factors extracted from the EFA.

Several CFA analyses were performed with the second half of the sample. Given the significant correlations between the factors, together with issues of theoretical interpretation, we considered a second-order factor called school adaptation (integrating the teacher-related adaptation and school-as-an-institution-related adaptation factors), as well as a third-order factor called adaptation (including all the factors). Therefore, a model (M1) including the five factors extracted from the EFA with a second-order factor (school adaptation) and a third-order factor (adaptation) was computed. Since the EFA excluded the mother-related adaptation factor and, by itself, the father-related adaptation factor is considered a weak indicator of family adaptation from a theoretical point of view, another model (M2) was tested: M2 was similar to M1, but from which the father-related adaptation factor was excluded.

Mardia's coefficient indicated violation of the multivariate normality assumption (MardiaM1 = 20.20 and MardiaM2 = 21.46), so we used robust estimators. Since the second-order factor consisted of only two first-order factors, identification problems emerged (Bollen, 1989). Therefore, the error variances of both first-order factors were constrained (Rossen et al., 2008). Table 3 shows the goodness-of-fit estimators for M1 and M2.

TABLE 3
www.frontiersin.org

Table 3. Goodness-of-fit indexes of the models resulting from the CFAs.

M1 and M2 were compared as rival models. For this purpose, we performed the significance test on the difference between Satorra-Bentler scaled chi square statistics (Satorra and Bentler, 2001; Crawford and Henry, 2003), with better goodness-of-fit indicators for M2, as ΔS-Bχ2 (173) = 306.45, p < 0.001. Therefore, following Hair et al's (2008) recommendations, we examined the statistical contribution and regression coefficients of the variables, resulting in p < 0.001 and adjusted R2 values ranging from 0.22 to 0.87. No high coefficient standardized errors were observed (Batista and Coenders, 2000). Second- and third-order factors significantly contributed to M2, although school-as-an-institution adaptation and personal adaptation showed weak standardized factor coefficients (0.07 and 0.9, respectively). Therefore, M2 was tested again after deleting the third-order factor adaptation (this is M2'). Goodness-of-fit indicators remained satisfactory [S-Bχ2 (251) = 538.08, NNFI = 0.94, CFI = 0.94, RMSEA = 0.05 with a confidence interval of 0.4–0.06], not differing from M2. Consequently, the M2', a second-order four-factor solution made up of 24 items, was the one finally adopted. The reliability of this model was 0.957.

Discussion

The aim of this study was to provide evidence attesting to the psychometric soundness of the EMA (García and Magaz, 1998). This effort goes beyond previous empirical approaches that offered only descriptives for Spanish population and item-level analyses (Aragón and Bosques, 2012; Suárez et al., 2012), inserting psychometric analysis of EMA for the first time in international scientific discussion. To this end, both items and factor structure were analyzed. A four-factor solution made up of 24-items was finally adopted, offering a shorter version of the instrument that includes peers-related, teacher-related, school-as-an-institution-related, and personal adaptation. A second-order factor integrated both teacher-related and school-as-an-institution related adaptation. This solution partially replicates the original factor structure. These results are consistent with previous psychometric analyses of other Magallanes instruments, which proved psychometric robustness (Servera et al., 2009; Martínez-Monteagudo et al., 2013) but included slight adaptations (Ison and Carrada, 2011).

The factor structure of the EMA presented in this paper is consistent with an organizational but non-deterministic view of adolescent development (Cicchetti and Toth, 1997; Wenar and Kerig, 2000), already described in the introduction section. Thus, a moderated inter-factor correlation was observed, but no third-order factor referring to global adaptation emerged. This is, as proposed in the introduction, adjustment at school context in adolescence refers to a multi-domain adjustment that encompasses not only academic, but also individual and social performance (Flammer and Alsaker, 2006; Wentzel and Looney, 2007). As previously stated, this perspective is in consonance with the integrated view of formal education that addresses twenty-one century agenda (Delors et al., 1996; OEI, 2010) that enhances the role of school context to promote social competences as self- and others understanding, as well as understanding of interpersonal interactions and social systems (Hutto et al., 2011). In sum, in our opinion these findings highlight the need to include comprehensive evaluations in the school context for Spanish students, if the aim is to promote adolescent development from an integrated perspective (Pozo and Pérez, 2009).

Despite the relevance of family influences for adolescent adjustment (Dowrick and Crespo, 2005), our results suggest that the EMA does not adequately evaluate this area. The majority of mother- and father-related items showed problems at the item-level analysis. In EFA, the mother-related factor was not found; in CFA, the inclusion of the father-related factor in the model showed worse adjustment-of-fit indicators. In our opinion, this scale assesses family adaptation from a dyadic approach; this is, it measures adjustment to family context from a person-to-person perspective (mother-related and father-related adaptation). However, nowadays there is consensus about that family influences are not limited to person-to-person interaction at a dyadic level. The family as a system encompasses complex rules, bonding, and circular interactions that play a role for adolescent development (Olson and Gorall, 2003). It is possible that the underlying dyadic approach in EMA does not adequately cover the ecological-systemic functioning of family dynamics (Walsh, 2016). As a result, mother- and father-related adaptation factors did not worked correctly.

The domains remaining in the final proposal for the EMA refer to school (both teacher- and institution-related), peers and personal adaptation. For both teacher- and peers-related adaptation, the items related to the frequency of the interaction were dropped out, and those concerning the satisfaction with the relationship and the perceived support remained. This result gives empirical support to the idea that perceived components of social interaction are critical in comparison to structural ones. This assumption is widely recognized in social support arena (Uchino, 2004), and has been explained from social cognition studies, stating that for both teacher- and peers-related adaptation the development of views of what “appropriate” or “expected” in these interactions are necessary (Brizio et al., 2015). However, from our knowledge this has not been tested from a psychometric approach on adolescent adjustment at school. Moreover, items referring to commitment with values and norms remained for the adaptation to school as an institution domain, and those focused on general satisfaction disappeared. This result emphasizes the independent and relevant component of feeling of belonging to the school institution (Kearney, 2008).

In sum, the version of the EMA presented in this paper is shorter and covers several core components of adjustment at school in adolescence. As pointed out in the introduction section, we do not count on a single model for this construct in adolescence. However, the facets cover by the EMA coincide with the broad categories identified in the most recent papers on adjustment evaluation within the school context in other developmental and educational transition, as adaptation to the college is (Credé and Niehorster, 2012). According to these authors, not only academic, but also social, and personal-emotional adjustment need to be considered in relation to how students adapt to the school environment. Despite the relevance of this, it has been discussed here that the EMA instrument does not cover adequately family adaptation. Moreover, it should be noticed that other individual components that influence school adjustment are not included in this measure, as expectations, goal orientations or self-concept (Bruyn et al., 2003; Dowrick and Crespo, 2005; Anderman and Kaplan, 2008).

Despite the aforementioned limitations, in our opinion, the short version of the EMA proposed in this paper constitutes a useful tool to evaluate adolescent adjustment for diverse purposes. School teachers are in a privileged position to enhance adolescents' health and development. For this aim, the EMA constitutes an interesting screening tool to identify vulnerable domains of adjustment at school that may need to be promoted, besides academic achievement. Moreover, the EMA can provide a holistic view of adolescent adjustment at school either for initial evaluations or as a progress indicator. This version of EMA is a context-based, reliable, and cost-effective measure of adolescent adjustment at school context from a developmental perspective respectful with organizational, contextualist, and positive principles. As designed and tested with Spanish-speaking adolescents, the cultural validity of this measure is also a strength. Nevertheless, the short version of the EMA proposed in this paper is limited as no empirical evidence on its relationship with other related constructs is provided. Thus, the incoming challenge is to probe whether this shorter version works better than the full-length version. Moreover, invariance testing accordance with adolescents' sociodemographic and psychoeducational profiles should be examined in future research. These advances will serve as the starting point to disseminate the EMA among school teachers so that they can consider this tool as a valuable resource to assess adolescent adjustment.

Author Contributions

All the authors have made substantial contributions to the conception of the work, as well as the analysis and interpretation of its data. All the authors have reviewed the work and have given their final approval of the version to be published. All authors agree to be accountable for the content of the work contributed to the manuscript and agree with this submission.

Funding

This study has been funded by the Spanish Government (MINECO, Ministerio de Economía y Competitividad). Project reference: EDU2013-41441-P, Evaluación de intervenciones psicoeducativas con familias en situación de riesgo psicosocial. Un análisis de buenas prácticas basadas en la evidencia.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

Achenbach, T. M. (1991). Manual for Child Behavior Checklist/ 4-18 and 1991 Profile. Burlington, VT: University of Vermont, Dept. of Psychiatry.

Anderman, L. H., and Kaplan, A. (2008). The role of interpersonal relationships in student motivation: introduction to the special issue. J. Exp. Educ. 76, 115–119. doi: 10.3200/JEXE.76.2.115-120

CrossRef Full Text | Google Scholar

Aragón, L. E., and Bosques, E. (2012). Adaptación familiar, escolar y personal de adolescentes de la ciudad de México. Enseñanza e Investig. Psicol. 17, 263–282.

Google Scholar

Barbero, M. I., Vila, E., and Suárez, J. C. (2006). Psicometría. Madrid: UNED.

Barrett, P. (2007). Structural equation modeling: adjudging model fit. Pers. Individ. Dif. 42, 815–824. doi: 10.1016/j.paid.2006.09.018

CrossRef Full Text | Google Scholar

Batista, J. M., and Coenders, G. (2000). Modelos de Ecuaciones Estructurales. Madrid: La Muralla, S.A.

Google Scholar

Bentler, P., and Wu, E. (2002). EQS for Windows User's Guide. Encino, CA: Multivariate Software, Inc.

Bentler, P. M. (2006). EQS 6 Structural Equations Program Manual. Encino, CA: Multivariate Software.

Bollen, K. A. (1989). Structural Equations with Latent Variables. New York, NY: John Wiley & Sons. doi: 10.1002/9781118619179

CrossRef Full Text

Brizio, A., Gabbatore, I., Tirassa, M., and Bosco, F. M. (2015). “No more a child, not yet an adult”: studying social cognition in adolescence. Front. Psychol. 6:1011. doi: 10.3389/fpsyg.2015.01011

CrossRef Full Text | Google Scholar

Brooks, F. M., Magnusson, J., Spencer, N., and Morgan, A. (2012). Adolescent multiple risk behaviour: an asset approach to the role of family, school and community. J. Public Health 34, i48–i56. doi: 10.1093/pubmed/fds001

PubMed Abstract | CrossRef Full Text | Google Scholar

Bruyn, E. H., Dekovic, M., and Meijnen, G. W. (2003). Parenting, goal orientations, classroom behavior, and school success in early adolescence. Appl. Dev. Psychol. 24, 393–412. doi: 10.1016/S0193-3973(03)00074-1

CrossRef Full Text | Google Scholar

Cicchetti, D., and Toth, S. L. (1997). “Transactional ecological systems in developmental psychopathology,” in Developmental psychopathology. Perspectives on Adjustment, Risk, And Disorder, eds S. S. Luthar, J. A. Burack, D. Cicchetti, and J. R. Weisz (Cambridge: Cambridge University Press), 317–349.

Google Scholar

Comrey, A. L., and Lee, H. B. (1992). A First Course in Factor Analysis (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.

Google Scholar

Crawford, J. R., and Henry, J. D. (2003). The depression anxiety stress scales: normative data and latent structure in a large non-clinical sample. Br. J. Clin. Psychol. 42, 111–131. doi: 10.1348/014466503321903544

PubMed Abstract | CrossRef Full Text | Google Scholar

Credé, M., and Niehorster, S. (2012). Adjustment to college as measured by the student adaptation to college questionnaire: a quantitative review of its structure and relationships with correlates and consequences. Educ. Psychol. Rev. 24, 133–165. doi: 10.1007/s10648-011-9184-5

CrossRef Full Text | Google Scholar

Delors, J., Al Mufti, I., Amagi, I., Carneiro, R., Chung, F., Geremek, B., et al. (1996). Learning: The Treasure Within. Paris: UNESCO.

Google Scholar

DeVellis, R. F. (2003). Scale Development. Theory and Applications, 2nd Edn. Thousand Oaks, CA: Sage Publications.

Google Scholar

Dishion, T. J., and Piehler, T. F. (2007). “Peer dynamics in the development and change of child and adolescent problem behaviour,” in Multilevel Dynamics in Developmental Psychopathology. Pathways to the Future, ed A. S. Masten (New Jersey, NJ: Lawrence Erlbaum), 151–180.

Google Scholar

DiStefano, C., and Hess, B. (2005). Using confirmatory factor analysis for construct validation: an empirical review. J. Psychoeduc. Assess. 23, 225–241. doi: 10.1177/073428290502300303

CrossRef Full Text | Google Scholar

Dowrick, P. W., and Crespo, N. (2005). “School failure,” in Handbook of Adolescent Behavioral Problems: Evidence-Based Approaches to Prevention and Treatment, eds T. P. Gullota, and G. R. Adams (New York, NY: Springer Science and Business Media), 589–610.

Google Scholar

Eccles, J. S. (2004). “Schools, academic motivation, and stage-environment fit,” in Handbook of Adolescent Psychology, eds R. M. Lerner and L. Steinberg (New Jersey, NJ: Wiley), 125–153.

Google Scholar

Eccles, J. S., and Roeser, R. W. (2003). “Schools as developmental contexts,” in Blackwell Handbook of Adolescence, ed G. R. Adams and M. D. Berzonsky (Padstow; Cornwall, ON: Blackwell), 129–148.

Google Scholar

Elosua, P., and Zumbo, B. D. (2008). Coeficientes de fiabilidad para respuestas categóricas ordenadas. Psicothema 20, 896−901.

Google Scholar

Ferrando, P. J., and Anguiano-Carrasco, C. (2010). El análisis factorial como técnica de investigación en psicología. Papeles Psicól. 31, 18−33.

Google Scholar

Flammer, A., and Alsaker, F. D. (2006). “Adolescents in school,” in Handbook of Adolescent Development, eds S. Jackson and L. Goossens (Padstow; Cornwall, ON: Psychology Press), 223–245.

Floyd, F. J., and Widaman, K. F. (1995). Factor analysis in the development and refinement of clinical assessment instruments. Psychol. Assess. 7, 286–299. doi: 10.1037/1040-3590.7.3.286

CrossRef Full Text | Google Scholar

Frazier, T. W., Youngstrom, E. A., Glutting, J. J., and Watkins, M. W. (2007). ADHD and achievement: meta-analysis of the child, adolescent, and adult literatures and a concomitant study with college students. J. Learn. Disabil. 40, 49–65. doi: 10.1177/00222194070400010401

PubMed Abstract | CrossRef Full Text | Google Scholar

García, M., and Magaz, A. (1998). Escalas Magallanes de Adaptación. Manual de Referencia. Cruces-Baracaldo; Vizcaya: Albor-Cohs.

Gresham, F. M., and Elliot, S. N. (1990). Social Skills Rating System. Circle Pines, MN: American Guidance Service.

Hair, J. F., Anderson, R. E., Tatham, R. L., and Black, W. C. (2008). Multivariate Analysis, 5th Edn. Madrid: Pearson Prentice Hall.

Hartley, M., and Soo, D. (2009). “Building democracy's university. University-community partnerships and the emergent civic engagement movement,” in The Routledge International Handbook of Higher Education, eds M. Tight, K. H. Mok, J. Huisman, and C. C. Morphew (New York, NY: Routledge), 397–407.

Heise, D. R., and Bohrnstedt, G. W. (1970). “Validity, invalidity, and reliability,” in Sociological Methodology, ed E. F. Borgatta (San Francisco, CA: Jossey-Bass), 104–129.

Google Scholar

Herschbach, M. (2012). On the role of social interaction in social cognition: a mechanistic alternative to enactivism. Phenomenol. Cogn. Sci. 11, 467–486. doi: 10.1007/s11097-011-9209-z

CrossRef Full Text | Google Scholar

Hu, L., and Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct. Equat. Model. 6, 1–55. doi: 10.1080/10705519909540118

CrossRef Full Text | Google Scholar

Hutto, D. D., Herschbach, M., and Southgate, V. (2011). Social cognition: mindreading and alternatives. Rev. Philos. Psychol. 2, 375–395. doi: 10.1007/s13164-011-0073-0

CrossRef Full Text | Google Scholar

Ison, M. S., and Carrada, M. (2011). La eficacia atencional: estudio normativo preliminar en escolares argentinos. Rev. Iberoamer. Diagn. Eval. Psicol. 29, 129–146.

Jiménez, L., Dekovic, M., and Hidalgo, M. V. (2009). Adjustment of school-aged children and adolescents growing up in at-risk families: relationships between family variables and individual, relational and school adjustment. Child. Youth Serv. Rev. 31, 654–661. doi: 10.1016/j.childyouth.2008.12.007

CrossRef Full Text | Google Scholar

Jiménez, L., Hidalgo, M. V., and Menéndez, S. (2013). “La evaluación del ajuste en la adolescencia desde una perspectiva positiva: análisis psicométrico de las Escalas Magallanes de Adaptación (EMA),” in Proceedings of 1st International Congress of Educational Sciences and Development, eds M. P. Bermúdez and M. T. Ramiro (Granada: Asociación Española de Psicología Conductual), 36–39.

Google Scholar

Kearney, C. A. (2008). School absenteeism and school refusal behavior in youth: a contemporary review. Clin. Psychol. Rev. 28, 451–471. doi: 10.1016/j.cpr.2007.07.012

PubMed Abstract | CrossRef Full Text | Google Scholar

Lane, K. L. (2003). Identifying young students at risk for antisocial behavior: the utility of “teachers as tests.” Behav. Dis. 28, 360–369. doi: 10.1177/2F019874290302800404

CrossRef Full Text | Google Scholar

Lerner, R. M., and Steinberg, L. (2004). “The scientific study of adolescent development” in Handbook of Adolescent Psychology, eds R. M. Lerner and L. Steinberg (New Jersey, NJ: Wiley), 1–12.

Google Scholar

Lorenzo-Seva, U., and Ferrando, P. J. (2006). FACTOR: a computer program to fit the exploratory factor analysis model. Behav. Res. Methods Instrum. Comput. 38, 88–91. doi: 10.3758/BF03192753

PubMed Abstract | CrossRef Full Text | Google Scholar

Määttä, S., Nurmi, J. E., and Stattin, H. (2007). Achievement orientations, school adjustment, and well-being: a longitudinal study. J. Res. Adolesc. 17, 789–812. doi: 10.1111/j.1532-7795.2007.00547.x

CrossRef Full Text | Google Scholar

Martínez-Monteagudo, M. C., Inglésa, C. J., and García-Fernández, J. M. (2013). Evaluación de la ansiedad escolar: revisión de cuestionarios, inventarios y escalas. Psicol. Educ. 19, 27–36. doi: 10.5093/ed2013a5

CrossRef Full Text | Google Scholar

Murdock, T. B., and Bolch, M. B. (2005). Risk and protective factors for poor school adjustment in lesbian, gay, and bisexual (lgb) high school youth: variable and person-centered analyses. Psychol. Sch. 42, 159–172. doi: 10.1002/pits.20054

CrossRef Full Text | Google Scholar

OEI (2010). 2021 Metas Educativas. La Educación que Queremos Para la Generación de los Bicentenarios. Madrid: Organización de Estados Iberoamericanos para la educación, la ciencia y la cultura.

Oliva, A., Ríos, M., Antolín-Suárez, L., Parra, Á., Hernando, Á., and Pertegal, M. Á. (2010). Más allá del déficit: construyendo un modelo de desarrollo positivo adolescente. Infancia Aprendizaje 33, 223–234. doi: 10.1174/021037010791114562

CrossRef Full Text | Google Scholar

Olson, D. H., and Gorall, D. (2003). “Circumplex Model of marital and family systems,” in Normal Family Processes: Growing Diversity and Complexity, ed F. Walsh (New York, NY: The Gildford Press), 514–548.

Google Scholar

Oramah, E. U. (2014). Gender differences in the school adjustment of senior secondary school adolescent students in Delta North Senatorial District of Delta State. Gender Behav. 12, 6162–6168.

Google Scholar

Ortega, R. (2005). Psicología de la Enseñanza y Desarrollo de Personas y Comunidades. México: Fondo de Cultura Económica.

Pozo, I., and Pérez, M. P. (2009). “Introducción: la nueva cultura del aprendizaje universitario o por qué cambiar nuestras formas de enseñar y aprender,” in Psicología del Aprendizaje Universitario: la Formación en Competencias, eds I. Pozo and M. P. Pérez (Madrid: Morata), 9–28.

Google Scholar

Reynolds, C. R., and Kamphaus, R. W. (2004). BASC. Sistema de Evaluación de la Conducta de Niños y Adolescentes. Madrid: TEA ediciones.

Google Scholar

Rossen, E., Kranzler, J. H., and Algina, J. (2008). Confirmatory factor analysis of the mayer–salovey–caruso emotional intelligence test V 2.0 (MSCEIT). Pers. Individ. Dif. 44, 1258–1269. doi: 10.1016/j.paid.2007.11.020

CrossRef Full Text | Google Scholar

Sandín, B., Santed, M. A., Valderas, P., Magaz, A., and García, L. (2005). Cuestionario de adaptación militar. Psiquis 26, 19–27.

Satorra, A., and Bentler, P. M. (2001). A scaled difference chi-square test statistic for moment structure analysis. Psychometrika 66, 507–514. doi: 10.1007/BF02296192

CrossRef Full Text | Google Scholar

Schaefer, E. S., and Edgerton, M. D. (1978). Classroom Behavior Inventory (CBI). Chapel Hill, NC: University of North Carolina.

Google Scholar

Servera, M., Cardo, E., Tortella-Feliu, M., and Buela-Casal, G. (2009). Propiedades psicométricas de las escalas magallanes de impulsividad computarizada. Rev. Mexicana Psicol. 26, 71–77.

Google Scholar

Smokowski, P. R., Mann, E. A., Reynolds, A. J., and Fraser, M. W. (2004). Childhood risk and protective factors and late adolescent adjustment in inner city minority youth. Child. Youth Serv. Rev. 26, 63–91. doi: 10.1016/j.childyouth.2003.11.003

CrossRef Full Text | Google Scholar

Stevens, J. (2002). Applied Multivariate Statistics for the Social Sciences, 4th Edn. Hillsdale, NJ: Lawrence Erlbaum.

Suárez, M. F., Cuenca, R. C., and Hurtado, D. (2012). Incidencia de la emigración familiar en el ámbito escolar y emocional en los niños/as de las provincias de Imbabura y Carchi-Ecuador. Revista Iberoamericana Sobre Calidad, Eficacia y Cambio en Educación 10, 119–132.

Tabachnick, B. G., and Fidell, L. S. (2007). Using Multivariate Statistics, 5th Edn. Boston, MA: Pearson Education.

Timmerman, M. E., and Lorenzo-Seva, U. (2011). Dimensionality assessment of ordered polytomous items with parallel analysis. Psychol. Methods 16, 209–220. doi: 10.1037/a0023353

PubMed Abstract | CrossRef Full Text | Google Scholar

Uchino, B. N. (2004). Social Support and Physical Health: Understanding the Health Consequences of Relationships. New Haven, CT: Yale University Press.

Walsh, F. (2016). Family resilience: a developmental systems framework. Eur. J. Dev. Psychol. 13, 313–324. doi: 10.1080/17405629.2016.1154035

CrossRef Full Text | Google Scholar

Wechsler Psychological Corporation (2003). Wechsler Intelligence Scale for Children, 4th Edn. Administration and Scoring Manual (WISC-IV). San Antonio, TX: Pearson, Inc.

Wenar, C., and Kerig, P. (2000). Developmental Psychopathology: From Infancy through Adolescence, 4th Edn. McGraw-Hill International.

Google Scholar

Wentzel, K. R. (2003). “School adjustment,” in Handbook of Psychology, Vol. 7, Educational Psychology, eds W. M. Reynolds and G. E. Miller (Hoboken, NJ: John Wiley & Sons), 235–258.

Google Scholar

Wentzel, K. R., and Looney, L. (2007). “Socialization in school settings,” in Handbook of Socialization: Theory and Research, eds J. E. Grusec and P. D. Hastings (New York, NY: Guilford Press), 382–403.

Google Scholar

Wingenfeld, S. A., Lachar, D., Gruber, C. P., and Kline, R. B. (1998). Development of the teacher-informant student behavior survey. J. Psychoeduc. Assess. 16 226–249. doi: 10.1177/073428299801600304

CrossRef Full Text | Google Scholar

Zettergren, P. (2003). School adjustment in adolescence for previously rejected, average and popular children. Br. J. Educ. Psychol. 73, 207–221. doi: 10.1348/00070990360626949

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: adolescent adjustment, validation, factor analysis, positive development, secondary education

Citation: Jiménez L, Menéndez S and Hidalgo V (2018) Factor Analysis of EMA-Scale on Adolescent Adjustment From a Developmental Perspective: A Short Form. Front. Psychol. 9:2406. doi: 10.3389/fpsyg.2018.02406

Received: 11 April 2018; Accepted: 15 November 2018;
Published: 03 December 2018.

Edited by:

Purificacion Checa, University of Granada, Spain

Reviewed by:

Francesca Marina Bosco, Università degli Studi di Torino, Italy
Rodrigo Jesús Carcedo, University of Salamanca, Spain

Copyright © 2018 Jiménez, Menéndez and Hidalgo. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Lucía Jiménez, luciajimenez@us.es

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.