Impact Factor 2.990 | CiteScore 3.5
More on impact ›


Front. Psychol., 13 March 2018 |

Measuring Responsibility and Cooperation in Learning Teams in the University Setting: Validation of a Questionnaire

  • 1Department of Psychology and Anthropology, University of Extremadura, Cáceres, Spain
  • 2Department of Didactics of Music, Plastic and Body Expression, University of Extremadura, Cáceres, Spain

Cooperative learning are being used increasingly in the university classroom, in order to promote teamwork among students, improve performance and develop interpersonal competences. Responsibility and cooperation are two fundamental pillars of cooperative learning. Team members’ responsibility is a necessary condition for the team’s success in the assigned tasks. Students must be aware that they depend on each other and should make their maximum effort. On the other hand, in efficient groups, the members cooperate and pool their efforts to achieve the proposed goals. In this research, we propose to create a Questionnaire of Group Responsibility and Cooperation in Learning Teams (CRCG). Participants in this work were 375 students from the Faculty of Teacher Training of the University of Extremadura (Spain). The CRCG has very acceptable psychometric characteristics, good internal consistency, and temporal reliability. Moreover, structural equation analysis allowed us to verify that the latent variables in the two factors found are well defined and, therefore, their assessment is adequate. Besides, we found high significant correlations between the Learning Team Potency Questionnaire (CPEA) and the total score and the factors of the CRCG. This tool will evaluate cooperative skills and offer faculty information in order to prepare students for teamwork and conflict resolution.


A Brief Description of Cooperative Learning Research

Most research on cooperative learning focused on the analysis of the consequences and outcomes of its application on academic, social, and affective variables (Johnson et al., 1981, 1983; Kromrey and Purdom, 1995; Kennett et al., 1996). With regard to the academic variables, cooperative learning increases the performance and productivity of participants (Johnson et al., 1981). Students improve the quality of their learning strategies and develop information-processing strategies, favoring critical and constructive thinking while promoting their capacity of communication and expression (Solsona, 1999).

Cooperative learning produces very interesting pedagogical results: intrinsic motivation, positive attitudes toward the subject, self-esteem, social support, group cohesion, participation, etc. (Cava, 1998; Del Caño and Mazaira, 2002). In general, situations of cooperative learning are more dynamic, attractive, and fun, they grant more responsibility and power to the students concerning their learning, while increasing their perceptions of autonomy and competence. At the affective and social levels, cooperative learning techniques influence motivation and contribute powerfully to the development and improvement of cooperative skills (Ovejero, 1993). Cooperative learning creates more interpersonal attraction among the students, leading to more positive attitudes toward classmates who are different (Johnson and Johnson, 1990). Some studies have analyzed the effect of cooperative learning on the attitudes of autochthonous students toward immigrants (León et al., 2009), and school bullying (León et al., 2012).

A few investigations have focused mainly on issues related to the efficacy of cooperative learning and the mediating mechanisms involved. The goal of these investigations revolves around two axes. The first one is the nature and quality of the interactive process (Johnson et al., 1990; Bennet and Dunne, 1991). The second axis refers to prior factors that condition the efficacy of cooperative learning (O’Donnel et al., 1990; Rewey et al., 1992; León et al., 2004; León, 2006). A series of studies shows that certain individual features may influence the positive results of cooperative learning. Among others, individual differences in verbal skill and cognitive style have been studied (Rewey et al., 1992). It has also been confirmed that cooperative learning may be more effective in people with high cognitive induction skills, extroversion (Hall et al., 1988), and social orientation.

In the university setting, we note the work of León et al. (2004), which analyzes how participants’ characters—introvert, extrovert, independent, gregarious, shy—affects the success and failure of cooperative learning. León (2006) corroborates the influence of social skills and group dynamics training on achievement and the interactive processes in cooperative learning situations. The more the resources of social interaction are consolidated in the group, the higher the achievement and efficacy of cooperative systems. Other researchers, too emphasize the importance of preparing students to make the most of cooperative learning situations (Johnson and Johnson, 1982; Webb, 2009; Buchs et al., 2016).

Cooperative Learning in the University

The adaptation of the European Higher Education Area (EHEA), which started in 1999, involves important methodological changes, a new allocation of meanings to the teaching and learning tasks (González and Raposo, 2008). For Palacios (2004), the teaching processes and the teacher’s work in presential teaching are no longer as interesting as the learning processes by which the student attains the proposed goals in each subject. According to this new learning-focused approach, new methodologies like cooperative learning, which facilitate and reinforce students’ autonomous learning, are needed.

Methods of collaborative and cooperative learning or other forms of group learning are being used increasingly in the classroom in order to promote teamwork among students, improve performance and learning or develop interpersonal competences (Gaudet et al., 2010; Kirschner et al., 2011; Mendo et al., 2016; León et al., 2017).

Cooperative learning at university is an efficacious methodology to develop transversal competences, such as a critical sense and tolerance, transcending the strictly academic aspect and facilitating the practice of habits of cooperation, solidarity, and teamwork. The latter are key aspects in most business organizational schemes. According to Colás (1993), between 70 and 80% of jobs require a complex coordination of ideas and efforts, a capacity that can only be experienced and learnt through situations of cooperative learning.

However, despite its advantages, the application of cooperative learning in the university classroom is not without problems. The organizational structure, the competitive climate, the few social objectives related to higher education courses, and the emphasis on theoretical concepts for achieving academic success, do not favor its application (Darnon et al., 2009; Buchs et al., 2016). The development of social competences has traditionally been perceived as secondary and not particularly relevant in higher education (Gismero, 2000; Gillies, 2008).

Teamwork is not always received positively by students (Burdett, 2006; Payne and Monk-Turner, 2006; Hammar Chiriac, 2014). It is not enough to assign a task to students and tell them to work together. In order to introduce teamwork in the classroom, the following aspects are essential: the teacher’s preparation in the use of methodologies favoring peer cooperation, students’ training in teamwork (Beigi and Shirmohammadi, 2012), the team’s social skills (Rodríguez and Ridao, 2014; León et al., 2015), task design (Hijzen et al., 2007), and the team’s beliefs about its efficacy and performance, interdependence, conflicts, etc. (León et al., 2017). When these elements are not taken into account, unsatisfactory work experiences may discourage people from teamwork.

Team members’ responsibility is a necessary condition for the team’s success in the assigned tasks. Students must become aware that they depend on each other and should put out maximum effort. According to Johnson and Johnson (1987b), cooperative learning groups are based on positive interdependence among the group components. The goals are structured so that the students are not only interested in their own effort and performance but also in others’ performance. There is clear individual responsibility; all the team members share the responsibility for learning. Smith (1996) underlines positive interdependence and responsibility as essential elements for the success of a cooperative learning group. Students are successful if the team is successful. Each team member commits to carrying out his or her part of the work and the team is considered responsible for achieving the goals.

Many authors underline the importance of group members’ cooperative skills and the group’s maturity (Johnson et al., 1990). In fact, according to Pallarés (1993), productivity and group learning depend on the maturity attained when growing. According to this author, in efficient groups, the members cooperate, joining forces to achieve the proposed goals. The idea is to collaborate, not compete; along these same lines, Bruffee (1995) notes that cooperation implies working together and providing mutual support to reach goals. According to Ovejero (1990), it is necessary to take into account a series of aspects to perform a task that is truly cooperative: individual responsibility and cooperative skills.

The Present Research

Diverse investigations have focused on the assessment of some of the variables related to cooperation in learning teams teamwork, such as the team’s social skills (León et al., 2015), the team’s potency (León et al., 2017), the preference or appraisal of the teamwork experience (Gottschall and García-Bayonas, 2008; Alford et al., 2014; Mendo et al., 2017), assessment and work environment (Beigi and Shirmohammadi, 2012), motivation (Ibarra and Rodríguez, 2007; Järvelä et al., 2010), the quality of the product and process, the classmates’ support, interdependence, and frustration (Nausheen et al., 2013).

Nevertheless, we believe that the organization, coordination, cohesion, solidarity, commitment, conflicts or the capacity to take criticism on board are some of the most relevant variables that determine whether work teams have been responsible and cooperative. Responsibility and cooperation are two fundamental pillars of cooperative learning. Individual learning as the result of teamwork will be better if there has been cooperation and responsibility (Johnson and Johnson, 1987a; Johnson et al., 1998).

It is important to design instruments to assess and delimit these variables in the university setting in situations of cooperative learning. Del Canto et al. (2009) point out as a source of team conflict the lack of responsibility, which translates into ‘Free Rider’ attitudes, that is, students who do not do their share of the work and always have the perfect excuse, negatively influencing the team’s motivation, productivity, and efficiency (Kerr and Bruun, 1983).

Social loafing is a phenomenon that occurs in groups and consists of a reduction in the effort and motivation of the participants when they are collectively responsible for carrying out a task (Hardy and Latané, 1988). This phenomenon most usually occurs when one or more of the participants believes that the other members of the group will do the work or when they believe it is difficult to evaluate their contribution (Karau and Williams, 1993). In the context of teamwork, evaluating the responsibility and cooperation will provide the teacher with information with which to resolve the conflicts arising from this Free Rider behavior.

Furthermore, when hiring, companies are demanding professionals who, in addition to a technological profile or a specialized training and professional experience, have basic and cooperative skills to be able to work in multidisciplinary teams within different environments. Having an instrument that evaluates such cooperative skills will provide faculty with information to train his students in teamwork abilities and conflict resolution.

In this research, our aim is to build an instrument to evaluate the responsibility and cooperation, determine its structure and analyze its psychometric characteristics. The questionnaire will provide the teachers and researchers with diagnostic information concerning the cooperative, or collaborative, learning teams, or other forms of group learning in the university, information which will transcend the evaluation of the product and permit an analysis of the process and the working of the team.

Materials and Methods


In this work, the participants were 375 students (66% females and 44% males), between 18 and 44 years of age. The mean age was 21.3 years (SD = 4.6). The participants were selected randomly using a cluster sampling, where 6 classes were randomly selected from a total of 16 (1680 licentiate students studying Primary and Social Education) of the Faculty of Teacher Training of the University of Extremadura (Spain).

It is important to underline why we selected students from Primary Education and Social Education for our study. The academic guidelines of these degrees present a large quantity of contents and activities related to teamwork as well as the competences related to such contents and activities, which the students should carry out throughout their training process. A high percentage is also assigned to their assessment, so we can get an idea of the importance of teamwork for the participants in the study.


The “Cuestionario de Responsabilidad y Cooperación Grupal en Equipos de Aprendizaje” (CRCG [Questionnaire of Group Responsibility and Cooperation in Learning Teams]).

This questionnaire was designed taking as the starting point some of the most common behavior patterns that the classic research has identified as determinant in the question of teamwork cooperation (Johnson and Johnson, 1987a; Smith, 1996; Johnson et al., 1998).

The CRCG is made up of 14 items on a Likert type scale of 5 points, from 1 (never) to 5 (always) grouped in two dimensions: That of Responsibility (8 items) evaluates to what extent a team is capable of fulfilling the team’s aims and obligations effectively. The dimension of Cooperation (6 items) is related to the evaluation of certain factors which allow the effort to be pooled in order to achieve a particular result from the interaction with other people.

The questionnaire’s unit of study is the participation of the team as a whole and this allows intra-group information to be obtained from the opinion that each participant has concerning the rest of the team as regards the frequency with which the team mates generally organize, coordinate, give input, fulfill their part of the work, positively resolve conflicts, are cohesive, supportive, accept criticism, or make an effort when carrying out group activities in the different subjects.

In a context where the responsibility and cooperation of each team member influences the team’s effectiveness, as well as the group’s qualification, the CRCG allows a collective average score to be obtained for the different members of the group, avoiding such biases in the evaluation as falsification and deception in the self reporting (Dunning et al., 2004) or the evaluation of team mates based on affective-emotional relationships (Martín, 2010).

The Cuestionario de Potencia de Equipos de Aprendizaje (CPEA [Learning Team Potency Questionnaire]; León et al., 2017). The CPEA assesses students’ perception of their work team’s capacity to successfully perform the activities in the different subjects. It is made up of 8 Likert-type items with 10 response options ranging from 1 (completely disagree) to 10 (completely agree). The CPEA has two factors: the first factor, Confidence (4 items), assesses students’ expectations about their own team’s efficacy. The second factor, Performance (4 items), assesses students’ perception of their team’s capacity to successfully perform a series of academic tasks. Example items are: F1: “It is easy for my team to carry out any activity proposed in the different subjects”; F2: “The teamwork carried out by my team is very high quality.” The alpha indexes (α = 0.90) and composite reliability (CR = 0.95) show that the CPEA presents good global reliability and average variance extracted (AVE = 0.70). The two factors of the questionnaire present adequate reliability and an AVE > 0.70 in both factors [F1 (α = 0.85, CR = 0.91, AVE = 0.71); F2 (α = 0.81, CR = 0.92, AVE = 0.73)].


This research is included in a larger Project called “Skills Development Working in Cooperative Teams in Educational Settings,” it was approved by the Bioethical Committee of the University of Extremadura.

Firstly, the coordinator previously explained the study and asked the participants if they had any questions. All students gave written informed consent to take part in the investigation. In order to ensure the anonymity of the responses, a code number was assigned to each participant, thus guaranteeing the confidentiality of the data and their exclusive use for research purposes. We followed the ethical guidelines of the American Psychological Association (2009). Subsequently, in order to establish temporal reliability, following the same procedure 20 days later, 125 of the participants again completed the CRCG.

Data Analysis

Initially, for the development and analysis of the psychometric characteristics of the CRCG, a principal components exploratory factor analysis (EFA) was carried out, after which we confirmed the factor structure found with a confirmatory factor analysis (CFA). To determine the invariance by gender of the obtained model, we performed a multi-group analysis. The stability and factor loadings of the model were established with the bootstrap method. Subsequently, we calculated correlations and comparisons of means to establish convergent and nomological validity. The reliability of the CRCG was calculated using Cronbach’s alpha, the composite reliability coefficients and the AVE. The EFA and correlations were performed with the SPSS-21 program, while for the CFA, the AMOS-21 program was used.


The original sample (n = 375) was divided into two randomly extracted subsamples (n1 = 175 and n2 = 200). The first one (n1) was used to carry out the EFA and the second (n2) as a validation sample for the CFA. Both subsamples are equivalent as regards age [t(373) = 0.439, p = 0.446] and gender [χ2(1) = 0.029, p = 0.864].

Factor Analysis of the CRCG

After discarding those items that had corrected homogeneity indices lower than 0.40 (e.g., My teammates treated each other with respect and were polite; My teammates took the division of responsibilities into account), the Kaiser-Meyer-Olkin measure of sample adequacy yielded a value of 0.924. Bartlett’s sphericity test was significant (χ2 = 1834.98, p ≤ 0.001). Both the KMO and Bartlett values indicate that the data are adequate and can yield interesting conclusions and, according to the eigenvalue > 1 criterion, reveal the existence of two factors that jointly explain 62% of the total variance.

We used principal components with oblimin rotation to extract the factors. The goal is to find a set of components that explain the greatest possible amount of the total variance of the original variables (Table 1). The first factor, which we call “Responsibility,” explains 53% of the variance and refers to each team member’s perception of the remaining teammates with regard to their responsibility in the cooperative activities. The second factor, “Cooperation,” explains 9% of the variance and assesses the degree of cooperation in the team tasks. The internal consistency of the questionnaire, as measured by the Cronbach alpha index, was 0.931. This is very high and quite acceptable for the factors Responsibility (α = 0.912) and Cooperation (α = 0.847). With regard to the temporal reliability, the test–retest reliability coefficient (r = 0.870, p < 0.001) indicated a high stability of the scores. Regarding temporal reliability, the correlation between the scores was 0.810 (p < 0.001).


TABLE 1. Factor analysis of the Questionnaire of Group Responsibility and Cooperation in Learning Teams (CRCG) principal components with oblimin rotation.

Confirmatory Analysis of the CRCG

The CFA was performed with the second subsample (n2 = 200). An ideal sample for confirmatory analysis should include between 150 and 200 subjects (Kline, 2005). According to Henson and Roberts (2006), in the psychometric study of a questionnaire, it is a good practice to confirm the factor structure found in EFA with CFA. With the EFA, it is possible to determine the number of factors, but not which items are related to each factor or the relationships between the factors. The CFA is used to demonstrate the validity of the factorial structure previously obtained with the EFA and, therefore, the validity of the inferred theoretical deductions (Arruda et al., 1996). Given that the Exploratory Factorial Analysis (AFE) was not devised for proving hypotheses or theories, the data are subjected to a Confirmatory Factorial Analysis (AFC) to check the following prior hypotheses: (a) the number of factors, (b) which factors are related or are independent, and (c) with which factor or factors are each of the variables related.

In order to check these hypotheses, three models are tested. The first one to be examined is that in which the existence of a single factor of the first order is postulated, in which case, all the items are related with this factor. Then, to check the hypothesis that allows us to verify the relationships between the factors, the two independent factor model and the two related factor model are tested.

In order to use the maximum likelihood method (Jöreskog and Sörbom, 1996) to perform the estimations, the assumptions of linearity and normal distribution of all the variables of the model should be met. The residual dispersion graphics showed linearity among the estimated variables. To determine whether the sample meets the normality criterion, we examined atypical values by applying Mahalanobis’ distance, using the Tests for normality and outliers option of the AMOS program. After eliminating some atypical scores, the data of the sample met the normality criterion.

Table 2 presents the goodness-of-fit indexes, considering three models: a one-factor model, a model with two independent factors, and a model with two correlated factors.


TABLE 2. Goodness-of-fit indexes of the proposed models.

All the models present a significant chi square value (p < 0.01) but as chi square tends to be statistically significant with large samples, from a practical perspective, it is more appropriate to take into account the magnitude of the value of chi square or of CMIN/df than the level of statistical significance: large values correspond to a poor fit and small values to a good fit.

We discarded the 1-factor model and the model of 2 independent factors. The CFI and TLI fit indexes should be higher than or equal to 0.95, a value that these models did not reach. Nor were values of the RMSEA and SRMR indicators reached, which should be lower than 0.08 and 0.10, respectively. The model with two related factors presented the best fit-index values (Figure 1).


FIGURE 1. Model of the CRCG (Questionnaire of Group Responsibility and Cooperation in Learning Teams) with two related factors.

The results of the model indicated that factors “Responsibility” and “Cooperation” are correlated (Φ = 0.90). On the other hand, the indicators of the latent factors revealed factor loadings ranging between λ = 0.62 and λ = 0.87 for the factor “Responsibility” and between λ = 0.58 and λ = 0.83 for the factor “Cooperation.” This indicates that the factors are well defined and, therefore, their assessment was adequate.

The model with two correlated factors shows evidence of the reliability of the questionnaire, with values higher than 0.50 for AVE, and values of 0.85 for CR (Global reliability: AVE = 0.57, CR = 0.95; Factor “Responsibility”: AVE = 0.60, CR = 0.92; Factor “Cooperation”: AVE = 0.52, CR = 0.87).

To show that the values obtained in the factor loadings are not conditioned by a single sample and are significant, we calculated a 95% confidence interval (CI) for these values using the bootstrap method, considered the most general and classic resampling method (Efron, 1979; Efron and Tibshirani, 1993). This method allows creating a large number of samples with replacement with the same data and calculating for each sample the value of the statistic studied. As shown in Table 3, using a total of 1000 samples, we obtained means for the values of the factor loadings very close to the values found in the confirmatory analysis. However, the values of the factor loadings fall between the upper and lower limits of the 95% CI and, therefore, all of them are significant.


TABLE 3. Bootstrap method, 1000 samples with 95% CI.

Analysis of Gender Invariance

We performed multi-group analysis to determine whether the model of two related factors was gender invariant, using a sample of 132 females and 68 males. Table 4 presents the results obtained in the comparison of the different models. There were significant differences in the value of chi square between the unconstrained model and the model with measurement residuals (p ≤ 0.001). However, Cheung and Rensvold (2002) state that the difference in the ΔCFI values of the different nested models may be an indicator of factor structure invariance. When the difference of the CFI decreases by 0.01 or less, the unconstrained model is accepted, and the null hypothesis of invariance cannot be rejected. Therefore, the ΔCFI values found in the unconstrained model and the different models with invariance indicate that the factor loadings of questionnaire are equivalent for females and males.


TABLE 4. Multi-group analysis of gender invariance.

Nomological Validity

Nomological validity refers to the degree to which the relationships of a construct with other constructs that form part of or an entire theory or theories can be confirmed empirically; that is, whether the theoretical configuration of the data corresponds with the theoretical predictions of that configuration.

In this case, we related the CRCG scores with the factors of the Learning Team Potency Questionnaire (CPEA; León et al., 2017). We found high significant correlations between the CPEA (Table 5) and the total score and the factors of the CRCG. These high correlations indicate that when the students perceive responsibility and cooperation, their confidence in the group’s effectiveness increases.


TABLE 5. Pearson correlations between CPEA and CRCG factors.


This aim of this present study was to create and validate a questionnaire that would allow us to simply and quickly evaluate responsibility and cooperation in university learning groups.

Regarding our goal, we can state that the CRCG has very acceptable psychometric characteristics, good internal consistency and temporal reliability. The factor adequacy measures of Kaiser-Meyer-Olkin and Bartlett’s test confirm the suitability of factor analysis. The analysis carried out has shown the existence of the two solid and well defined factors on which we based the construction of the scales, which explain 62% of the total variance. The factor loadings of the items that define the two factors have values higher than 0.50. According to Costello and Osborne (2005), when a factor is defined by 4–5 items with loadings above 0.50, it is a solid factor with practical relevance.

Lastly, the questionnaire was submitted to CFA, testing the three different factor structures: the first one, made up of 14 items grouped into a sole factor, the second with two independent factors, and the third with two correlated factors. The values that presented the best fit were those of the model with two related factors. The correlations between the two factors are high and statistically significant (p < 0.01). As the perceived degree of responsibility increases in one factor, the degree of cooperation in the other factor also increases.

Structural equation analysis and the application of the bootstrap method allowed us to verify that the values of the factor loadings fell between the upper and lower limits of the 95% CI, and all of them were significant. Therefore, the latent variables in the two factors are well defined and adequately assessed, reaffirming the good psychometric characteristics of the scale.

Diverse investigations reveal that females usually score higher than males in social skills and cooperation (Bandeira et al., 2006). In general, women are more expressive than men and, in their investigations, authors like Lafferty (2004) and Tapia and Marsh (2006), among others, showed that women are more perceptive, display more empathy, and better recognize other people’s emotions. This would explain their more positive social interaction with others. To ensure that in future investigations of the CRCG, gender differences are due to real differences in the construct assessed and not to different psychometric responses to the items of the questionnaire (Cheung and Rensvold, 2002; Pedraza and Mungas, 2008), we conducted multi-group analysis to determine whether the model of two related factors was gender invariant. The results obtained confirm the equivalence of men and women in the perception of the assessed construct. The data support the equivalence of the factor structure of the CRCG as a function of gender.

In addition, the relations between the CRCG and the CPEA clearly indicate an association between group cooperative skills and the beliefs of the team members about the team’s capacity to be effective. The concept of team potency was originally defined by Guzzo et al. (1993) in reference to a group’s collective beliefs in its effectiveness, and it is an essential construct related to group motivation. Team potency is the most relevant variable to predict performance and group efficacy when compared with other variables such as group composition, interdependence, work design, and organizational setting (Campion et al., 1996).

In situations of cooperative learning, students become aware that depend on one another and they must make the maximum effort and cooperate. All the team members share the responsibility for learning. Each team member commits to carrying out his or her part of the work and the team is considered responsible for achieving the goals. When the students perceive their team’s responsibility and cooperation, they think that the team has worked more efficaciously and it stimulates cohesion and trust among the members. No doubt, these mechanisms of cooperation and responsibility will increase confidence in the efficacy of the team.

On another hand, although the CRCG presents sufficient evidence of validity and reliability, it is not exempt from limitations, such as the difficulty to generalize the results to other groups of university population, which compromises the external validity (population and ecological) of the questionnaire, or to establish greater evidence of convergent and discriminant validity. In addition, the design of the items for the CRCG does not allow the extraction of self-reports or individual evaluations of the behavior of the different group members. As commented above, although this does reduce some evaluation biases, it also impedes obtaining individual results from the different team members. It would, therefore, be interesting to validate different versions of the CRCG, as this would allow us to establish self-reporting or individual evaluations individuals so as to better understand how each member of the team functions specifically. As future lines of research, besides resolving these limitations, it would be of interest to validate the CRCG in a non-university population.

Lastly, based on the above, it can be concluded that the CRCG can help to understand the Responsibility and Cooperation in Learning Teams in the University Setting. Its application is simple and fast, and it can be useful as a diagnostic and/or predictive measure, allowing us to know the students’ attitudes toward teamwork in general or regarding a certain subject or material, and if necessary, to design actions to improve teacher practice in cooperative, collaborative learning, or other forms of group or team learning. We think that university professors should create the conditions to guarantee optimal responsibility and cooperation in cooperative learning teams. To achieve this outcome implies teachers’ effort and interest and accepting that their role not only determines good team functioning and goal achievement, but also the satisfaction of all the students who participate in the diverse teams. To achieve the many advantages of cooperative learning in the university classroom requires the teachers to carefully design a program and to perform interventions throughout the process to resolve conflicts, and subsequently to analyze the teamwork.

There are many evolutionary reasons for the members of an intelligent species to try to live in peace (Pinker, 2003). Many computer simulations and mathematical models have demonstrated that cooperation is profitable from an evolutionary viewpoint. Cooperation is a characteristic of the human being that differentiates us from other species. In fact, cooperation has allowed us to adapt constantly to new environmental situations, making human development possible.

Author Contributions

BL-d-B and SM-L: analysis and interpretation of the data and also drafting the work. BL-d-B, SM-L, EF-C, FF-B, and DI-G: the conception and design of the work. All authors listed have made a substantial, direct and intellectual contribution to the work, and approved it for publication.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.


Alford, L. K., Fowler, R., and Sheffield, S. (2014). Evolution of student attitudes toward teamwork in a project-based, team-based first-year introductory engineering course. Paper Presented in 2014 at the ASEE Annual Conference, Indianapolis.

Google Scholar

American Psychological Association (2009). Publication Manual of the American Psychological Association, 6th Edn. Worcester, MA: American Psychological Association.

Google Scholar

Arruda, J. E., Weiler, M. D., Valentino, D., Willis, W. G., Rossi, J. S., Stern, R. A., et al. (1996). A guide for applying principal-components analysis and confirmatory factor analysis to quantitative electroencephalogram data. Int. J. Psychophysiol. 23, 63–81. doi: 10.1016/0167-8760(96)00032-3

CrossRef Full Text | Google Scholar

Bandeira, M., Silva, S., Cordeiro, L., Pereira, Z., and Del Prette, A. (2006). Social skills and sociodemographic variables in elementary school students. Psicol. Estud. 11, 541–549. doi: 10.1590/S1413-73722006000300010

PubMed Abstract | CrossRef Full Text | Google Scholar

Beigi, M., and Shirmohammadi, M. (2012). Attitudes toward teamwork: Are Iranian university students ready for the workplace? Team Perform. Manage. Int. J. 18, 295–311. doi: 10.1108/13527591211251087

CrossRef Full Text | Google Scholar

Bennet, N., and Dunne, E. (1991). The nature and quality of talk in cooperative classroom groups. Learn. Instr. 1, 103–118. doi: 10.1016/0959-4752(91)90021-Y

CrossRef Full Text | Google Scholar

Bruffee, K. A. (1995). Sharing our toys: cooperative learning versus collaborative learning. Change 27, 12–18. doi: 10.1080/00091383.1995.9937722

CrossRef Full Text | Google Scholar

Buchs, C., Gilles, I., Antonietti, J. P., and Butera, F. (2016). Why students need to be prepared to cooperate: a cooperative nudge in statistics learning at university. Educ. Psychol. 36, 956–974. doi: 10.1080/01443410.2015.1075963

CrossRef Full Text | Google Scholar

Burdett, J. (2006). Degrees of separation – balancing intervention and independence in group work assignments. Aust. Educ. Res. 34, 55–71. doi: 10.1007/BF03216850

CrossRef Full Text | Google Scholar

Campion, M. A., Papper, E. M., and Medsker, G. J. (1996). Relations between work team characteristics and effectiveness: a replication and extension. Pers. Psychol. 49, 429–452. doi: 10.1111/j.1744-6570.1996.tb01806.x

CrossRef Full Text | Google Scholar

Cava, M. J. (1998). Empowerment of Self-Esteem: Elaboration and Assessment of an Intervention Program. Doctoral thesis, University of Valencia, Valencia.

Cheung, G. W., and Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Struct. Equ. Modeling 9, 233–255. doi: 10.1207/S15328007SEM0902_5

PubMed Abstract | CrossRef Full Text | Google Scholar

Colás, P. (1993). Cooperative learning research-action as a proposal of methodological innovation in the university classroom. Rev. Enseñ. Interuniv. 5, 83–97.

Costello, A. B., and Osborne, J. W. (2005). Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. Pract. Assess. Res. Eval. 10, 1–9.

Google Scholar

Darnon, C., Dompnier, B., Delmas, F., Pulfrey, C., and Butera, F. (2009). Achievement goal promotion at university: social desirability and social utility of mastery and performance goals. J. Pers. Soc. Psychol. 96, 119–134. doi: 10.1037/a0012824

PubMed Abstract | CrossRef Full Text | Google Scholar

Del Caño, M., and Mazaira, O. (2002). “Peer relations in the classroom, self-concept and cooperative learning,” in Psicología de la Educación y Formación del Profesorado, eds I. Fajardo, I. Ruíz, A. Ventura, F. Vicente, and A. Julve (Teruel: Psicoex), 199–211.

Del Canto, P., Gallego, I., López, J. M., Mora, J., Reyes, A., Rodríguez, E., et al. (2009). Conflicts in teamwork: four representative cases. Rev. Formación Innovación Educ. Univ. 2, 344–359.

Dunning, D., Heath, C., and Suls, J. (2004). Flawed self-assessment: implications for health, education and the workplace. Psychol. Sci. Public Interest 5, 69–106. doi: 10.1111/j.1529-1006.2004.00018.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Efron, B. (1979). Bootstrap methods: another look at the jackknife. Ann. Stat. 7, 1–26. doi: 10.1214/aos/1176344552

CrossRef Full Text | Google Scholar

Efron, B., and Tibshirani, R. (1993). An Introduction to the Bootstrap. New York, NY: Chapman and Hall.

Google Scholar

Gaudet, A. D., Ramer, L. M., Nakonechny, J., Cragg, J. J., and Ramer, M. S. (2010). Small-group learning in an upper-level university biology class enhances academic performance and student attitudes toward group work. PLoS One 5:e15821. doi: 10.1371/journal.pone.0015821

PubMed Abstract | CrossRef Full Text | Google Scholar

Gillies, R. M. (2008). The effects of cooperative learning on junior high school students’ behaviours, discourse and learning during a science-based learning activity. Sch. Psychol. Int. 29, 328–347.

PubMed Abstract | Google Scholar

Gismero, E. (2000) EHS. Escala de Habilidades Sociales. Madrid: TEA.

Google Scholar

González, M., and Raposo, M. (2008). Formative needs of university teachers in the context of European convergence. Rev. Investigación Educ. 26, 285–306.

Gottschall, H., and García-Bayonas, M. (2008). Student attitudes towards group work among undergraduates in business administration, education and mathematics. Educ. Res. Q. 32, 3–28.

Google Scholar

Guzzo, R. A., Yost, P. R., Campbell, R. J., and Shea, G. P. (1993). Potency in groups: articulating a construct. Br. J. Soc. Psychol. 32, 87–106. doi: 10.1111/j.2044-8309.1993.tb00987.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Hall, R., Rocklin, T., Dansereau, D., Skaggs, L., O‘Donnell, A., Lambiotte, J., et al. (1988). The role of individual differences in the cooperative learning of technical material. J. Educ. Psychol. 80, 172–178. doi: 10.1037/0022-0663.80.2.172

CrossRef Full Text | Google Scholar

Hammar Chiriac, E. H. (2014). Group work as an incentive for learning–students’ experiences of group work. Front. Psychol. 5:558. doi: 10.3389/fpsyg.2014.00558

PubMed Abstract | CrossRef Full Text | Google Scholar

Hardy, C. J., and Latané, B. (1988). Social loafing in cheerleaders: effects of team membership and competition. J. Sport Exerc. Psychol. 10, 109–114. doi: 10.1123/jsep.10.1.109

CrossRef Full Text | Google Scholar

Henson, R. K., and Roberts, J. K. (2006). Use of exploratory factor analysis in published research: common errors and some comment on improved practice. Educ. Psychol. Meas. 66, 393–416. doi: 10.1177/0013164405282485

CrossRef Full Text | Google Scholar

Hijzen, D., Boekaerts, M., and Vedder, P. (2007). Exploring the links between students’ engagement in cooperative learning, their goal preferences and appraisals of instructional conditions in the classroom. Learn. Instr. 17, 673–687. doi: 10.1016/j.learninstruc.2007.09.020

CrossRef Full Text | Google Scholar

Ibarra, M. S., and Rodríguez, G. (2007). Collaborative groups in university classrooms: reflections on self-assessment. Rev. Educ. 344, 355–375.

Järvelä, S., Volet, S., and Järvenoja, H. (2010). Research on motivation in collaborative learning: moving beyond the cognitive–situative divide and combining individual and social processes. Educ. Psychol. 45, 15–27. doi: 10.1080/00461520903433539

CrossRef Full Text | Google Scholar

Johnson, D. W., and Johnson, R. (1982). Joining Together. Group Theory and Group Skills. Upper Saddle River, NJ: Prentice Hall.

Google Scholar

Johnson, D. W., and Johnson, R. (1987a). A Meta-Analysis of Cooperative, Competitive and Individualistic Goal Structures. Hillsdale, NJ: Lawrence Erlbaum.

Google Scholar

Johnson, D. W., and Johnson, R. (1987b). Learning Together and Alone. Englewood Cliffs; NJ: Prentice Hall.

Google Scholar

Johnson, D. W., and Johnson, R. (1990). Cooperation and competition. Theory and Research. Hillsdale, NJ: Addison-Wesley.

Google Scholar

Johnson, D. W., Johnson, R., and Maruyama, G. (1983). Interdependence and interpersonal attraction among heterogeneous and homogeneous individuals. A theoretical formulation and meta-analysis of the research. Rev. Educ. Res. 53, 5–54. doi: 10.3102/00346543053001005

CrossRef Full Text | Google Scholar

Johnson, D. W., Johnson, R., Stanne, M., and Garibaldi, A. (1990). Impact of group processing on achievement in cooperative groups. J. Psychol. 130, 507–516. doi: 10.1080/00224545.1990.9924613

PubMed Abstract | CrossRef Full Text | Google Scholar

Johnson, D. W., Maryuama, G., Johnson, R., Nelson, O., and Skon, L. (1981). Effects of cooperative, competitive and individualistic goal structures on achievement. A meta-analysis. Psychol. Bull. 89, 47–62. doi: 10.1037/0033-2909.89.1.47

PubMed Abstract | CrossRef Full Text | Google Scholar

Johnson, R. T., Johnson, D. W., and Holubec, E. J. (1998). Cooperation in the Classroom. Boston, MA: Allyn and Bacon.

Google Scholar

Jöreskog, K. G., and Sörbom, D. (1996). Lisrel 8: User’s Reference Guide. Chicago, IL: SSI.

Google Scholar

Karau, S. J., and Williams, K. D. (1993). Social loafing. A meta-analytic review and theoretical integration. J. Pers. Soc. Psychol. 65, 681–706. doi: 10.1037/0022-3514.65.4.681

CrossRef Full Text | Google Scholar

Kennett, D. J., Stedwill, A. T., Berrill, D., and Young, A. M. (1996). Co-operative learning in a university setting: evidence for the importance of learned resourcefulness. Stud. High. Educ. 21, 177–186. doi: 10.1080/03075079612331381348

CrossRef Full Text | Google Scholar

Kerr, N. L., and Bruun, S. E. (1983). Dispensability of member effort and group motivation losses: free rider effects. J. Pers. Soc. Psychol. 44, 78–94. doi: 10.1037/0022-3514.44.1.78

CrossRef Full Text | Google Scholar

Kirschner, F., Paas, F., Kirschner, P. A., and Janssen, J. (2011). Differential effects of problem-solving demands on individual and collaborative learning outcomes. Learn. Instr. 21, 587–599. doi: 10.1016/j.learninstruc.2011.01.001

CrossRef Full Text | Google Scholar

Kline, R. B. (2005). Principles and Practice of Structural Equation Modeling. New York, NY: Guilford Press.

Google Scholar

Kromrey, J. D., and Purdom, D. M. (1995). A comparison of lecture, cooperative learning and programmed instruction at the college level. Stud. High. Educ. 20, 341–349. doi: 10.1080/03075079512331381605

CrossRef Full Text | Google Scholar

Lafferty, J. (2004). The Relationships Between Gender, Empathy and Aggressive Behaviors Among Early Adolescents. Diss. Abstr. Int. B Sci. Eng. 64:6377B.

Google Scholar

León, B. (2006). Mediatory elements in the efficiency of cooperative learning: previous training in social skills and group dynamics. Anal. Psicol. 22, 105–112.

Google Scholar

León, B., Felipe, E., Gozalo, M., Gómez, T., and Latas, C. (2009). Improving students’ attitudes towards immigrants by means of cooperative learning. Rev. Psicol. Gen. y Aplicada 9, 159–173.

León, B., Felipe, E., Mendo, S., and Iglesias, D. (2015). Social skills in cooperative learning teams in the University context. Psicol. Conductual 23, 191–214.

León, B., Gozalo, M., and Polo, I. (2012). Cooperative learning and bullying. Infancia Aprendizaje 35, 23–35. doi: 10.1174/021037012798977494

CrossRef Full Text

León, B., Gozalo, M., and Vicente, F. (2004). Mediating factors in cooperative learning: interpersonal behavior styles. Apuntes Psicol. 22, 61–74.

León, B., Mendo, S., Felipe, E., Polo, M. I., and Fajardo, F. (2017). Team potency and cooperative learning in the university setting. J. Psychodidactics 22, 9–15. doi: 10.1387/RevPsicodidact.14213

CrossRef Full Text | Google Scholar

Martín, A. D. (2010). Introducción al Liderazgo Organizacional: Teoría y Metodología, Vol. 46. Madrid: Librería-Editorial Dykinson.

Google Scholar

Mendo, S., León, B., Felipe, E., Polo, M. I., and Palacios, V. (2016). Assessment of social skills of students of social education. J. Psychodidactics 21, 139–156. doi: 10.1387/RevPsicodidact.14031

CrossRef Full Text | Google Scholar

Mendo, S., Polo, M. I., Iglesias, D., Felipe, E., and León, B. (2017). Construction and validation of a measurement instrument for attitudes towards teamwork. Front. Psychol. 8:1009. doi: 10.3389/fpsyg.2017.01009

PubMed Abstract | CrossRef Full Text | Google Scholar

Nausheen, M., Alvi, E., Munir, S., and Anwar, R. (2013). Attitudes of postgraduate students towards cooperative learning. J. Educ. Res. 16, 107–115.

PubMed Abstract | Google Scholar

O’Donnel, A., Dansereau, D., Hall, R., Skaggs, L., Hythecker, V., Peel, J., et al. (1990). Learning concrete procedures. Effects of processing strategies and cooperative learning. J. Educ. Psychol. 82, 171–177. doi: 10.1037/0022-0663.82.1.171

CrossRef Full Text | Google Scholar

Ovejero, A. (1990). Cooperative Learning. An Efficacious Alternative to Traditional Teaching. Barcelona: PPU.

Ovejero, A. (1993). “Social skills training in the school setting,” in Proceedings of the Libro de Comunicaciones del III Congreso de Psicología Social, Vol. I, Santiago de Compostela, 381–388.

Palacios, A. (2004). The European credit as the key to change in the configuration of European higher education. Rev. Interuniversitaria Formación Profesorado 18, 197–207.

Google Scholar

Pallarés, M. (1993). Group Techniques for Educators. Madrid: Publicaciones ICCE.

Payne, B. K., and Monk-Turner, E. (2006). Students’ perceptions of group projects: the role of race, age, and slacking. Coll. Stud. J. 40, 132–139.

Google Scholar

Pedraza, O., and Mungas, D. (2008). Measurement in cross-cultural neuropsychology. Neuropsychol. Rev. 18, 184–193. doi: 10.1007/s11065-008-9067-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Pinker, S. (2003). The Clean Slate. The Modern Denial of Human Nature. Barcelona: Paidós.

Google Scholar

Rewey, K. L., Dansereau, D. F., Dees, S. M., Skaggs, L. P., and Pitre, U. (1992). Scripted cooperation and knowledge map supplements. Effects on the recall of biological and statistical information. J. Exp. Educ. 60, 93–107. doi: 10.1080/00220973.1991.10806582

CrossRef Full Text | Google Scholar

Rodríguez, F. J., and Ridao, S. (2014). Teamwork as a resource for promoting social skills in university students. Educ. Futuro 31, 273–288.

Smith, K. A. (1996). “Cooperative learning: making groupwork work,” in Using Active Learning in College Classes: A Range of Options for Faculty, eds T. E. Sutherland and C. C. Bonwell (San Francisco, CA: Jossey-Bass), 71–82.

Google Scholar

Solsona, N. (1999). Cooperative learning: a communication strategy. Aula Innovación Educ. 80, 65–67.

Tapia, M., and Marsh, G. E. (2006). The effects of sex and grade-point average on emotional intelligence. Psicothema 18, 108–111.

PubMed Abstract | Google Scholar

Webb, N. M. (2009). The teacher’s role in promoting collaborative dialogue in the classroom. Br. J. Educ. Psychol. 79, 1–28. doi: 10.1348/000709908X380772

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: responsibility, cooperation, team efficacy, cooperative learning, university, students

Citation: León-del-Barco B, Mendo-Lázaro S, Felipe-Castaño E, Fajardo-Bullón F and Iglesias-Gallego D (2018) Measuring Responsibility and Cooperation in Learning Teams in the University Setting: Validation of a Questionnaire. Front. Psychol. 9:326. doi: 10.3389/fpsyg.2018.00326

Received: 01 December 2017; Accepted: 26 February 2018;
Published: 13 March 2018.

Edited by:

Jesus de la Fuente, University of Almería, Spain

Reviewed by:

Joan Guàrdia-Olmos, Universitat de Barcelona, Spain
Melissa Christine Davis, Curtin University, Australia

Copyright © 2018 León-del-Barco, Mendo-Lázaro, Felipe-Castaño, Fajardo-Bullón and Iglesias-Gallego. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Santiago Mendo-Lázaro,