Your new experience awaits. Try the new design now and help us make it even better

ORIGINAL RESEARCH article

Front. Educ., 28 October 2025

Sec. Digital Education

Volume 10 - 2025 | https://doi.org/10.3389/feduc.2025.1655913

This article is part of the Research TopicDigital Learning Innovations: Trends Emerging Scenario, Challenges and OpportunitiesView all 33 articles

Cooperative learning with QR codes technology: enhancing cognitive achievement and attitudes among students

  • Department of Physical Education and Kinesiology, College of Education, Qassim University, Buraidah, Saudi Arabia

Introduction: Integrating quick response (QR) codes into cooperative learning may streamline access to multimedia, reduce extraneous cognitive load, and improve learning outcomes in technology-rich courses.

Methods: A quasi-experimental single-group, repeated-measures design was used with 30 regularly attending undergraduates in “Technology in Sports.” Students completed a cognitive test at pre-, post-, and 1-month follow-up; attitudes were collected post-course via a validated Likert instrument. Instruction employed five cooperative strategies (Think–Pair–Share, Timed Pair Share, Three-Step Interview, Jigsaw, Case Study) supported by QR-linked resources.

Results: Repeated-measures ANOVA showed significant gains from pre- to post-test with retention at follow-up (η² = 0.89, α = 0.05). Post vs. follow-up differences were nonsignificant, indicating maintenance. Power analysis indicated 1 − β = 1.00. Attitude scores were positive across cognitive, emotional, and behavioral dimensions.

Discussion: QR-supported cooperative learning improved and sustained cognitive achievement and elicited favorable student attitudes. Thoughtful instructional design, teacher readiness, and high-quality resources appear critical to effectiveness.

Conclusion: Embedding QR technology within cooperative learning is a feasible, learner-centered approach that enhances outcomes and attitudes in higher-education sport-technology courses.

Introduction

The massive information revolution of the twenty-first century has brought about advanced technologies that greatly influence the development of education. In order to enhance the effectiveness of educational environments, educators have been working on developing educational systems that incorporate technological innovations and benefit from them. Mobile phones connected to the internet are now considered one of the most significant technological advancements globally, regardless of culture, social status, or economic status. Providing students with efficient access to education anytime, anywhere, according to their preferences and needs, has become imperative. Lan et al. (2010) proposed the use of mobile phone services in educational institutions, a suggestion that has gained widespread support among educators. This concept, known as mobile learning, has become increasingly popular.

E-learning, according to Pahl (2008), is one of the primary modern methods of education as it overcomes time and space limitations and offers solutions that cater to learners’ needs. As a concept, e-learning pertains to an electronic learning system, also known as a Learning Management System, a Virtual Learning System, a Content Management System, or a Mobile Learning System. In addition to learning materials, it also provides support for infrastructure resources. The infrastructure facilities within the e-learning system allow for the uploading, storage, access, and transfer of educational content.

In 1994, Denso Wave introduced the QR code to the Japanese car manufacturer Toyota as a type of barcode that can be scanned. QR codes have a higher storage capacity compared to barcodes because they store information both vertically and horizontally, unlike barcodes that only store information horizontally. Mobile phones can be used to decode and read QR codes by using specific programs designed for this purpose (Göksu and Atici, 2013; Qiao et al., 2015; Saravani and Clayton, 2009).

QR codes are useful in education because of their massive storage capacity, which allows students to transition from printed educational materials to digital ones by scanning the QR codes using their smartphones (Robertson and Green, 2012). Numerous studies have demonstrated the effectiveness of QR Code technology in a variety of educational settings. Educators can use this technology to enhance printed educational materials, facilitate learners’ access to digital resources, and guide learners through well-structured educational plans. Additionally, QR codes can improve learning effectiveness, boost learners’ self-motivation, and enable them to choose preferred learning sources (Abeywardena, 2017; Carrondo and Gil, 2019; Chung et al., 2019; Durak et al., 2016; Ortega-Sánchez and Gómez-Trigueros, 2019; Widyasari et al., 2019; Wu et al., 2018).

The concept of cooperative learning is an educational strategy that encourages students to work together in small, independent groups to achieve a common goal. They are assessed both individually and collectively (Johnson and Johnson, 2009). It is important to distinguish between cooperative and collaborative learning in this context. Cooperative learning involves students working together to accomplish common goals under teacher guidance and instruction, allowing for both collective and individual assessment (Millis and Cottell, 1997). Collaborative learning, on the other hand, focuses on learners and their ability to interact freely. Learners in collaborative learning must search for and navigate resources on their own (Panitz, 1999). Davidson and Major (2014) explain that both terms aim to develop learners’ higher-order thinking skills (HOTS).

In several studies, cooperative learning groups have shown significantly better performance compared to non-collaborative groups. Additionally, students who were exposed to cooperative teaching methods reported significantly more positive attitudes toward classroom instruction. Teachers also agreed that cooperative learning is effective for students’ academic and social learning, and can provide individualized support for their learning processes. These findings are supported by studies conducted by Abramczyk and Jurkowski (2020), Namaziandost et al. (2020), and Agonafir (2023).

Consequently, the significance of this study lies in proposing an instructional design that combines the benefits of cooperative learning strategies with QR code technology. The study aims to determine if this integration positively impacts students’ cognitive development and attitudes toward learning. It is a serious scientific endeavor to utilize digital learning resources such as educational texts, videos, and electronic educational games for the Technology in Sports Sciences course. Student cooperative groups can access these resources by scanning QR codes with a mobile phone, enhancing the printed scientific material for the course. Additionally, pre-prepared task cards will be provided for cooperative learning groups, tailored to the needs and requirements of different lesson stages in the Technology in Sports Sciences course. Therefore, the current study aims to investigate the effectiveness of cooperative learning with QR codes in enhancing students’ cognitive achievements and attitudes.

Theoretical framework

Cooperative learning

Cooperative learning involves students working in small groups to achieve common learning goals, assessing their progress individually and collectively (Johnson and Johnson, 2009). Lougheed et al. (2012) describe it as an active learning strategy that engages students in the learning process. Davidson and Major (2014) have found a positive link between cooperative learning and the development of students’ higher-order thinking skills (HOTS).

Lev Vygotsky proposed the sociocultural constructivist theory (Bruning et al., 2011). This theory states that knowledge exists in a social context. Eggen and Kauchak (2013) emphasize the importance of activity in learning that arises in directed social situations. Johnson and Johnson (2009) identify two types of social interdependence between individuals: positive interdependence, characterized by individuals striving to achieve common goals, and negative interdependence, occurring when individuals hinder each other’s goals. Therefore, the teacher seeks to foster positive social interdependence among students so they can achieve the desired knowledge structure independently.

Haenen et al. (2003) point out that according to Vygotsky, learners can only learn by engaging directly in meaningful activities with more intelligent people. Through interactions with others, learners improve their understanding, knowledge, and develop an understanding of others. Vygotsky also noted that the learner’s ability, according to this theory, develops through two levels: the social level, meaning the learners’ social educational environment that enhances their learning, and the learner’s psychological level, referring to the mental and psychological processes that occur within the learner’s mind during interaction with the social educational environment. Thus, this theory focuses on both the external and internal social educational environment as fundamental factors in the formation of knowledge and cognitive development of the individual.

According to Johnson and Johnson (2009), cooperative learning is based on sociocultural theory. They suggest that cooperative learning strategies should have the following five characteristics:

• Positive interdependence: This idea implies that individuals work together toward a common goal, taking responsibility for their own learning as well as that of others, and recognizing that success for one enhances success for all.

• Individual accountability: Each student in the group should be accountable for their own learning and performance, as well as that of the group, to prevent free riding and social loafing. Performance is evaluated individually, and feedback is provided to identify who needs more support, encouragement, and help.

• Face-to-face promotive interaction: Individuals can help each other overcome challenges, share resources, provide feedback, and build knowledge together. This fosters motivation through respect, interest, and encouragement.

• Interpersonal and small group skills: Members of a group can discuss work, assist each other, and update materials to ensure smooth progress. Each member’s unique contributions are essential for group success, as strengths are collaboratively pooled. Responsibility for group cohesion, decision-making, leadership, communication, trust-building, respect, and conflict resolution are crucial.

• Group processing: This allows the group to continuously improve its collaboration over time, focusing on individual accountability, simplifying learning processes, and eliminating non-contributory actions. Teachers set objectives, explain expectations, observe group dynamics, and intervene as needed to enhance learning. Students and groups then carry out their roles in the group process.

In order to ensure that cooperative learning is successful, it is important to have these five fundamental principles in place (Johnson et al., 2000; Sharan, 2015).

Because of the intense focus on promoting teamwork among students, a variety of cooperative learning techniques have been developed to facilitate collaboration. These techniques include Think-Pair-Share (Lyman, 1992), Three-Step Interview, Timed Pair Share (Kagan and Kagan, 2015), Jigsaw (Aronson et al., 1978), Scripted Cooperation (O'Donnell, 1999), Guided Design (Newsome and Tillman, 1990), Concept Mapping (Clayton, 2006), Active Knowledge Sharing (Silberman, 1996), Teammates Consult, Numbered Heads Together (Kagan, 1992), Teams – Games – Tournaments (TGT) (De Vries and Slavin, 1978), Learning Together (Gokkurt et al., 2012), and Throw the Ball (Johnson and Johnson, 1999). These cooperative learning techniques have served as the foundation for numerous other methods, either through the adaptation of their procedures or the creation of new techniques within the same framework.

Gillies and Khan (2008) warned about the negative consequences of improperly implementing cooperative learning techniques. These consequences include some group members not responding as expected, conflicts and compliments occurring within the same group, negativity from certain group members, and a lack of acceptance of the concept of group evaluation among many students. This leads students to reject the idea of assisting their peers and instead concentrate on their individual performance within the group. Furthermore, some teachers may lack an understanding of how to effectively implement cooperative learning.

To address these challenges and ensure that cooperative learning techniques are implemented successfully, Berk and Winsler (1995) suggest that the teacher should identify each student’s Zone of Proximal Development (ZPD) by giving a short quiz or conducting an introductory discussion on the topic. During this discussion, the teacher should ask students questions to determine what they already know. It is imperative to encourage group work by creating groups that include students with different skill sets and learning levels. This diversity can increase the amount that students learn from each other. In addition, it is crucial to ensure that each student in the group participates actively. The teacher should try not to provide too much assistance, as this could make the student passive rather than active, reducing the learning experiences gained. Additionally, it is important to encourage students to think aloud. By asking students to think aloud, the teacher can determine their current skills and ensure that they are actively engaged in the learning process.

QR codes technology in education

A QR code is short for Quick Response Code. Robertson and Green (2012) define it as a two-dimensional square with small squares of different sizes and spaces between them at varying distances. These squares contain data stored with a capacity of 4,000–7,000 characters. By using specific applications, mobile phones can scan QR codes and access letters, numbers, texts, symbols, and web links. The QR code is also described by Ortega-Sánchez and Gómez-Trigueros (2019) as a matrix-like system of dots that encodes a wide range of information. It is characterized by three squares at the corners that can be detected by the reading application, as illustrated in Figure 1:

Figure 1
Diagram of a QR Code showing five labeled areas: (1) position squares at the corners, (2) version information, (3) alignment and border markers, (4) format data type region, and (5) synchronization pattern defining matrix size for accurate code detection.

Figure 1. QR-code areas.

Area (1) Position: includes the squares in the three corners. This allows the QR-Code Reader application to recognize the border of the code and start reading it. The surrounding margins should be white for it to work efficiently and swiftly.

Area (2) QR Code Version: The second area provides information regarding the version used to generate the QR code.

Area (3) Alignment - Borders: The third area mark provides help to the reader application during automatic drawing to correct distortions caused by perspective.

Area (4) Format: The fourth area indicates to the reader application what type of information is being stored (VCARD - URL - text - SMS, etc.).

Area (5) Synchronization: Between the squares in the three corners is the fifth area, which indicates the matrix’s size.

QR codes can be considered a valuable tool in mobile learning within education. Learners can use QR codes to access supplementary resources such as text, URLs, or other data, providing them with a deeper understanding of a subject. Smartphones with QR code reader apps allow learners to access text, open web pages, send automated SMS messages, and more. QR codes can be easily read and decoded using various free mobile apps. Additionally, QR codes can be integrated into alternate reality games that aim to address educational challenges (Lee et al., 2011). When integrating technology in education, it is crucial to focus more on the learners than on the technology itself. Instead of simply incorporating technology into education and learning, QR codes should enhance learner-centered learning through innovative teaching strategies (Wu et al., 2010). Furthermore, they enable learning outside of the classroom, as school books are not the only source of educational materials (Rikala and Kankaanranta, 2014).

QR codes are also used in a variety of educational activities, allowing for a direct link between the physical world (printed materials) and the virtual world (online resources). This enables teachers to develop or select digital resources that can be filtered according to the age and ability level of the students. This is particularly useful as most, if not all, students already have mobile devices (Skeele, 2013).

According to Rikala and Kankaanranta (2014) study, QR codes can increase students’ motivation to learn. They engage students in stimulating and meaningful activities that enhance their learning experience and provide them with authentic tasks inspired by real-world situations. Traser et al. (2015), and Chung et al. (2019) both found that QR codes enhance learning outcomes, facilitate learning effectiveness, and improve learners’ attitudes toward courses and educational experiences. As Abeywardena (2017) pointed out, QR codes can bridge the gap between printed scientific material and multimedia. So (2011) and Palazón and Giráldez (2018) explained that the integration of QR codes into printed educational materials improves the relationship between the activity in the book and an additional online activity. QR codes, according to Karia et al. (2019), can be used to link various multimedia resources to reduce learners’ cognitive load. Students are given autonomy over their learning, supporting a student-centered approach. This also allows students to assess their own learning, access a variety of resources, and enhance self-motivation. Additionally, it provides opportunities for increased interaction and supports both independent and collaborative learning approaches.

Cognitive load theory (CLT)

Cognitive Load Theory emphasizes that the effectiveness of learning is fundamentally constrained by the limited capacity of working memory, which can process only a small amount of information simultaneously. When instructional materials are overly complex or poorly structured, they may overload this system, resulting in reduced learning efficiency. To facilitate optimal learning, instructional design must carefully manage cognitive demands to avoid overloading the learner’s mental resources (Stiller and Bachmaier, 2018; Sweller, 2010).

Sweller (2010) identifies three types of cognitive load: intrinsic, germane, and extraneous. Intrinsic load is tied to the inherent complexity of the material and the learner’s prior knowledge. Germane load reflects the effort devoted to building and refining mental schemas that support deeper understanding and long-term retention. Conversely, extraneous load refers to cognitive demands arising from suboptimal instructional design, such as irrelevant content, confusing layouts, or inefficient delivery methods, which unnecessarily occupy working memory and hinder learning (De Jong, 2010; Stiller and Bachmaier, 2018; Sweller, 2010).

In previous work, it was shown that the integration of 3D hologram technology within structured, reciprocal teaching environments significantly reduced extraneous load and enhanced students’ skill acquisition by enabling them to visualize complex movements in manageable segments (Rakha, 2023a). The findings suggested that immersive technologies, when embedded in well-structured pedagogical strategies, can enhance mental model formation and reduce cognitive strain during motor learning.

Building on these findings, the current study applies the same theoretical lens to a new learning context: cooperative learning supported by QR code technology. QR codes, by providing instant access to targeted multimedia content (e.g., videos, diagrams, or instructions), can reduce the extraneous cognitive burden associated with locating or decoding information. When integrated into cooperative tasks, this technology promotes shared information processing, peer-assisted learning, and more efficient engagement with instructional material—thereby optimizing germane cognitive load and supporting schema development.

This approach, grounded in CLT, seeks to examine whether QR-enhanced cooperative learning environments can similarly improve cognitive achievement and foster positive learning attitudes among students, particularly in knowledge-intensive or digital-rich settings.

Instructional approach in the present study

The instructional approach employed in the present study is grounded in cooperative learning principles enriched by QR code technology, aiming to foster meaningful student interaction, shared responsibility, and active engagement with digital resources. This design seeks to enhance cognitive achievement and promote positive learning attitudes by integrating structured cooperative techniques with easily accessible multimedia content.

A set of well-established cooperative learning strategies was implemented throughout the intervention, each selected for its ability to foster peer interaction, critical thinking, and individual accountability. These included:

• Think–Pair–Share: This strategy encourages individual accountability followed by peer interaction and group synthesis. Students first scanned a QR code linking to a thought-provoking question, short video, or infographic. They independently reflected on the material, paired up to discuss their interpretations, and finally shared synthesized responses with the class. QR-linked content provided diverse entry points for understanding, fostering metacognitive reflection and collaborative refinement.

• Timed Pair Share: Designed to ensure balanced participation and active listening, students were paired and given timed intervals to discuss a prompt. QR codes guided the discussion by presenting digital tasks such as diagrams, brief tutorials, or concept images. This structure not only enhanced oral expression and listening but also grounded conversations in shared digital content, allowing students to anchor their responses in consistent resources.

• Three-Step Interview: This triadic structure promotes deeper communication and role rotation. Students formed groups of three and rotated between the roles of interviewer, interviewee, and recorder. QR codes presented varied perspectives or real-world contexts (e.g., videos, expert quotes, or case outlines) to frame the interviews. This fostered inclusive dialogue, strengthened interpersonal skills, and supported collaborative knowledge construction.

• Jigsaw Strategy: Jigsaw is centered on positive interdependence, where each student is responsible for mastering and teaching a segment of the material. QR codes were used to provide individualized digital content (videos, articles, infographics) for each “expert” student. After studying their assigned piece, students returned to their home groups and taught their peers. This method not only ensured full participation but also deepened learning through peer explanation, with QR content supporting clarity and consistency.

• Case Studies: This group-based strategy immerses students in complex, real-world scenarios. QR codes granted access to digital case files—videos, documents, or simulations—allowing teams to analyze, discuss, and propose solutions. By engaging with multimedia sources, students collaborated on critical thinking, applied theoretical knowledge to authentic problems, and developed evidence-based reasoning in a cooperative setting.

As shown in Figure 2, the instructional design incorporated five cooperative learning techniques, each supported by QR code technology that enabled students to interact with multimedia content, explore learning materials, and collaborate more effectively.

Figure 2
Illustration showing four teaching strategies with text descriptions.

Figure 2. Cooperative learning techniques enhanced by QR code technology.

QR codes were embedded in instructional materials such as worksheets and activity guides, allowing students to scan and access supplementary digital content including videos, interactive models, and online simulations. These resources were directly aligned with the learning objectives of each cooperative task, supporting student autonomy and inquiry-based learning.

The teaching process unfolded in four main phases:

• Orientation and Preparation: Students were introduced to the learning objectives, cooperative roles, and how to use QR codes.

• Engagement with Content: Learners participated in structured cooperative strategies, scanning QR codes to access materials as needed.

• Facilitation and Monitoring: The teacher guided group interactions, clarified misunderstandings, and encouraged critical thinking.

• Reflection and Presentation: Groups shared findings, discussed learning outcomes, and reflected on the collaborative process.

This integrative instructional model aligns with the principles of Cognitive Load Theory, aiming to reduce extraneous cognitive load through efficient access to learning materials while increasing germane load by supporting active schema construction. It also draws upon prior findings indicating the effectiveness of technology-supported collaborative methods in enhancing student performance and engagement (Rakha, 2023a).

Materials and methods

Bias mitigation measures and ethical protocols

Given that the researcher also served as the course instructor, specific methodological safeguards were implemented to ensure objectivity and minimize potential bias throughout the study.

• The research was reviewed and approved by the Research Ethics Committee of the Department of Physical Education and Kinesiology, College of Education, Qassim University (Approval No. 01452142024). Prior to participation, all students received a written informed consent form that detailed the study’s objectives, significance, procedures, voluntary nature, and participants’ right to withdraw at any time. The final section of the form included a clear prompt allowing participants to indicate whether they agreed or declined to participate.

• The course was conducted over a full academic semester, comprising 2 contact hours per week for 12 weeks, following institutional academic guidelines. To ensure the neutrality of evaluation, cognitive achievement assessments (pretest, posttest, and follow-up) were graded by an independent faculty member from the same department who specializes in physical education pedagogy. The follow-up test was administered after the final course grades were released to eliminate any perception of pressure or bias.

• Students’ attitudes were measured using an anonymous self-report instrument distributed via Google Forms. No identifying information was collected, ensuring full confidentiality and encouraging honest, unbiased responses.

• All data collected were handled with strict confidentiality. Responses were anonymized using coded identifiers, and no personal data were stored. Digital responses were collected through secure platforms and stored in encrypted, password-protected folders accessible only to the research team. The data were used exclusively for research purposes and were not shared with any third party, thus preserving the privacy and security of participant information throughout the study.

• The study followed a quasi-experimental single-group repeated measures design, ensuring equal learning opportunities for all students. A repeated-measures ANOVA was employed to analyze changes over time within the same group.

Design

A quasi-experimental design was utilized, with one experimental group receiving repeated measures. QR code technology, along with cooperative learning techniques, was implemented in this group. Cognitive achievement levels were measured at multiple points (pre, post, and during a follow-up) using cognitive tests to assess the long-term impact of the teaching strategy. A follow-up measurement was conducted after a month-long break from teaching and learning.

RQ1: Are there statistically significant differences, at a significance level of 0.05, among the repeated measurements (pre, post, and follow-up) of the learning effect for the students in the experimental group?

Ha: Based on the repeated measurements (pre, post, and follow-up assessment of the learning effect) for the students in the experimental group, there are statistically significant differences in cognitive achievement levels.

To investigate students’ attitudes regarding the QR code technology incorporated with cooperative learning techniques used in teaching the “Technology in Sports Science” course, a descriptive method was conducted. An online survey was designed with closed and open-ended questions to investigate students’ attitudes regarding the proposed teaching strategy. The following question was asked:

RQ2: What are the attitudes of students toward cooperative learning with QR code technology used in the “Technology in Sports Science” course?

An overview of the conceptual structure guiding this study is provided in Figure 3, highlighting the relationships among the key variables and the flow of the research process.

Figure 3
Flowchart illustrating the relationship among variables in a study. The independent variable is

Figure 3. Conceptual framework of the current study.

Study population and sample

The sample size for this study consisted of 33 students who were enrolled in the course “Technology in Sports Sciences” during the 2nd semester of the 2023/2024 academic year. This is an elective course that meets for one theoretical credit hour per week (two face-to-face hours) and is part of the Bachelor of Sports Sciences and Physical Activity program offered by the Department of Physical Education and Kinesiology at Qassim University College of Education. Three students who had poor attendance records were excluded from the experiment, leaving a total of 30 students in the experimental group. All 30 students provided informed consent to participate in the study. The course was taught to them in accordance with the university-approved description, utilizing QR code technology integrated with cooperative learning techniques.

Data collection tools

The cognitive achievement test

Based on the approved course description, a cognitive achievement test was developed to meet the current study’s objective. The test was conducted as follows:

The table of specifications (TOS)

According to Gronlund (1998), teachers can create balance in testing by aligning the relative weights of learning outcomes, content, and assessment purposes. Using the following formulas, the number of topic questions and their scores are calculated (Rakha, 2023b):

Topic relative weight ( % ) = ( Total number of teaching hours or days allocated to a specific topic ) / ( The number of hours allotted to teaching the entire course ) × 100
Learning outcomes category relative weight ( % ) = ( number of learning outcomes in the category ) / ( total number of learning outcomes in the course ) × 100
The number of test items in the category of learning outcomes for each topic = Proposed total number of test items × Topic relative weight × Learning outcomes category relative weight
The Learning outcomes category score for each topic = Final score proposed for the test × Topic relative weight × Learning outcomes category relative weight

The TOS for the cognitive test is detailed in Table 1.

Table 1
www.frontiersin.org

Table 1. Table of specification (TOS).

Formulating and validating test items

In order to assess various levels of thinking, the items were originally created as true-false questions, matching questions, multiple-choice questions, and essay questions based on the TOS. Five experts in physical education curriculum and methodologies reviewed the test items to confirm the content validity of the test (Hays and Revicki, 2005).

Analyzing the difficulty and discrimination indexes

According to Gregory (2015), difficulty indexes are a useful technique for determining whether test items require revision or removal. A question’s ideal difficulty level falls between 0.30 and 0.70, with an average of 0.50. According to Bichi (2016), the difficulty index is calculated as follows: P = R/N, where R is the number of examinees who answered the question correctly, and N is the total number of examinees.

Discrimination index measures how well a test item distinguishes between high-scoring and low-scoring examinees, denoted by the symbol (d). The upper and lower bands are typically calculated based on 10–33% of the highest and lowest scores of examinees. For normally distributed scores, it is recommended to compare the top 27% with the bottom 27%. In cases where results are more evenly distributed than a normal curve, a percentage around 33% is preferable. The calculation of (d) is as follows: d = (U − L)/N, where U represents examinees who answered the question correctly and were in the top quartile, L represents examinees who answered the question correctly and were in the bottom quartile, and N represents the total number of examinees in the top or bottom quartiles. Ideally, a discrimination index should range from −1.00 to +1.00. In cognitive achievement tests, an index greater than 0.20 is considered acceptable. Any item showing negative discrimination will be excluded (Gregory, 2015).

Bichi (2016) interprets d in the following manner:

• If d is greater than or equal to 0.40, the item functions without any issues and operates exceptionally well.

• If d falls between 0.30 and 0.39, the item is considered adequate and requires little to no adjustment.

• If d is between 0.20 and 0.29, the item requires revision because it is considered marginal.

• If d is less than or equal to 0.19, the item must be removed or completely rewritten.

Sixteen students who completed the Technology in Sports Sciences course in the first semester 2023/2024 and were not included in the basic sample for the current study took the initial form of the cognitive achievement test to determine the test’s difficulty and discrimination indexes. The results indicated that the difficulty indexes (P) ranged from 0.32 to 0.46, while the discrimination indices (d) ranged from 0.30 to 0.46.

Reliability

The reliability of the cognitive achievement test was evaluated using Cronbach’s Alpha coefficient. The coefficient obtained was 0.81, indicating good reliability (Taber, 2018). The final version of this test is included in Appendix A.

A self-assessment tool for evaluating students’ attitudes toward QR code technology when integrated with cooperative learning techniques

To assess students’ attitudes toward QR code technology when integrated with cooperative learning techniques, a self-assessment tool was created. According to Conner et al. (2021), attitudes were evaluated across three dimensions: cognitive, emotional, and behavioral. The final self-assessment tool consisted of 13 items, each rated on a five-point Likert scale: strongly agree, agree, neutral, disagree, and strongly disagree. These responses were then assigned values of 5, 4, 3, 2, and 1, respectively. To establish the validity and reliability of the tool, the following methods were utilized:

(a) Content validity: An initial evaluation round was conducted by five arbitrators, all of whom held PhDs in educational technology and physical education teaching methods. Several items were revised based on their feedback and recommendations.

(b) Internal consistency validity: An exploratory sample of 16 students, who were not part of the original sample, was evaluated using the proposed self-assessment tool after being exposed to QR code technology and cooperative learning techniques. The correlation of each item with its corresponding axis was determined. The students completed the assessment through an online Google Form. Subsequently, the Pearson correlation between each item and its axis was calculated. A significant positive correlation was discovered between each item and its axis, with r(14) = 0.70–0.92, p < 0.01. These findings suggest a high level of internal consistency (Schober et al., 2018).

(c) Reliability: The reliability of the tool was assessed using Cronbach’s alpha coefficient. The values ranged from 0.79 to 0.94, exceeding the acceptable threshold of 0.70, which indicates good reliability (Taber, 2018).

A QR code-based learning program that incorporates cooperative learning techniques.

The ADDIE model (Branch, 2009) was used to design the educational program, incorporating QR code technology along with cooperative learning techniques:

1 Analysis: This stage involved designing and specifying the following:

 a The primary objective is to enhance the level of cognitive achievement related to the topics covered in the sports technology course.

 b Student characteristics: The study sample consisted of individuals aged 19–23. According to Spano (2004), students in this age group possess the ability to set and achieve goals, articulate their ideas, maintain a clear sense of their roles in life, demonstrate a strong work ethic, and assume individual responsibility. They exhibit cognitive development, often discuss their experiences and experiments, and can explain concepts logically and objectively. As a result, they are equipped to solve problems, engage in discovery, think critically, and make inferences through both collaborative and competitive learning. Additionally, they utilize visual media and technology to enhance their understanding and thinking processes.

 c Educational activities: A teacher and a student participate in the following activities:

 • Teacher Activities: During the cooperative learning strategy, the teacher reviews the lesson objectives, provides students with exercises, guides them in using an educational website that incorporates QR code technology, and explains their roles in utilizing task cards. Following the lesson sequence and procedures, the teacher instructs students to scan QR code stickers using a smartphone application to access the digital resources available on the website. In addition to explaining the cooperative learning strategy and the integration of technology in education, the teacher also monitors the cooperative work groups and assists them in achieving the desired objectives.

 • Student Activities: Using the QR Code Reader application on a smartphone, students can access the digital resources on the educational website. They should follow the lesson procedures and guidance provided by the teacher. As part of a cooperative work group, students are responsible for completing tasks outlined on task cards. They should interact with educational videos, answer questions while watching, and participate in electronic activities in accordance with the lesson sequence. This will help them track their notes and progress effectively.

 d The educational content is as follows: The development of the educational content was guided by a description of the technology in the sports course, approved by the Department of Physical Education and kiensology at Qassim University. Topics covered include Virtual Reality in Sports, Artificial Intelligence in Sports, Arbitration in Sports: A Technological Approach, Sports Health and Technology, and Integrating Technology into Sports Management.

2 Design: During this stage, the following elements were designed and defined:

 a Behavioral objectives design: Following Bloom’s taxonomy, 26 cognitive behavioral objectives were identified and categorized into the six cognitive levels outlined in the TOS (Bloom et al., 1956).

 b Teaching strategies: To engage the experimental group with the educational website supported by QR Code technology, a variety of cooperative learning strategies were employed. These included Think–Pair–Share, Timed Pair Share, Three-Step Interview, Jigsaw Strategy, and Case Studies (Johnson and Johnson, 2009).

 c Formative assessment strategy: Using TechSmith Camtasia (Camtasia, 2023), multiple-choice questions were embedded in educational videos to serve as formative assessment tools. According to the video scenario, playback is paused at specific intervals, prompting a question that the student must answer to continue watching. If the student answers correctly, they receive immediate reinforcement; if they answer incorrectly, they receive instant feedback. Additionally, the Wordwall website was utilized to design interactive electronic activities (Wordwall, 2023).

 d Design of task cards: The task cards included instructions, lesson objectives, teaching strategies, tasks, and time allocations for each task. These elements guided the students in the experimental group during their cooperative learning activities. According to Mosston and Ashworth (1986), task cards help students engage in tasks more effectively, enhancing efficiency and productivity in the educational process. They also reduce the need for repetitive instruction from teachers and empower students to take responsibility for their own learning.

 e Time frame: The study plan for the Technology in Sports course, along with the credit hours allocated for each topic, was followed as outlined in the previous TOS.

3 Development

 a QR code design: QR codes were generated using the website https://www.qrcode-monkey.com/. This free website produces highly accurate codes. With its various design options, QR codes can be customized to reflect their intended use (Qrcode monkey, 2023).

 b The educational website was developed using the following software:

 • The Website X5 v16 Professional program is used for creating and designing web pages, inserting digital resources, establishing links, and publishing websites on the Internet (WebSite X, 2023).

 • TechSmith Camtasia version 2019.0.10 is a program used for creating educational videos (Camtasia, 2023).

 • Production of web-based educational activities and training sessions utilizing the website https://wordwall.net/ (Wordwall, 2023).

 c Educational and technological standards must be considered when designing educational websites. As Lencastre and Chaves (2008) assert, effective websites provide reliable content and are easy to navigate. A well-designed website should adhere to established quality standards. Egger (2001), Roy et al. (2001), Lee and Kozar (2012), Huang and Benyoucef (2014), and Panda et al. (2015) have identified the most important criteria for website design: consistency, learnability, simplicity, ease of navigation, readability, content relevance, supportability, interactivity, credibility, and remote presence.

4 Implementation: From January 22, 2024, to May 6, 2024, the experiment was conducted every Monday. This was accomplished by combining QR code technology with cooperative learning techniques. The pre-test was given on January 15, 2024, and the post-test occurred on May 13, 2024. After the post-test, an online questionnaire was sent out to assess student attitudes toward QR code technology as a tool integrated into cooperative learning. A follow-up assessment was carried out after a one-month break from instructional and learning activities.

Statistical analysis

IBM SPSS Statistics for Windows (2017; version 25) was utilized to conduct the subsequent statistical analyses: frequency, percentage, mean, standard deviation, Shapiro–Wilk, repeated measures ANOVA, Mauchly’s test of sphericity, and Bonferroni’s post-hoc test (Field, 2013). Furthermore, a post-hoc power analysis was carried out using the G*Power 3.1 tool (Verma and Verma, 2020).

Results

Research question 1. Are there statistically significant differences, at a significance level of 0.05, among the repeated measurements (pre, post, and follow-up) of the learning effect for the students in the experimental group?

Ha: The analysis of repeated measurements, including pre-, post-, and follow-up assessments of the learning effect for students in the experimental group, indicates statistically significant differences in cognitive achievement levels.

A repeated measures ANOVA was performed to assess the effect size, classified as low, medium, or high, of integrating QR code technology with cooperative learning techniques on the cognitive achievement of 30 participants enrolled in the Technology in Sports course.

Table 2 presents the outcomes of the Shapiro–Wilk test conducted on repeated measures of cognitive achievement at three time points: pre-test, post-test, and follow-up. The results yielded the following statistics: (W = 0.95, p = 0.16); (W = 0.94, p = 0.13); and (W = 0.97, p = 0.55). Given that the p-values exceed the threshold of 0.05, the null hypothesis cannot be rejected. Consequently, it can be concluded that the repeated measures of cognitive achievement are normally distributed.

Table 2
www.frontiersin.org

Table 2. Tests of normality.

Based on the data presented in Table 3, Mauchly’s test was performed to evaluate the assumption of sphericity, χ2(2) = 33.72, p < 0.001. As a result, the null hypothesis of sphericity was rejected. The degrees of freedom for the Greenhouse–Geisser correction were subsequently adjusted in accordance with this finding.

Table 3
www.frontiersin.org

Table 3. Mauchly’s test of sphericity.

Table 4 demonstrates that the integration of QR code technology into cooperative learning significantly influences cognitive achievement, as evidenced by statistical analysis (F(1.18) = 230.60, p < 0.001, η2 = 0.89). Consequently, participants’ cognitive achievement exhibited variability across the repeated measures (Pre, Post, and Follow-up).

Table 4
www.frontiersin.org

Table 4. Tests of within-subjects effects.

In Table 5 and Figure 4, post-hoc pairwise comparisons adjusted using the Bonferroni correction revealed that cognitive achievement scores at the post-measurement were significantly higher than those at the pre-measurement (p < 0.001). Additionally, follow-up measurements of cognitive achievement demonstrated significantly higher scores compared to the pre-measurement (p < 0.001). Conversely, there were no significant differences in cognitive achievement scores between the post- and follow-up measurements (p = 0.17).

Table 5
www.frontiersin.org

Table 5. Pairwise comparisons.

Figure 4
Line graph showing mean scores over three stages: Pre-test at 37.03, Post-test at 51.8, and Follow-up at 51.16. The line shows an increase from Pre-test to Post-test, then stabilizes at Follow-up.

Figure 4. Mean scores of students’ cognitive achievement across pre-test, post-test, and follow-up.

The post-hoc power analysis

The G*Power 3.1 tool was utilized to perform a post-hoc power analysis. A sample size of n = 30 was employed for a one-way repeated measures ANOVA (within-subjects ANOVA), with an effect size (η2 = 0.89) at a significance level of α = 0.05. The results indicated that the power analysis (1 − β = 1.00) exceeded 0.80, suggesting a significant effect size (Faul et al., 2009). Consequently, the findings from this sample size can be reliably generalized to the entire population, as illustrated in Figure 5.

Figure 5
Figure 5 presents the post-hoc power analysis using G*Power 3.1 for a repeated-measures ANOVA (n = 30, η² = 0.89, α = 0.05). The red curve rises sharply and levels off at 1.00, indicating a statistical power above 0.80 and confirming that the findings are robust and generalizable.

Figure 5. Power analysis for repeated measures ANOVA based on sample size.

Research question 2. What are students’ attitudes toward the integration of QR code technology with cooperative learning techniques in the course “Technology in Sports Sciences”?

The Student Attitudes Questionnaire was administered to the study sample via a Google Form following the post-cognitive achievement test. This questionnaire aimed to assess attitudes toward QR code technology as a tool integrated into cooperative learning. The results are as follows:

Table 6 shows a strong cognitive attitude (strongly agree) toward the integration of QR code technology as a tool for cooperative learning. The results indicate that item three received the highest ranking (M = 4.48, SD = 0.62), suggesting that QR code technology in cooperative learning has effectively enhanced students’ retention and comprehension of course material. In the second position, item one (M = 4.45, SD = 0.56) illustrates that QR code technology has simplified scientific content presentation.

Table 6
www.frontiersin.org

Table 6. Descriptive statistics of students’ attitudes toward QR code technology as an integrated tool in cooperative learning.

The results related to the affective and cognitive attitude axes are consistent, as demonstrated by the high levels of positive attitudes demonstrated by the experimental group. Their responses predominantly indicated strong agreement. Items seven and eight received the highest scores, with mean values of (M = 4.58, SD = 0.61) and (M = 4.58, SD = 0.75), respectively, positioning them at the top of the overall attitude scale. This suggests that the integration of QR code technology with cooperative learning techniques has promoted equitable participation among students during lessons and enhanced their motivation to learn. Item six, with a mean of (M = 4.33, SD = 0.82), ranked second, indicating that the incorporation of QR code technology as a tool within cooperative learning has facilitated improved communication among peers.

Furthermore, the results from the behavioral attitude axis indicated a strong agreement among respondents. Item 11 (M = 4.58, SD = 0.66) received the highest ranking, suggesting that the integration of QR code technology into cooperative learning has significantly enhanced the efficiency with which individuals and their teams approach assignments. Item 12 (M = 4.55, SD = 0.67) ranked second, indicating that the incorporation of QR code technology alongside cooperative learning techniques has the potential to improve the monitoring and evaluation of both individual and collective learning progress.

Discussion

The current study found that integrating QR Code technology into cooperative learning significantly enhances cognitive achievement. The proposed cooperative learning program, supported by QR Code technology, achieved an effect size of 0.98. A post-hoc pairwise comparison using Bonferroni correction revealed that cognitive achievement scores in the post-measurement were significantly higher than those in the pre-measurement. Furthermore, follow-up measurements of cognitive achievement indicated significantly higher scores compared to pre-measurements. This confirms that QR Code technology is a valuable tool for enhancing cooperative learning techniques. One reason for this positive impact is the use of QR Code stickers in educational contexts. They have positively influenced students’ learning motivation and enriched the teaching and learning processes by facilitating electronic educational activities and linking them to printed educational content. Similarly, So (2011), Rikala and Kankaanranta (2014), Del Rosario-Raymundo (2017), and Palazón and Giráldez (2018), and have found that QR codes effectively enhance students’ motivation to learn by connecting printed scientific materials with electronic educational resources available on the Internet. This connection allows learners to easily access educational experiences and activities in an organized way, ultimately helping them achieve their learning goals.

In addition, the integration of QR code technology into cooperative learning techniques such as Think-Pair-Share, Jigsaw, Three Steps for Interview, Team Competition with Games, Learning Together, and Ball Throwing enhanced cognitive achievement in the experimental group. As a result of this cooperative learning experience, participants gained a deeper understanding of the topics covered in the Technology in Sports course, which require high levels of problem-solving and critical thinking skills. It is consistent with the findings of Gokkurt et al. (2012), Tran (2013), Korkmaz and Öztürk (2020), Völlinger and Supanc (2020), Wang et al. (2020) and Rakha (2023b), which demonstrate that cooperative learning techniques enhance students’ critical thinking, problem-solving speed, and productivity.

The use of QR codes to support task cards enabled the experimental group to achieve learning outcomes by standardizing the work of cooperative groups, distributing roles among members, and establishing an organized timeframe for their tasks. Furthermore, cooperative groups improved evaluation and feedback processes by documenting their interactions and presenting them to the teacher and classmates. This created a competitive environment among the groups, motivating each to excel in showcasing their activities and outcomes. These findings align with the suggestions made by Nurkhin and Pramusinto (2020), which indicate that cooperative learning techniques necessitate active student participation in learning activities, reflection on acquired knowledge, and the development of critical and creative thinking skills. Furthermore, they underscore the importance of placing students at the center of the learning process and fostering their collaborative abilities. In contrast to traditional lectures, Apkarian et al. (2021) and Junejo et al. (2022) assert that cooperative learning techniques facilitate the implementation of student-centered learning activities, such as knowledge construction and problem-solving exercises. According to Johnson and Johnson (2008), cooperative learning encourages students to engage actively rather than passively. A study conducted by Hang and Van (2020) found that innovations in teaching and learning formats and methods enhance students’ creativity. Therefore, it is essential for both lecturers and students to develop active and creative teaching and learning strategies.

The results of the current study align with those of Wang et al. (2020), Cho et al. (2021), and Warsah et al. (2021). These studies demonstrated that cooperative learning strategies significantly enhance academic achievement, interpersonal relationships, diversity awareness, and critical thinking skills. Furthermore, the findings are consistent with the research conducted by Walker (2003), Johnson and Johnson (2009), Harris and Bacon (2019), Rossi et al. (2021), and Chen et al. (2022). In these studies, cooperative learning was shown to improve students’ communication skills, thereby enhancing their ability to acquire knowledge independently. The positive interactions among students within a group foster increased engagement and active participation.

Additionally, the implementation of formative assessment activities conducted through educational videos and online resources enabled the teacher to monitor the progress of students in the experimental group. Consequently, the zone of proximal development was identified. The cooperative learning techniques employed for the experimental group served as an educational scaffold, assisting students in advancing to higher cognitive levels. According to Vygotsky and Cole (1978), educational scaffolds are strategies, instructional procedures, or supportive activities used to identify learners’ zones of proximal development. Thus, students can develop greater knowledge, skills, and values by collaborating in groups and articulating their thoughts.

Furthermore, there was no statistically significant difference in cognitive achievement between the experimental group’s post-measurements and follow-up measurements after a one-month hiatus. The findings align with those of Stiller (2007), De Jong (2010), Plass et al. (2010), Sweller (2010), Stiller and Bachmaier (2018), and Costley and Fanguy (2021). These studies suggest that a positive learning environment and cognitive enhancements, such as the integration of QR Code technology with cooperative learning techniques, contribute to the development of robust cognitive abilities. These abilities create cognitive schemas that improve information processing and enhance working memory, resulting in a strong cognitive framework in long-term memory. Consequently, the experimental group was able to maintain their cognitive level despite a one-month break from teaching and learning activities.

In response to the second question, students enrolled in the “Technology in Sports” course exhibited a positive attitude across all dimensions—cognitive, behavioral, and emotional—due to the implementation of a cooperative learning strategy enhanced by QR code technology. These favorable attitudes were attributed to the integration of QR codes, as supported by the findings of studies conducted by Latif et al. (2011), Yahya et al. (2018), Abdul Rabu et al. (2019), Tan and Chee (2021), and Anggraeni et al. (2022), which indicate that QR code technologies significantly influence students’ motivation, abilities, and skills. Furthermore, this integration enhances academic achievement and promotes active learning by introducing a valuable element into the educational process.

As a result of integrating QR code technology and cooperative learning techniques in the current study, positive social interactions among students within their respective groups were enhanced. Their attitudes improved due to increased engagement and active participation in the learning process. These findings align with the results of studies conducted by Korkmaz and Öztürk (2020), Völlinger and Supanc (2020), Dewi and Muhid (2021), and Bizimana et al. (2022), all of which confirmed that collaborative learning positively influences learners’ attitudes by enhancing their ability to work together with peers to master academic tasks.

Limitations

In cooperative learning, teachers must monitor student participation to ensure that all students contribute equally to the tasks outlined on the group’s task card. Furthermore, to facilitate the prompt display of educational videos and e-learning activities via QR code stickers, it is essential to have adequate internet bandwidth. This approach helps both students and teachers avoid frustration and prevents the wastage of valuable learning time. A persistent challenge in achieving the teacher’s goals to enhance the effectiveness of the classroom environment is student engagement. A clear understanding of their responsibilities and expectations may pose an obstacle to fulfilling the teacher’s ambitions.

In addition to the aforementioned challenges, it is also important to recognize certain pedagogical considerations. First, the frequent use of mobile devices may foster a degree of technological dependency among students, potentially reducing their ability to maintain focus or to solve problems in the absence of digital tools (Costley and Fanguy, 2021; Lan et al., 2010). Second, although the current study was implemented in a higher education setting with adequate resources, not all schools or institutions—particularly in low-resource environments—can guarantee stable internet connectivity or equal access to smartphones. Nevertheless, the instructional model proposed in this study remains adaptable, as printed QR codes can be used to link learners to pre-downloaded videos or assignments, thereby offering a viable and low-cost solution that maintains the benefits of cooperative and technology-supported learning even in under-resourced contexts (Abdul Rabu et al., 2019; Abeywardena, 2017).

Conclusions and implications for future research

The study examined the impact of QR code technology combined with cooperative learning on students’ cognitive achievement and attitudes in the “Technology in Sport” course. Results showed significant improvements from pre- to post-measurements, with follow-up measurements confirming the effectiveness of the integration. After a one-month break from learning, the experimental group maintained their cognitive levels, indicating sustained achievement. Students also displayed positive attitudes toward the learning approach, encompassing cognitive, emotional, and behavioral factors. Effective implementation requires selecting an appropriate instructional design model, evaluating learners’ needs, and providing training in cooperative learning techniques. Access to suitable devices and a reliable internet connection is essential, and teachers must be trained in integrating QR code technology, including activity reviews and student feedback in evaluations.

Future research could further explore the long-term impact of QR code–enhanced cooperative learning across diverse educational levels and subject areas, including primary and secondary education. Comparative studies between institutions with varying levels of digital infrastructure may also provide deeper insights into the adaptability of the model in different contexts. In addition, practical interventions could examine teacher training programs focused on integrating QR codes into cooperative learning, as well as the development of low-cost digital and printed resources to support schools in under-resourced environments.

Data availability statement

The original contributions presented in the study are included in the article/Supplementary material, further inquiries can be directed to the corresponding author.

Ethics statement

The research was reviewed and approved by the Research Ethics Committee of the Department of Physical Education and Kinesiology, College of Education, Qassim University (Approval No. 01452142024). The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.

Author contributions

AR: Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing.

Funding

The author(s) declare that no financial support was received for the research and/or publication of this article.

Acknowledgments

The researchers would like to thank the Deanship of Graduate Studies and Scientific Research at Qassim University for financial support (QU-APC-2025).

Conflict of interest

The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Generative AI statement

The author(s) declare that no Gen AI was used in the creation of this manuscript.

Any alternative text (alt text) provided alongside figures in this article has been generated by Frontiers with the support of artificial intelligence and reasonable efforts have been made to ensure accuracy, including review by the authors wherever possible. If you identify any issues, please contact us.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/feduc.2025.1655913/full#supplementary-material

References

Abdul Rabu, S. N., Hussin, H., and Bervell, B. (2019). Qr code utilization in a large classroom: higher education students’ initial perceptions. Educ. Inf. Technol. 24, 359–384. doi: 10.1007/s10639-018-9779-2

Crossref Full Text | Google Scholar

Abeywardena, I. S. (2017). Print2screen mobile app: embedding multimedia in printed ODL course materials using QR codes. J. Learn. Dev. 4, 366–374. doi: 10.56059/jl4d.v4i3.242

Crossref Full Text | Google Scholar

Abramczyk, A., and Jurkowski, S. (2020). Cooperative learning as an evidence-based teaching strategy: what teachers know, believe, and how they use it. J. Educ. Teach. 46, 296–308. doi: 10.1080/02607476.2020.1733402

Crossref Full Text | Google Scholar

Agonafir, A. M. (2023). Using cooperative learning strategy to increase undergraduate students’ engagement and performance. Educ. Action Res. 31, 981–997. doi: 10.1080/09650792.2023.2231512

Crossref Full Text | Google Scholar

Anggraeni, F. K. A., Prastowo, S. H. B., and Prihandono, T. (2022). Development of integrated QR code module on physics learning module to increase learning interest and knowing students' digital literacy. J. Penelit. Pendidik. IPA. 8, 2203–2209. doi: 10.29303/jppipa.v8i5.1874

Crossref Full Text | Google Scholar

Apkarian, N., Henderson, C., Stains, M., Raker, J., Johnson, E., and Dancy, M. (2021). What really impacts the use of active learning in undergraduate STEM education? Results from a national survey of chemistry, mathematics, and physics instructors. PLoS One 16:e0247544. doi: 10.1371/journal.pone.0247544

PubMed Abstract | Crossref Full Text | Google Scholar

Aronson, E., Stephan, C., Sikes, J., Blaney, N., and Snapp, M. (1978). The Jigsaw Classroom. Beverly Hills, CA: Sage Publication.

Google Scholar

Berk, L. E., and Winsler, A. (1995). Scaffolding children's learning: Vygotsky and early childhood education. NAEYC Research into Practice Series. Volume 7. ERIC. Available online at: https://eric.ed.gov/?id=ED384443

Google Scholar

Bichi, A. A. (2016). Classical test theory: an introduction to linear modeling approach to test and item analysis. Int. J. Soc. Stud. 2, 27–33. Available online at: https://journals.eduindex.org/index.php/ijss/article/view/6690/3143

Google Scholar

Bizimana, E., Mutangana, D., and Mwesigye, A. (2022). Enhancing students’ attitude towards biology using concept mapping and cooperative mastery learning instructional strategies: implication on gender. LUMAT Int. J. Math. Sci. Technol. Educ. 10, 242–266. doi: 10.31129/LUMAT.10.1.1728

Crossref Full Text | Google Scholar

Bloom, B. S., Engelhart, M. D., Furst, E. J., Hill, W. H., and Krathwohl, D. R. (1956). Handbook I: cognitive domain. New York: David McKay.

Google Scholar

Branch, R. M. (2009). Instructional design: the ADDIE approach, vol. 722. New York, NY: Springer Science & Business Media.

Google Scholar

Bruning, R. H., Schraw, G. J., and Norby, M. M. (2011). Cognitive psychology and instruction. Boston, MA: Pearson.

Google Scholar

Camtasia. (2023). Screen recorder and video editor. Available online at: https://www.techsmith.com/video-editor.html

Google Scholar

Carrondo, K., and Gil, H. (2019). The Potencial of «QR code» in education a study in the 1st cycle of basic education. 2019 14th Iberian conference on information systems and technologies (CISTI).

Google Scholar

Chen, Y., Lin, W., Zheng, Y., Xue, T., Chen, C., and Chen, G. (2022). Application of active learning strategies in metaverse to improve student engagement: an immersive blended pedagogy bridging patient care and scientific inquiry in pandemic. Available at SSRN 4098179. doi: 10.2139/ssrn.4098179

Crossref Full Text | Google Scholar

Cho, H. J., Zhao, K., Lee, C. R., Runshe, D., and Krousgrill, C. (2021). Active learning through flipped classroom in mechanical engineering: improving students’ perception of learning and performance. Int. J. STEM Educ. 8:46. doi: 10.1186/s40594-021-00302-2

PubMed Abstract | Crossref Full Text | Google Scholar

Chung, T., Wilsey, S., Mykita, A., Lesgold, E., and Bourne, J. (2019). Quick response code scanning for children’s informal learning. Int. J. Inf. Learn. Technol. 36, 38–51. doi: 10.1108/IJILT-04-2017-0026

Crossref Full Text | Google Scholar

Clayton, L. H. (2006). Concept mapping: an effective, active teaching-learning method. Nurs. Educ. Perspect. 27, 197–203. Available online at: https://pubmed.ncbi.nlm.nih.gov/16921805/

Google Scholar

Conner, M., Wilding, S., van Harreveld, F., and Dalege, J. (2021). Cognitive-affective inconsistency and ambivalence: impact on the overall attitude–behavior relationship. Personal. Soc. Psychol. Bull. 47, 673–687. doi: 10.1177/0146167220945900

PubMed Abstract | Crossref Full Text | Google Scholar

Costley, J., and Fanguy, M. (2021). Collaborative note-taking affects cognitive load: the interplay of completeness and interaction. Educ. Technol. Res. Dev. 69, 655–671. doi: 10.1007/s11423-021-09979-2

Crossref Full Text | Google Scholar

Davidson, N., and Major, C. H. (2014). Boundary crossings: cooperative learning, collaborative learning, and problem-based learning. J. Excell. Coll. Teach. 25, 7–55. Available online at: https://api.semanticscholar.org/CorpusID:61849265

Google Scholar

De Jong, T. (2010). Cognitive load theory, educational research, and instructional design: some food for thought. Instr. Sci. 38, 105–134. doi: 10.1007/s11251-009-9110-0

Crossref Full Text | Google Scholar

De Vries, D. L., and Slavin, R. E. (1978). Teams-games-tournaments (TGT): review of ten classroom experiments. J. Res. Dev. Educ. 12, 28–38.

Google Scholar

Del Rosario-Raymundo, M. R. (2017). QR codes as mobile learning tools for labor room nurses at the San Pablo colleges medical center. Interact. Technol. Smart Educ. 14, 138–158. doi: 10.1108/ITSE-02-2017-0015

Crossref Full Text | Google Scholar

Dewi, P., and Muhid, A. (2021). Students’ attitudes towards collaborative learning through E-learning during Covid-19: a male and female students. English Teach. J. 9, 26–33. doi: 10.25273/etj.v9i1.9046

Crossref Full Text | Google Scholar

Durak, G., Ozkeskin, E. E., and Ataizi, M. (2016). QR codes in education and communication. Turk. Online J. Dist. Educ. 17, 42–58. Available online at: https://eric.ed.gov/?id=EJ1097236

Google Scholar

Eggen, P. D., and Kauchak, D. P. (2013). Educational psychology: windows on classrooms : Peason.

Google Scholar

Egger, F. N. (2001). Affective design of e-commerce user interfaces: how to maximise perceived trustworthiness. Proc. intl. conf. affective human factors design.

Google Scholar

Faul, F., Erdfelder, E., Buchner, A., and Lang, A.-G. (2009). Statistical power analyses using G*power 3.1: tests for correlation and regression analyses. Behav. Res. Methods 41, 1149–1160. doi: 10.3758/BRM.41.4.1149

PubMed Abstract | Crossref Full Text | Google Scholar

Field, A. (2013). Discovering statistics using IBM SPSS statistics: and sex and drugs and Rock “N” Roll, 4th Edn. Los Angeles, London, New Delhi: Sage.

Google Scholar

Gillies, R. M., and Khan, A. (2008). The effects of teacher discourse on students’ discourse, problem-solving and reasoning during cooperative learning. Int. J. Educ. Res. 47, 323–340. doi: 10.1016/j.ijer.2008.06.001

Crossref Full Text | Google Scholar

Gokkurt, B., Dundar, S., Soylu, Y., and Akgun, L. (2012). The effects of learning together technique which is based on cooperative learning on studentss’ achieevement in mathematics class. Proc. Soc. Behav. Sci. 46, 3431–3434. doi: 10.1016/j.sbspro.2012.06.079

Crossref Full Text | Google Scholar

Göksu, İ., and Atici, B. (2013). Need for mobile learning: technologies and opportunities. Proc. Soc. Behav. Sci. 103, 685–694. doi: 10.1016/j.sbspro.2013.10.388

Crossref Full Text | Google Scholar

Gregory, R. J. (2015). Psychological testing history principles and applications.(7th ed.). Harlow, Essex: Pearson Education Limited.

Google Scholar

Gronlund, N. E. (1998). Assessment of student achievement (6th ed.). Needham Heights, MA: Allyn & Bacon.

Google Scholar

Haenen, J., Schrijnemakers, H., and Stufkens, J. (2003). Sociocultural theory and the practice of teaching historical concepts. Vygotsky’s Educ. Theory Cult. Context, 246–266. doi: 10.1017/CBO9780511840975.014

Crossref Full Text | Google Scholar

Hang, L. T., and Van, V. H. (2020). Building strong teaching and learning strategies through teaching innovations and learners' creativity: a study of Vietnam universities. Int. J. Educ. Pract. 8, 498–510. doi: 10.18488/journal.61.2020.83.498.510

Crossref Full Text | Google Scholar

Harris, N., and Bacon, C. E. W. (2019). Developing cognitive skills through active learning: a systematic review of health care professions. Athl. Train. Educ. J. 14, 135–148. doi: 10.4085/1402135

Crossref Full Text | Google Scholar

Hays, R. D., and Revicki, D. A. (2005). Reliability and validity (including responsiveness). In Assessing quality of life in clinical trials: Methods and practice. Eds. P. Fayers and R. Hays (pp. 25–40). Oxford University Press. doi: 10.1093/oso/9780198527695.003.0003

Crossref Full Text | Google Scholar

Huang, Z., and Benyoucef, M. (2014). Usability and credibility of e-government websites. Gov. Inf. Q. 31, 584–595. doi: 10.1016/j.giq.2014.07.002

Crossref Full Text | Google Scholar

Johnson, D. W., and Johnson, R. T. (1999). Making cooperative learning work. Theory Pract. 38, 67–73. doi: 10.1080/00405849909543834

Crossref Full Text | Google Scholar

Johnson, R. T., and Johnson, D. W. (2008). Active learning: cooperation in the classroom. Ann. Rep. Educ. Psychol. Japan 47, 29–30. doi: 10.5926/arepj1962.47.0_29

Crossref Full Text | Google Scholar

Johnson, D. W., and Johnson, R. T. (2009). An educational psychology success story: social interdependence theory and cooperative learning. Educ. Res. 38, 365–379. doi: 10.3102/0013189X09339057

Crossref Full Text | Google Scholar

Johnson, D. W., Johnson, R. T., and Stanne, M. B. (2000). Cooperative learning methods: a meta-analysis. University of Minnesota. Available online at: https://www.researchgate.net/profile/David-Johnson-113/publication/220040324_Cooperative_learning_methods_A_meta-analysis/links/00b4952b39d258145c000000/Cooperative-learning-methods-A-meta-analysis.pdf

Google Scholar

Junejo, S., Khatoon, S., and Jaleel, B. (2022). Active learning strategies and their effects on learning: a review. Pakistan Lang. Human. Rev. 6, 742–755. doi: 10.47205/plhr.2022(6-III)65

Crossref Full Text | Google Scholar

Kagan, S. (1992). Cooperative learning. San Juan Capistrano, CA: Resources for Teachers.

Google Scholar

Kagan, S., and Kagan, M. (2015). Kagan cooperative learning : Kagan Cooperative Learning. (Revised ed.). San Clemente, CA: Kagan Publishing.

Google Scholar

Karia, C. T., Hughes, A., and Carr, S. (2019). Uses of quick response codes in healthcare education: a scoping review. BMC Med. Educ. 19:456. doi: 10.1186/s12909-019-1876-4

PubMed Abstract | Crossref Full Text | Google Scholar

Korkmaz, Ö., and Öztürk, Ç. (2020). The effect of gamification activities on students' academic achievements in social studies course, attitudes towards the course and cooperative learning skills. Participat. Educ. Res. 7, 1–15. doi: 10.17275/per.20.1.7.1

Crossref Full Text | Google Scholar

Lan, Y.-J., Sung, Y.-T., Tan, N.-C., Lin, C.-P., and Chang, K.-E. (2010). Mobile-device-supported problem-based computational estimation instruction for elementary school students. J. Educ. Technol. Soc. 13, 55–69. Available online at: https://eric.ed.gov/?id=EJ899862

Google Scholar

Latif, L. A., Fadzil, M., Azzman, T. A. M. T. M., and Ng, M. S. (2011). Can the use of QR codes enhance m-learning in a blended learning environment? J. Lifelong Learn. Soc. 8, 1–20. doi: 10.4018/IJTD.2016100101

Crossref Full Text | Google Scholar

Lee, Y., and Kozar, K. A. (2012). Understanding of website usability: specifying and measuring constructs and their relationships. Decis. Support. Syst. 52, 450–463. doi: 10.1016/j.dss.2011.10.004

Crossref Full Text | Google Scholar

Lee, J.-K., Lee, I.-S., and Kwon, Y.-J. (2011). Scan & learn! Use of quick response codes smartphones in a biology field study. Am. Biol. Teach. 73, 485–492. doi: 10.1525/abt.2011.73.8.11

Crossref Full Text | Google Scholar

Lencastre, J., and Chaves, J. (2008). A usability evaluation of educational websites. Proceedings of EADTU conference.

Google Scholar

Lougheed, J., Kirkland, J., and Newton, G. (2012). Using breakout groups as an active learning technique in a large undergraduate nutrition classroom at the University of Guelph. Can. J. Scholarship Teach. 3, 1–18. doi: 10.5206/cjsotl-rcacea.2012.2.6

Crossref Full Text | Google Scholar

Lyman, F. (1992). “Think-pair-share, thinktrix, thinklinks, and weird facts: an interactive system for cooperative thinking” in Enhancing thinking through cooperative learning (New York: Teachers College Press), 169–181.

Google Scholar

Millis, B. J., and Cottell, P. G.Jr (1997). Cooperative learning for higher education faculty. Series on Higher Education. ERIC. Available online at: https://eric.ed.gov/?id=ED415756

Google Scholar

Mosston, M., and Ashworth, S. (1986). Teaching physical education. 4th Edn. New York, NY: Macmillan Publishing Company.

Google Scholar

Namaziandost, E., Homayouni, M., and Rahmani, P. (2020). The impact of cooperative learning approach on the development of EFL learners’ speaking fluency. Cogent Arts Humanit. 7:1780811. doi: 10.1080/23311983.2020.1780811

Crossref Full Text | Google Scholar

Newsome, G. G., and Tillman, M. H. (1990). Effects of guided design and lecture teaching strategies on knowledge recall and on problem-solving performance of student nurses. Int. J. Nurs. Terminol. Classif. 1, 89–96. doi: 10.1111/j.1744-618X.1990.tb00248.x

PubMed Abstract | Crossref Full Text | Google Scholar

Nurkhin, A., and Pramusinto, H. (2020). Problem-based learning strategy: its impact on students' critical and creative thinking skills. Eur. J. Educ. Res. 9, 1141–1150. doi: 10.12973/eu-jer.9.3.1141

Crossref Full Text | Google Scholar

O'Donnell, A. M. (1999). “Structuring dyadic interaction through scripted cooperation” in Cognitive perspectives on peer learning Eds. A. M. O’Donnell and A. King. (Mahwah, NJ: Lawrence Erlbaum Associates), 179–196.

Google Scholar

Ortega-Sánchez, D. n., and Gómez-Trigueros, I. (2019). Didactics of historical-cultural heritage QR codes and the TPACK model: an analytic revision of three classroom experiences in Spanish higher education contexts. Educ. Sci. 9:117. doi: 10.3390/educsci9020117

Crossref Full Text | Google Scholar

Pahl, C. (2008). Content-driven design and architecture of e-learning applications. Adv. Technol. Learn. 5, 62–67. doi: 10.2316/Journal.208.2008.1.208-1056

Crossref Full Text | Google Scholar

Palazón, J., and Giráldez, A. (2018). QR codes for instrumental performance in the music classroom. Int. J. Music Educ. 36, 447–459. doi: 10.1177/0255761418771992

Crossref Full Text | Google Scholar

Panda, S. K., Swain, S. K., and Mall, R. (2015). An investigation into usability aspects of E-commerce websites using user’ preferences. Adv. Comput. Sci. Int. J. 4, 65–73. Available online at: https://www.acsij.org/index.php/acsij/article/view/132

Google Scholar

Panitz, T. (1999). Collaborative versus cooperative learning: a comparison of the two concepts which will help us understand the underlying nature of interactive learning. Available online at: https://eric.ed.gov/?id=ED448443

Google Scholar

Plass, J. L., Moreno, R., and Brunken, R. (Eds.). (2010). Cognitive load theory. Cambridge, UK: Cambridge University Press. doi: 10.1017/CBO9780511844744

Crossref Full Text | Google Scholar

Qiao, S., Fang, X., Sheng, B., Wu, W., and Wu, E. (2015). Structure-aware QR code abstraction. Vis. Comput. 31, 1123–1133. doi: 10.1007/s00371-015-1107-x

Crossref Full Text | Google Scholar

Qrcode monkey. (2023). The free QR code generator for high quality QR codes. Available online at: https://www.qrcode-monkey.com/

Google Scholar

Rakha, A. H. (2023a). Application of 3D hologram technology combined with reciprocal style to learn some fundamental boxing skills. PLoS One 18:e0286054. doi: 10.1371/journal.pone.0286054

PubMed Abstract | Crossref Full Text | Google Scholar

Rakha, A. H. (2023b). The impact of blackboard collaborate breakout groups on the cognitive achievement of physical education teaching styles during the COVID-19 pandemic. PLoS One 18:e0279921. doi: 10.1371/journal.pone.0279921

PubMed Abstract | Crossref Full Text | Google Scholar

Rikala, J., and Kankaanranta, M. (2014). Blending classroom teaching and learning with QR codes. 10th international conference mobile learning.

Google Scholar

Robertson, C., and Green, T. (2012). Scanning the potential for using QR codes in the classroom. TechTrends 56, 11–12. doi: 10.1007/s11528-012-0558-4

Crossref Full Text | Google Scholar

Rossi, I. V., de Lima, J. D., Sabatke, B., Nunes, M. A. F., Ramirez, G. E., and Ramirez, M. I. (2021). Active learning tools improve the learning outcomes, scientific attitude, and critical thinking in higher education: experiences in an online course during the COVID-19 pandemic. Biochem. Mol. Biol. Educ. 49, 888–903. doi: 10.1002/bmb.21574

PubMed Abstract | Crossref Full Text | Google Scholar

Roy, M. C., Dewit, O., and Aubert, B. A. (2001). The impact of interface usability on trust in web retailers. Internet Res. 11, 388–398. doi: 10.1108/10662240110410165

Crossref Full Text | Google Scholar

Saravani, S.-J., and Clayton, J. (2009). Conceptual model for the educational deployment of QR codes. ascilite Conference, Auckland, New Zealand. Available online at: https://core.ac.uk/download/pdf/11229232.pdf

Google Scholar

Schober, P., Boer, C., and Schwarte, L. A. (2018). Correlation coefficients: appropriate use and interpretation. Anesth. Analg. 126, 1763–1768. doi: 10.1213/ANE.0000000000002864

PubMed Abstract | Crossref Full Text | Google Scholar

Sharan, Y. (2015). Meaningful learning in the cooperative classroom. Education 43, 83–94. doi: 10.1080/03004279.2015.961723

PubMed Abstract | Crossref Full Text | Google Scholar

Silberman, M. (1996). The use of pairs in cooperative learning. Cooper. Learn. College Teach. 7, 2–12.

Google Scholar

Skeele, R. (2013). QR codes: repurposing technologies into assistive technologies. Society for information technology & teacher education international conference.

Google Scholar

So, S. (2011). Beyond the simple codes: QR codes in education. ASCILITE 2011 - the Australasian society for computers in learning in tertiary education, 1157–1161. Available online at: http://www.leishman-associates.com.au/ascilite2011/downloads/papers/So-concise.pdf

Google Scholar

Spano, S. (2004). Stages of adolescent development. Research facts and findings. Available online at: https://www.actforyouth.net/resources/rf/rf_stages_0504.pdf

Google Scholar

Stiller, K. D. (2007). Computerised multimedia learning. Modes of text presentation and access to text. Hamburg, Germany: Verlag Dr.Kovac.

Google Scholar

Stiller, K. D., and Bachmaier, R. (2018). Cognitive loads in a distance training for trainee teachers. Front. Educ. :44:3. doi: 10.3389/feduc.2018.00044

Crossref Full Text | Google Scholar

Sweller, J. (2010). Element interactivity and intrinsic, extraneous, and germane cognitive load. Educ. Psychol. Rev. 22, 123–138. doi: 10.1007/s10648-010-9128-5

Crossref Full Text | Google Scholar

Taber, K. S. (2018). The use of Cronbach’s alpha when developing and reporting research instruments in science education. Res. Sci. Educ. 48, 1273–1296. doi: 10.1007/s11165-016-9602-2

Crossref Full Text | Google Scholar

Tan, K. H., and Chee, K. M. (2021). Exploring the motivation of pupils towards the implementation of QR codes in pronunciation learning. Acad. J. Interdiscip. Stud. 10, 204–213. doi: 10.36941/ajis-2021-0018

Crossref Full Text | Google Scholar

Tran, V. D. (2013). Theoretical perspectives underlying the application of cooperative learning in classrooms. Int. J. High. Educ. 2, 101–115. doi: 10.5430/ijhe.v2n4p101

Crossref Full Text | Google Scholar

Traser, C. J., Hoffman, L. A., Seifert, M. F., and Wilson, A. B. (2015). Investigating the use of quick response codes in the gross anatomy laboratory. Anat. Sci. Educ. 8, 421–428. doi: 10.1002/ase.1499

PubMed Abstract | Crossref Full Text | Google Scholar

Verma, J. P., and Verma, P. (2020). “Use of G*power software” in Determining sample size and power in research studies: a manual for researchers. eds. J. P. Verma and P. Verma (Singapore: Springer), 55–60. doi: 10.1007/978-981-15-5204-5_6

Crossref Full Text | Google Scholar

Völlinger, V. A., and Supanc, M. (2020). Student teachers’ attitudes towards cooperative learning in inclusive education. Eur. J. Psychol. Educ. 35, 727–749. doi: 10.1007/s10212-019-00435-7

Crossref Full Text | Google Scholar

Vygotsky, L. S., and Cole, M. (1978). Mind in society: development of higher psychological processes. Cambridge, MA: Harvard University Press. doi: 10.2307/j.ctvjf9vz4

Crossref Full Text | Google Scholar

Walker, S. E. (2003). Active learning strategies to promote critical thinking. J. Athl. Train. 38, 263–267. Available online at: https://pmc.ncbi.nlm.nih.gov/articles/PMC233182/

Google Scholar

Wang, C., Fang, T., and Gu, Y. (2020). Learning performance and behavioral patterns of online collaborative learning: impact of cognitive load and affordances of different multimedia. Comput. Educ. 143:103683. doi: 10.1016/j.compedu.2019.103683

Crossref Full Text | Google Scholar

Warsah, I., Morganna, R., Uyun, M., Hamengkubuwono, H., and Afandi, M. (2021). The impact of collaborative learning on learners’ critical thinking skills. Int. J. Instr. 14, 443–460. Available online at: https://eric.ed.gov/?id=EJ1290961

Google Scholar

WebSite X. (2023). Create your website and online store in 5 steps. Available online at: https://www.websitex5.com/en/

Google Scholar

Widyasari, W., Sutopo, H., and Agustian, M. (2019). Qr code-based learning development: accessing math game for children learning enhancement. Int. J. Interact. Mob. Technol. 13, 111–124. doi: 10.3991/ijim.v13i11.10976

Crossref Full Text | Google Scholar

Wordwall. (2023). The easy way to create your own teaching resources.

Google Scholar

Wu, C. -H., Chen, C. -C., Wang, S. -M., and Hou, H. -T. (2018). The design and evaluation of a gamification teaching activity using board game and QR code for organic chemical structure and functional groups learning. 2018 7th international congress on advanced applied informatics (IIAI-AAI). Available online at: https://www.qrcode-monkey.com/

Google Scholar

Wu, H., Tian, G.-H., Xue, Y.-H., and Zhang, T.-T. (2010). QR code based semantic map building in domestic semi unknown environment. Pattern Recogn. Artif. Intell. 23, 464–470. Available online at: http://manu46.magtech.com.cn/Jweb_prai/CN/abstract/abstract9180.shtml

Google Scholar

Yahya, F. H., Abas, H., and Yussof, R. (2018). Integration of screencast video through QR code: an effective learning material for m-learning. J. Eng. Sci. Technol. 13, 1–13. Available online at: https://jestec.taylors.edu.my/Special%20Issue%20on%20ICETVESS_2017/ICETVESS_01.pdf

Google Scholar

Keywords: e-learning, teaching, education, active learning, QR codes, cooperative learning, educational innovation

Citation: Rakha AH (2025) Cooperative learning with QR codes technology: enhancing cognitive achievement and attitudes among students. Front. Educ. 10:1655913. doi: 10.3389/feduc.2025.1655913

Received: 28 June 2025; Accepted: 06 October 2025;
Published: 28 October 2025.

Edited by:

Indira Boutier, Glasgow Caledonian University, United Kingdom

Reviewed by:

Maria Tomé-Fernández, University of Granada, Spain
Manoel Salvino, Instituto Federal de Educação Ciência e Tecnologia de Mato Grosso, Brazil

Copyright © 2025 Rakha. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Ahmed Hassan Rakha, YS5yYWtoYUBxdS5lZHUuc2E=

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.