Original Research ARTICLE
Observation of Metacognitive Skills in Natural Environments: a Longitudinal Study with Mixed Methods
- 1University of Burgos, Spain
- 2University of Valladolid, Spain
Recent studies pointing to evaluation methods in natural environments suggest that their use in the analysis of metacognitive strategies provides more precise information than the use of off-line evaluation methods. In this research, mixed methods are used over one academic year for the evaluation of the metacognitive strategies that students of Secondary Education apply to solve physics problems. The objectives of this study are to analyze the use of metacognitive strategies in natural environments and to study behavioral patterns of student learning through a longitudinal study. A total of 509 recordings of think-aloud protocols are analyzed through the categorization of the responses (liquefying) and the protocol of Van der Stel and Veenman for the analysis of the quality of metacognitive strategies. Fewer conceptual errors and less uncertainty over vocabulary were noted during the academic year. Nevertheless, a degree of ambiguity persisted in the understanding of physics concepts. The metacognitive strategies of Orientation and Planning were used more than any others. The technique of graph analysis is also applied, to establish the patterns of behavior of each student throughout the academic year. Different patterns were found, the analysis of which helped to identify academically challenged and at-risk students. The use of mixed observation techniques and graph analysis facilitated information on the pace of learning of each student. Future studies will be directed at proposals for the automation of these evaluation techniques in natural learning environments.
Keywords: Metacognitive skills, quality, on-line evaluation methods, mixed methods, Indirect observation, systematic observation, personalized learning, Natural Environments
Received: 13 Apr 2019;
Accepted: 08 Oct 2019.
Copyright: © 2019 SAIZ MANZANARES, QUEIRUGA-DIOS, GARCIA-OSORIO, MONTERO-GARCIA and RODRIGUEZ-MEDINA. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
* Correspondence: Dr. MARIA C. SAIZ MANZANARES, University of Burgos, Burgos, Spain, email@example.com