Abstract
In recent years, research on embodied cognition has inspired a number of studies on multimedia learning and instructional psychology. However, in contrast to traditional research on education and multimedia learning, studies on embodied learning (i.e., focusing on bodily action and perception in the context of education) in some cases pose new problems for the measurement of cognitive load. This review provides an overview over recent studies on embodied learning in which cognitive load was measured using surveys, behavioral data, or physiological measures. The different methods are assessed in terms of their success in finding differences of cognitive load in embodied learning scenarios. At the same time, we highlight the most important challenges for researchers aiming to include these measures into their study designs. The main issues we identified are: (1) Subjective measures must be appropriately phrased to be useful for embodied learning; (2) recent findings indicate potentials as well as problematic aspects of dual-task measures; (3) the use of physiological measures offers great potential, but may require mobile equipment in the context of embodied scenarios; (4) meta-cognitive measures can be useful extensions of cognitive load measurement for embodied learning.
Embodied Learning Scenarios and Cognitive Load
In response to the findings concerning the influence of bodily perception, activity, and the physical environment on cognition in the fields of cognitive psychology and neuroscience (i.e., embodied cognition; Barsalou, 1999, 2003, 2008; Wilson, 2002; Glenberg, 2010; Shapiro, 2011), researchers investigating multimedia learning have begun to transfer insights gained from more basic embodiment research into applied settings (Paas and Sweller, 2012; Choi et al., 2014). Research on embodied learning usually focuses on the application of principles derived from embodiment research to the presentation of learning contents in educational settings (van Gog et al., 2009; Lindgren and Johnson-Glenberg, 2013).
A large part of educational research in the area of multimedia learning is concerned with learning settings in which, among others, the influence of visual and auditive design characteristics of learning materials is investigated (see Mayer, 2005, for an overview). However, formats of online education have been referred to as “disembodied” (Dall’Alba and Barnacle, 2005, p. 730). Still, even studies that include only very basic forms of bodily involvement and action beyond standard user interfaces are currently presented as being linked to embodiment research (e.g., Agostinho et al., 2015; Dubé and McEwen, 2015). Though, a large number of studies focusing on embodied learning deal with more sophisticated learning scenarios involving technology such as tangible user interfaces (e.g., Pouw et al., 2016a; Skulmowski et al., 2016) and mixed reality environments (e.g., Johnson-Glenberg et al., 2014, 2016). Therefore, the term embodied learning scenarios currently needs to be interpreted broadly (see Johnson-Glenberg et al., 2014, for a taxonomy).
Clark (1999, p. 348) introduced the theoretical distinction between “simple embodiment” and “radical embodiment”; Clark (1999) characterizes the former type of studies as embodied cognition research dealing with theoretical entities such as mental representation and computation, whereas the latter type of embodiment theory is described by Clark (1999) as rejecting these concepts (for further overviews, see Gallagher, 2005; Lindblom, 2015). However, educational researchers incorporating insights from embodied cognition usually do not exclusively align with the theoretical assumptions of either of these two views of embodiment. Thus, embodied learning currently needs to be considered to be a rather broad term. It includes studies based on the notion of multimodal mental representations related to Barsalou’s (1999) model (see Skulmowski et al., 2016, for an example), as well as theoretical assumptions derived from non-representational accounts focusing on the bodily enactment of learning contents (for overviews on enactivism in the context of learning, see Gallagher and Lindgren, 2015; Hutto et al., 2015; see Lindgren et al., 2016, for a study that exemplifies the enactive approach).
When applied to educational settings involving the measurement of cognitive load during learning, these theoretical models are operationalized in a multitude of ways. Interventions based on embodiment have been introduced to a large number of subjects and educational contexts, including physics (e.g., Johnson-Glenberg et al., 2014, 2016; Pouw et al., 2016a), language learning (Post et al., 2013), mathematics (e.g., Ruiter et al., 2015), and reading comprehension (e.g., Glenberg et al., 2004).
As a number of recent embodiment studies in the field of multimedia learning have revealed negative results concerning the effectiveness of body-based (and in some cases activity-based) forms of instruction (e.g., Post et al., 2013; Song et al., 2014; see Tran et al., 2017), a closer look at the cognitive mechanisms relevant to embodied learning seems warranted. The field of multimedia learning research employs a wide array of measures in order to assess the cognitive demands that learning materials impose on learners (see Brünken et al., 2003, for an overview). Cognitive load theory (CLT; Sweller, 1988; Sweller et al., 1998) is considered to have exhibited a major influence on the field of learning and instruction (Ozcinar, 2009); therefore, a large part of educational research concerned with embodied learning relates the findings of embodied cognition research to CLT (e.g., Paas and Sweller, 2012; Skulmowski et al., 2016). Conversely, progress in the field of cognitive load measurement is regarded to be important for the future of CLT (Paas et al., 2003). The objective of this review is to present subjective, behavioral, and physiological measurements of cognitive load in the context of embodied learning scenarios and to provide an assessment concerning the success of these instruments in recent studies.
Cognitive Load Theory
The CLT model is built upon the premise that cognitive capacity is inherently limited by the availability of working memory resources (Sweller et al., 1998), based on the working memory model introduced by Baddeley (1992). CLT has been conceived as a computationalist framework right from the beginning (Sweller, 1988), implying a theoretical alignment with “simple embodiment” as defined by Clark (1999, p. 348).
In order to achieve an optimal exploitation of resources, CLT suggests interventions aimed at manipulating cognitive load, which is theoretically subdivided into three types of cognitive load (Sweller et al., 1998). These load types are described in the following section.
Load Types
CLT researchers subscribe to a model dividing learners’ cognitive resources into three distinct kinds of cognitive load, namely the components intrinsic load, extraneous load, and germane load (Sweller et al., 1998). Intrinsic load is defined as measuring the inherent difficulty of learning contents (Sweller, 1994; Sweller and Chandler, 1994). Instructional factors concerning the design of learning materials are thought to influence the second component of CLT, the so-called extraneous load (Sweller, 1994; Sweller et al., 1998). CLT models usually include a third component, namely germane load, that is thought to be associated with the generation of knowledge structures in long-term memory (Sweller et al., 1998). Some researchers suggest to consider germane load as being linked to meta-cognitive processes (Valcke, 2002; Young et al., 2016). Moreover, there has been a debate around the issue whether it is actually necessary to distinguish between three types of cognitive load that called into doubt several assumptions made regarding germane load (de Jong, 2010; Kalyuga, 2011). Whelan (2007) reviewed several neuroscientific studies on learning and provided interpretations regarding the neural underpinnings of CLT.
Cognitive Load Measurement for Embodied Learning
The measurement of cognitive load is generally regarded as a difficult task (e.g., de Jong, 2010; Martin, 2014), with some researchers even arguing against the use of distinct measures for the three load types (Kalyuga, 2011). In the following we will present and review methods that have been used to measure cognitive load in embodied learning scenarios, evaluate their success and highlight new developments.
Subjective Methods
One method of cognitive load measurement is the use of subjective scales (Paas et al., 2003). One commonly used question item developed by Paas (1992) asks participants for an indication of their mental effort during a learning task. In the following, we will provide some examples of recent embodiment studies that used this item:
Castro-Alonso et al. (2015a) found significant differences for the item developed by Paas (1992) when comparing animated learning materials with static depictions in the context of a brick construction task. Significant results of this item (Paas, 1992) indicating less cognitive load for static forms of instruction compared to animations were found in one trial of a related study (Experiment 1 in Wong et al., 2015). In contrast, other embodiment studies did not reveal significant effects using variants of this item (e.g., Ruiter et al., 2015; Pouw et al., 2016a). The mental effort item developed by Paas (1992) has been used in various studies to compute the instructional efficiency (Paas and van Merriënboer, 1993) of learning interventions (e.g., Castro-Alonso et al., 2014).
Another method of survey-based cognitive load measurement is the NASA Task Load Index (NASA-TLX; Hart and Staveland, 1988), which was recently used in studies concerning embodied learning (Skulmowski and Rey, 2017) and problem-solving (Kaspar and Vennekötter, 2015). The NASA-TLX survey contains of six question items: mental demand, physical demand, temporal demand, performance, effort, and frustration. Neither in the two studies reported by Skulmowski and Rey (2017) nor in the two experiments described by Kaspar and Vennekötter (2015) did the NASA-TLX result in significant differences concerning most of the cognitive variables of the NASA-TLX. The variable effort was significantly affected by the embodiment manipulation of sensing weight during a problem-solving task in Experiment 1 of Kaspar and Vennekötter (2015); the variable physical demands was significantly affected by the embodiment manipulation targeted at increasing physical exertion during a word learning task in both experiments of Skulmowski and Rey (2017). For a comparison between the NASA-TLX and the mental effort scale developed by Paas (1992), see Naismith et al. (2015).
Recently, cognitive load surveys measuring the three distinct load types were presented (e.g., Eysink et al., 2009; Leppink et al., 2013). The cognitive load survey instrument presented by Leppink et al. (2013) contains question items aimed at measuring intrinsic, extraneous, and germane load. However, the question items of this instrument (Leppink et al., 2013, p. 1070) refer to “instructions”, “explanations”, as well as “concepts” and “definitions”, suggesting that this survey may not be the optimal choice for instructional settings that rely less strongly on verbal instructions.
Another cognitive load survey was developed by Eysink et al. (2009) and contains one question item aimed at measuring intrinsic cognitive load, three items targeted at extraneous load, one item for germane load, and a last item for overall load. Eysink et al. (2009) used their cognitive load survey in order to measure cognitive load in the context of learning with (interactive) simulations (see Plass et al., 2009, for an overview of research on simulations). Hence, due to the links between research on interactive learning media and embodiment that have been suggested in the literature (see Lindgren and Johnson-Glenberg, 2013; Castro-Alonso et al., 2015b), one may assume that this survey could be appropriate for embodied learning research. Skulmowski et al. (2016) used this survey in a study investigating the effects of different interaction designs on learning. The study (Skulmowski et al., 2016) revealed a correspondence of the extraneous load ratings with retention scores (i.e., higher retention scores when extraneous load was lower and vice versa), providing evidence for the appropriateness of this questionnaire in embodied learning scenarios.
In summary, subjective measures may provide useful for cognitive load measurement in embodied scenarios if an appropriate survey is chosen. However, there are some general problems and theoretical issues related to the use of cognitive load questionnaires (see also de Jong, 2010). Van Gog and Paas (2008) highlight the problem that different phrasings in cognitive load question items might lead to results that may not be comparable. Furthermore, Leppink et al. (2013) suggest to conduct additional research specifically aimed at determining how participants understand cognitive load question items in different contexts. Lastly, Skulmowski et al. (2016) propose to subdivide extraneous load into more fine-grained components in the context of embodiment.
Behavioral Measures of Cognitive Load
Behavioral measures of cognitive load are an alternative to subjective measures (see Brünken et al., 2003, for an overview). In recent embodiment studies, a variety of behavioral measures have been utilized. For instance, Pouw et al. (2016a) included an analysis of reaction times alongside mental effort questions and performance measures. Dubé and McEwen (2015) used measures of response latency to investigate behavioral aspects of touchscreen interaction types in the context of embodied learning. Eye movements were used as an indicator of cognitive activity in a study presented in Pouw et al. (2016b). As the study (Pouw et al., 2016b) involved bodily activity in the form of gesturing, a mobile eye tracker was used.
Research on multimedia learning has made use of dual-task performance as a measure of cognitive load (e.g., Brünken et al., 2002). The procedure developed by Park and Brünken (2015) has been suggested for use in embodied learning research (Pouw et al., 2016c). However, recent findings suggest that specific types of dual-tasks may more strongly negatively affect performance in text-based forms of instruction compared to learning materials that additionally include pictures (van Genuchten et al., 2014). Kirschner et al. (2011) argue that the dual-task method may not be adequate for more elaborate settings. Therefore, we think that further research should be conducted to assess how dual-task measurements affect different cognitive processes involved in embodied learning scenarios.
Physiological Measures of Cognitive Load
Physiological measures of cognitive load (for overviews, see Brünken et al., 2003; Paas et al., 2003) include electroencephalography (EEG; e.g., Antonenko et al., 2010), heart rate (e.g., Paas et al., 1994), and pupil dilation (e.g., van Gerven et al., 2004). However, the application of brain imaging to embodied scenarios involving extensive movement may also introduce new difficulties (Gramann et al., 2014); in some cases requiring complex setups (e.g., Ehinger et al., 2014). On the other hand, EEG recordings can now be generated using low-budget EEG headsets (e.g., Debener et al., 2012; Palermo et al., 2017).
Pupil dilation was used in a variety of studies to measure cognitive load during learning and related cognitive tasks (e.g., van Gerven et al., 2004; Mitra et al., 2016). Recent research supports the idea that pupil dilation may be a valuable measure of mental demands in the context of movement-related studies (Jiang et al., 2015). Again, it should be noted that embodied learning scenarios in which participants perform movements may require the use of specialized hardware in the form of mobile eye tracking devices (e.g., Pouw et al., 2016b). As an increasing number of embodied learning scenarios are presented using immersive virtual reality equipment and related technologies (for a meta-analysis, see Merchant et al., 2014), pupillometric measurements may be obtained using eye trackers integrated into head-mounted displays (e.g., Skulmowski et al., 2014). In addition, other non-invasive physiological measures such as functional near-infrared spectroscopy were recently used in the context of embodied learning (Brucker et al., 2015).
Outlook and Conclusion
In this review we have summarized the most widely used methods of cognitive load measurement as they pertain to embodied learning scenarios. Yet, several developments within the field of cognitive load measurement should be taken into greater account when investigating embodied learning. Repeated-measures study designs have been revealed to provide more appropriate measurements of cognitive load (e.g., van Gog et al., 2012; see Leppink and van Merriënboer, 2015), but only few studies on embodied learning have so far implemented repeated measurements of cognitive load (see Wong et al., 2015, for an example).
A number of recent studies on embodied learning employed meta-cognitive ratings in the form of judgments of learning, i.e., predictive self-assessments on how well one will be able to recall learning contents (e.g., Alban and Kelley, 2013; Skulmowski and Rey, 2017; for an overview on metacognition, see Dunlosky and Metcalfe, 2009). A study investigating the effects of a drawing activity on learning revealed that judgments of learning are even better predictors of learning results than cognitive load measurements (Schleinschok et al., 2017). Theoretical advances concerning embodied cognition have focused on the aspect of prediction (e.g., Clark, 2013, 2015) and there have been suggestions toward emphasizing meta-cognitive judgments within CLT (see Valcke, 2002; Skulmowski et al., 2016).
Judging from recent research on embodied learning, we can draw a number of conclusions for cognitive load measurement. Considering the reviewed studies utilizing subjective methods, cognitive load surveys appear to be a viable choice for measuring cognitive load in embodied learning. Yet, the different wordings found across different cognitive load surveys may pose a difficulty for choosing an appropriate survey for learning settings based on embodiment theory (see Subjective Methods).
Behavioral and physiological measures of cognitive load are objective alternatives to subjective cognitive load surveys (Brünken et al., 2003; Paas et al., 2003). In Section “Behavioral Measures of Cognitive Load” we have presented arguments in favor and against the use of dual-task performance as cognitive load measurement. From the reviewed research on physiological measures, we can see an enormous potential for these types of measures for educational and applied research based on embodied cognition. However, embodied learning may require specialized equipment allowing to perform mobile recordings (see Physiological Measures of Cognitive Load).
To conclude, researchers interested in embodied learning have a wide variety of tools for cognitive load measurement at their disposal. Yet, as we have seen, some methods are more appropriate than others for specific situations. Therefore, further research is necessary to determine more detailed guidelines regarding the use of cognitive load measurement methods in embodied scenarios.
Statements
Author contributions
AS created the initial draft of the manuscript. GR provided critical revisions to the draft. Both authors read and approved the final manuscript.
Funding
This research received funding from the German Research Foundation/DFG, GRK 1780/1. The publication costs of this article were funded by the German Research Foundation/DFG and the Technische Universität Chemnitz in the funding program Open Access Publishing.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
1
AgostinhoS.Tindall-FordS.GinnsP.HowardS. J.LeahyW.PaasF. (2015). Giving learning a helping hand: finger tracing of temperature graphs on an iPad.Educ. Psychol. Rev.27427–443. 10.1007/s10648-015-9315-5
2
AlbanM. W.KelleyC. M. (2013). Embodiment meets metamemory: weight as a cue for metacognitive judgments.J. Exp. Psychol. Learn. Mem. Cogn.391628–1634. 10.1037/a0032420
3
AntonenkoP.PaasF.GrabnerR.van GogT. (2010). Using electroencephalography to measure cognitive load.Educ. Psychol. Rev.22425–438. 10.1007/s10648-010-9130-y
4
BaddeleyA. (1992). Working memory.Science255556–559. 10.1126/science.1736359
5
BarsalouL. (2003). Situated simulation in the human conceptual system.Lang. Cogn. Process.18513–562. 10.1080/01690960344000026
6
BarsalouL. W. (1999). Perceptions of perceptual symbols.Behav. Brain Sci.22637–660. 10.1017/S0140525X99532147
7
BarsalouL. W. (2008). Grounded cognition.Annu. Rev. Psychol.59617–645. 10.1146/annurev.psych.59.103006.093639
8
BruckerB.EhlisA. C.HäußingerF. B.FallgatterA. J.GerjetsP. (2015). Watching corresponding gestures facilitates learning with animations by activating human mirror-neurons: an fNIRS study.Learn. Instr.3627–37. 10.1016/j.learninstruc.2014.11.003
9
BrünkenR.PlassJ. L.LeutnerD. (2003). Direct measurement of cognitive load in multimedia learning.Educ. Psychol.3853–61. 10.1207/S15326985EP3801_7
10
BrünkenR.SteinbacherS.PlassJ. L.LeutnerD. (2002). Assessment of cognitive load in multimedia learning using dual-task methodology.Exp. Psychol.49109–119. 10.1027//1618-3169.49.2.109
11
Castro-AlonsoJ. C.AyresP.PaasF. (2014). Learning from observing hands in static and animated versions of non-manipulative tasks.Learn. Instr.3411–21. 10.1016/j.learninstruc.2014.07.005
12
Castro-AlonsoJ. C.AyresP.PaasF. (2015a). Animations showing Lego manipulative tasks: three potential moderators of effectiveness.Comput. Educ.851–13. 10.1016/j.compedu.2014.12.022
13
Castro-AlonsoJ. C.AyresP.PaasF. (2015b). “The potential of embodied cognition to improve STEAM instructional dynamic visualizations,” in Emerging Technologies for STEAM Education, edsGeX.IfenthalerD.SpectorJ. M. (New York, NY: Springer), 113–136. 10.1007/978-3-319-02573-5_7
14
ChoiH. H.van MerriënboerJ. J.PaasF. (2014). Effects of the physical environment on cognitive load and learning: towards a new model of cognitive load.Educ. Psychol. Rev.26225–244. 10.1007/s10648-014-9262-6
15
ClarkA. (1999). An embodied cognitive science?Trends Cogn. Sci.3345–351. 10.1016/S1364-6613(99)01361-3
16
ClarkA. (2013). Whatever next? Predictive brains, situated agents, and the future of cognitive science.Behav. Brain Sci.36181–204. 10.1017/S0140525X12000477
17
ClarkA. (2015). Surfing Uncertainty: Prediction, Action, and the Embodied Mind.Oxford: Oxford University Press.
18
Dall’AlbaG.BarnacleR. (2005). Embodied knowing in online environments.Educ. Philos. Theory37719–744. 10.1111/j.1469-5812.2005.00153.x
19
de JongT. (2010). Cognitive load theory, educational research, and instructional design: some food for thought.Instr. Sci.38105–134. 10.1007/s11251-009-9110-0
20
DebenerS.MinowF.EmkesR.GandrasK.VosM. (2012). How about taking a low-cost, small, and wireless EEG for a walk?Psychophysiology491617–1621. 10.1111/j.1469-8986.2012.01471.x
21
DubéA. K.McEwenR. N. (2015). Do gestures matter? The implications of using touchscreen devices in mathematics instruction.Learn. Instr.4089–98. 10.1016/j.learninstruc.2015.09.002
22
DunloskyJ.MetcalfeJ. (2009). Metacognition.Thousand Oaks, CA: Sage Publications.
23
EhingerB. V.FischerP.GertA. L.KaufholdL.WeberF.PipaG.et al (2014). Kinesthetic and vestibular information modulate alpha activity during spatial navigation: a mobile EEG study.Front. Hum. Neurosci.8:71. 10.3389/fnhum.2014.00071
24
EysinkT. H.de JongT.BertholdK.KolloffelB.OpfermannM.WoutersP. (2009). Learner performance in multimedia learning arrangements: an analysis across instructional approaches.Am. Educ. Res. J.461107–1149. 10.3102/0002831209340235
25
GallagherS. (2005). How the Body Shapes the Mind.Oxford: Oxford University Press. 10.1093/0199271941.001.0001
26
GallagherS.LindgrenR. (2015). Enactive metaphors: learning through full-body engagement.Educ. Psychol. Rev.27391–404. 10.1007/s10648-015-9327-1
27
GlenbergA. M. (2010). Embodiment as a unifying perspective for psychology.Wiley Interdiscip. Rev. Cogn. Sci.1586–596. 10.1002/wcs.55
28
GlenbergA. M.GutierrezT.LevinJ. R.JapuntichS.KaschakM. P. (2004). Activity and imagined activity can enhance young children’s reading comprehension.J. Educ. Psychol.96424–436. 10.1037/0022-0663.96.3.424
29
GramannK.FerrisD. P.GwinJ.MakeigS. (2014). Imaging natural cognition in action.Int. J. Psychophysiol.9122–29. 10.1016/j.ijpsycho.2013.09.003
30
HartS. G.StavelandL. E. (1988). Development of NASA-TLX (Task Load Index): results of empirical and theoretical research.Adv. Psychol.52139–183. 10.1016/S0166-4115(08)62386-9
31
HuttoD. D.KirchhoffM. D.AbrahamsonD. (2015). The enactive roots of STEM: rethinking educational design in mathematics.Educ. Psychol. Rev.27371–389. 10.1007/s10648-015-9326-2
32
JiangX.ZhengB.BednarikR.AtkinsM. S. (2015). Pupil responses to continuous aiming movements.Int. J. Hum. Comput. Stud.831–11. 10.1016/j.ijhcs.2015.05.006
33
Johnson-GlenbergM. C.BirchfieldD. A.TolentinoL.KoziupaT. (2014). Collaborative embodied learning in mixed reality motion-capture environments: two science studies.J. Educ. Psychol.10686–104. 10.1037/a0034008
34
Johnson-GlenbergM. C.Megowan-RomanowiczC.BirchfieldD. A.Savio-RamosC. (2016). Effects of embodied learning and digital platform on the retention of physics content: centripetal force.Front. Psychol.7:1819. 10.3389/fpsyg.2016.01819
35
KalyugaS. (2011). Cognitive load theory: how many types of load does it really need?Educ. Psychol. Rev.231–19. 10.3389/fpsyg.2016.00420
36
KasparK.VennekötterA. (2015). Embodied information in cognitive tasks: haptic weight sensations affect task performance and processing style.Adv. Cogn. Psychol.1164–76. 10.5709/acp-0172-0
37
KirschnerP. A.AyresP.ChandlerP. (2011). Contemporary cognitive load theory research: the good, the bad and the ugly.Comput. Hum. Behav.2799–105. 10.1016/j.chb.2010.06.025
38
LeppinkJ.PaasF.van der VleutenC. P.van GogT.van MerriënboerJ. J. (2013). Development of an instrument for measuring different types of cognitive load.Behav. Res. Methods451058–1072. 10.3758/s13428-013-0334-1
39
LeppinkJ.van MerriënboerJ. J. (2015). The beast of aggregating cognitive load measures in technology-based learning.Educ. Technol. Soc.18230–245.
40
LindblomJ. (2015). Embodied Social Cognition.Berlin: Springer. 10.1007/978-3-319-20315-7
41
LindgrenR.Johnson-GlenbergM. (2013). Emboldened by embodiment: six precepts for research on embodied learning and mixed reality.Educ. Res.42445–452. 10.3102/0013189X13511661
42
LindgrenR.TschollM.WangS.JohnsonE. (2016). Enhancing learning and engagement through embodied interaction within a mixed reality simulation.Comput. Educ.95174–187. 10.1016/j.compedu.2016.01.001
43
MartinS. (2014). Measuring cognitive load and cognition: metrics for technology-enhanced learning.Educ. Res. Eval.20592–621. 10.1080/13803611.2014.997140
44
MayerR. E. (2005). “Cognitive theory of multimedia learning,” in The Cambridge Handbook of Multimedia Learning, ed.MayerR. E. (Cambridge: Cambridge University Press), 31–48. 10.1017/CBO9780511816819.004
45
MerchantZ.GoetzE. T.CifuentesL.Keeney-KennicuttW.DavisT. J. (2014). Effectiveness of virtual reality-based instruction on students’ learning outcomes in K-12 and higher education: a meta-analysis.Comput. Educ.7029–40. 10.1016/j.compedu.2013.07.033
46
MitraR.McNealK. S.BondellH. D. (2016). Pupillary response to complex interdependent tasks: a cognitive-load theory perspective.Behav. Res. Methods10.3758/s13428-016-0833-y[Epub ahead of print].
47
NaismithL. M.CheungJ. J.RingstedC.CavalcantiR. B. (2015). Limitations of subjective cognitive load measures in simulation-based procedural training.Med. Educ.49805–814. 10.1111/medu.12732
48
OzcinarZ. (2009). The topic of instructional design in research journals: a citation analysis for the years 1980-2008.Australas. J. Educ. Technol.25559–580. 10.14742/ajet.1129
49
PaasF.SwellerJ. (2012). An evolutionary upgrade of cognitive load theory: using the human motor system and collaboration to support the learning of complex cognitive tasks.Educ. Psychol. Rev.2427–45. 10.1007/s10648-011-9179-2
50
PaasF.TuovinenJ. E.TabbersH.van GervenP. W. (2003). Cognitive load measurement as a means to advance cognitive load theory.Educ. Psychol.3863–71. 10.1207/S15326985EP3801_8
51
PaasF. G. (1992). Training strategies for attaining transfer of problem-solving skill in statistics: a cognitive-load approach.J. Educ. Psychol.84429–434. 10.1037/0022-0663.84.4.429
52
PaasF. G.van MerriënboerJ. J. (1993). The efficiency of instructional conditions: an approach to combine mental effort and performance measures.Hum. Fact.35737–743.
53
PaasF. G.van MerriënboerJ. J.AdamJ. J. (1994). Measurement of cognitive load in instructional research.Percept. Mot. Skills79419–430. 10.2466/pms.1994.79.1.419
54
PalermoE.LautJ.NovO.CappaP.PorfiriM. (2017). Spatial memory training in a citizen science context.Comput. Hum. Behav.7338–46. 10.1016/j.chb.2017.03.017
55
ParkB.BrünkenR. (2015). The rhythm method: a new method for measuring cognitive load—an experimental dual-task study.Appl. Cogn. Psychol.29232–243. 10.1002/acp.3100
56
PlassJ. L.HomerB. D.HaywardE. O. (2009). Design factors for educationally effective animations and simulations.J. Comp. High. Educ.2131–61. 10.1007/s12528-009-9011-x
57
PostL. S.Van GogT.PaasF.ZwaanR. A. (2013). Effects of simultaneously observing and making gestures while studying grammar animations on cognitive load and learning.Comput. Hum. Behav.291450–1455. 10.1016/j.chb.2013.01.005
58
PouwW. T.EieltsC.van GogT.ZwaanR. A.PaasF. (2016a). Does (non-) meaningful sensori-motor engagement promote learning with animated physical systems?Mind Brain Educ.1091–104. 10.1111/mbe.12105
59
PouwW. T.MavilidiM. F.van GogT.PaasF. (2016b). Gesturing during mental problem solving reduces eye movements, especially for individuals with lower visual working memory capacity.Cogn. Proc.17269–277. 10.1007/s10339-016-0757-6
60
PouwW. T.van GogT.ZwaanR. A.PaasF. (2016c). Augmenting instructional animations with a body analogy to help children learn about physical systems.Front. Psychol.7:860. 10.3389/fpsyg.2016.00860
61
RuiterM.LoyensS.PaasF. (2015). Watch your step children! Learning two-digit numbers through mirror-based observation of self-initiated body movements.Educ. Psychol. Rev.27457–474. 10.1007/s10648-015-9324-4
62
SchleinschokK.EitelA.ScheiterK. (2017). Do drawing tasks improve monitoring and control during learning from text?Learn. Instr.10.1016/j.learninstruc.2017.02.002[Epub ahead of print].
63
ShapiroL. (2011). Embodied Cognition.New York, NY: Routledge.
64
SkulmowskiA.BungeA.KasparK.PipaG. (2014). Forced-choice decision-making in modified trolley dilemma situations: a virtual reality and eye tracking study.Front. Behav. Neurosci.8:426. 10.3389/fnbeh.2014.00426
65
SkulmowskiA.PradelS.KühnertT.BrunnettG.ReyG. D. (2016). Embodied learning using a tangible user interface: the effects of haptic perception and selective pointing on a spatial learning task.Comput. Educ.92–93, 64–75. 10.1016/j.compedu.2015.10.011
66
SkulmowskiA.ReyG. D. (2017). Bodily effort enhances learning and metacognition: investigating the relation between physical effort and cognition using dual-process models of embodiment.Adv. Cogn. Psychol.133–10. 10.5709/acp-0202-9
67
SongH. S.PusicM.NickM. W.SarpelU.PlassJ. L.KaletA. L. (2014). The cognitive impact of interactive design features for learning complex materials in medical education.Comput. Educ.71198–205. 10.1016/j.compedu.2013.09.017
68
SwellerJ. (1988). Cognitive load during problem solving: effects on learning.Cogn. Sci.12257–285. 10.1207/s15516709cog1202_4
69
SwellerJ. (1994). Cognitive load theory, learning difficulty, and instructional design.Learn. Instr.4295–312. 10.1016/0959-4752(94)90003-5
70
SwellerJ.ChandlerP. (1994). Why some material is difficult to learn.Cogn. Instr.12185–233. 10.1207/s1532690xci1203_1
71
SwellerJ.van MerrienboerJ. J.PaasF. G. (1998). Cognitive architecture and instructional design.Educ. Psychol. Rev.10251–296. 10.1023/A:1022193728205
72
TranC.SmithB.BuschkuehlM. (2017). Support of mathematical thinking through embodied cognition: nondigital and digital approaches.Cogn. Res. Princ. Implic.2:16. 10.1186/s41235-017-0053-8
73
ValckeM. (2002). Cognitive load: updating the theory?Learn. Instr.12147–154. 10.1016/S0959-4752(01)00022-6
74
van GenuchtenE.HooijdonkC.SchülerA.ScheiterK. (2014). The role of working memory when ‘learning how’ with multimedia learning material.Appl. Cogn. Psychol.28327–335. 10.1002/acp.2998
75
van GervenP. W.PaasF.van MerriënboerJ. J.SchmidtH. G. (2004). Memory load and the cognitive pupillary response in aging.Psychophysiology41167–174. 10.1111/j.1469-8986.2003.00148.x
76
van GogT.KirschnerF.KesterL.PaasF. (2012). Timing and frequency of mental effort measurement: evidence in favour of repeated measures.Appl. Cogn. Psychol.26833–839. 10.1002/acp.2883
77
van GogT.PaasF. (2008). Instructional efficiency: revisiting the original construct in educational research.Educ. Psychol.4316–26. 10.1080/00461520701756248
78
van GogT.PaasF.MarcusN.AyresP.SwellerJ. (2009). The mirror neuron system and observational learning: implications for the effectiveness of dynamic visualizations.Educ. Psychol. Rev.2121–30. 10.1007/s10648-008-9094-3
79
WhelanR. R. (2007). Neuroimaging of cognitive load in instructional multimedia.Educ. Res. Rev.21–12. 10.1016/j.edurev.2006.11.001
80
WilsonM. (2002). Six views of embodied cognition.Psychon. Bull. Rev.9625–636. 10.3758/BF03196322
81
WongM.Castro-AlonsoJ. C.AyresP.PaasF. (2015). Gender effects when learning manipulative tasks from instructional animations and static presentations.Educ. Technol. Soc.1837–52.
82
YoungJ. Q.IrbyD. M.Barilla-LaBarcaM. L.ten CateO.O’SullivanP. S. (2016). Measuring cognitive load: mixed results from a handover simulation for medical students.Perspect. Med. Educ.524–32. 10.1007/s40037-015-0240-6
Summary
Keywords
embodied cognition, learning, cognitive load theory, cognitive load, measurement
Citation
Skulmowski A and Rey GD (2017) Measuring Cognitive Load in Embodied Learning Settings. Front. Psychol. 8:1191. doi: 10.3389/fpsyg.2017.01191
Received
26 March 2017
Accepted
29 June 2017
Published
02 August 2017
Volume
8 - 2017
Edited by
Claudia Repetto, Università Cattolica del Sacro Cuore, Italy
Reviewed by
Jessica Lindblom, University of Skövde, Sweden; Thea Ionescu, Babeş-Bolyai University, Romania
Updates
Copyright
© 2017 Skulmowski and Rey.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Alexander Skulmowski, alexander.skulmowski@phil.tuchemnitz.de
This article was submitted to Cognition, a section of the journal Frontiers in Psychology
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.