<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Psychol.</journal-id>
<journal-title>Frontiers in Psychology</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Psychol.</abbrev-journal-title>
<issn pub-type="epub">1664-1078</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fpsyg.2022.810194</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Psychology</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>The Impact of Emotional Feedback and Elaborated Feedback of a Pedagogical Agent on Multimedia Learning</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name><surname>Lang</surname> <given-names>Yueru</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/1381086/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Xie</surname> <given-names>Ke</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/649818/overview"/>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>Gong</surname> <given-names>Shaoying</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/566167/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Wang</surname> <given-names>Yanqing</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/1393962/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Cao</surname> <given-names>Yang</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/649964/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>School of Psychology, Central China Normal University</institution>, <addr-line>Wuhan</addr-line>, <country>China</country></aff>
<aff id="aff2"><sup>2</sup><institution>Key Laboratory of Adolescent Cyberpsychology and Behavior (CCNU), Ministry of Education</institution>, <addr-line>Wuhan</addr-line>, <country>China</country></aff>
<aff id="aff3"><sup>3</sup><institution>No. 4 Junior Middle School of Wuhan Optics Valley</institution>, <addr-line>Wuhan</addr-line>, <country>China</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Harrison Yang, SUNY Oswego, United States</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Lijia Lin, East China Normal University, China; Dayu Jiang, Wuhan University, China</p></fn>
<corresp id="c001">&#x0002A;Correspondence: Shaoying Gong <email>gongsy&#x00040;ccnu.edu.cn</email></corresp>
<fn fn-type="other" id="fn001"><p>This article was submitted to Educational Psychology, a section of the journal Frontiers in Psychology</p></fn></author-notes>
<pub-date pub-type="epub">
<day>10</day>
<month>06</month>
<year>2022</year>
</pub-date>
<pub-date pub-type="collection">
<year>2022</year>
</pub-date>
<volume>13</volume>
<elocation-id>810194</elocation-id>
<history>
<date date-type="received">
<day>06</day>
<month>11</month>
<year>2021</year>
</date>
<date date-type="accepted">
<day>13</day>
<month>05</month>
<year>2022</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2022 Lang, Xie, Gong, Wang and Cao.</copyright-statement>
<copyright-year>2022</copyright-year>
<copyright-holder>Lang, Xie, Gong, Wang and Cao</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract>
<p>This study aimed to explore the impact of emotional feedback and elaborated feedback provided by a pedagogical agent (PA) on learners&#x00027; emotions, intrinsic motivation, agent perception, cognitive load, and transfer performance in multimedia learning. The experiment was conducted based on an actual undergraduate course. Undergraduate students (<italic>N</italic> = 117) were randomly assigned to one of the four conditions, where PA&#x00027;s feedback differed by emotional feedback (with vs. without) and elaborated feedback (elaborated feedback vs. knowledge of results). Results revealed that emotional feedback reduced learners&#x00027; confusion, activated intrinsic motivation, and enhanced agent perception. In addition, elaborated feedback improved intrinsic motivation, agent perception, and transfer performance but reduced germane cognitive load. Surprisingly, there was no significant interaction between emotional feedback and elaborated feedback. These findings had implications for designing a PA with a feedback fulfilling learners&#x00027; emotional and cognitive needs to maximize multimedia learning.</p></abstract>
<kwd-group>
<kwd>emotional feedback</kwd>
<kwd>elaborated feedback</kwd>
<kwd>pedagogical agent</kwd>
<kwd>multimedia learning</kwd>
<kwd>learning processes</kwd>
<kwd>learning performance</kwd>
</kwd-group>
<contract-sponsor id="cn001">National Natural Science Foundation of China<named-content content-type="fundref-id">10.13039/501100001809</named-content></contract-sponsor>
<counts>
<fig-count count="2"/>
<table-count count="3"/>
<equation-count count="0"/>
<ref-count count="68"/>
<page-count count="12"/>
<word-count count="9044"/>
</counts>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="s1">
<title>Introduction</title>
<p>With the advance of educational technology, implementing a pedagogical agent (PA) to interact with learners in real time becomes a trend in computer-based learning environment. Providing feedback is an important function of PA, which keeps learners&#x00027; motivation high and benefits performance (Dennis et al., <xref ref-type="bibr" rid="B10">2015</xref>). Feedback can be classified by content into emotional feedback and cognitive feedback (Economides, <xref ref-type="bibr" rid="B13">2005</xref>). Some studies have found the positive effects of emotional feedback provided by PA on emotions (Klein et al., <xref ref-type="bibr" rid="B29">2002</xref>; Arroyo et al., <xref ref-type="bibr" rid="B1">2011</xref>), learning motivation (Lin et al., <xref ref-type="bibr" rid="B34">2014</xref>), agent perception (Woolf et al., <xref ref-type="bibr" rid="B66">2010</xref>), but uncertain facilitation on cognitive processes or performance (Guo et al., <xref ref-type="bibr" rid="B22">2014</xref>; Kim et al., <xref ref-type="bibr" rid="B28">2017</xref>). Other studies indicated that elaborated feedback, one type of cognitive feedback, could promote academic achievement (Moreno, <xref ref-type="bibr" rid="B39">2004</xref>; Lin et al., <xref ref-type="bibr" rid="B35">2013</xref>; Law and Chen, <xref ref-type="bibr" rid="B30">2016</xref>), while the impact on learning processes was ambiguous. The following questions need to be further solved: Can emotional feedback of PA have an impact on learning performance? What kind of cognitive feedback is more conducive to learning? Can PA incorporated with emotional feedback and elaborated feedback at the same time facilitate not only learning processes but also learning performance? On the basis of previous studies, this study aims to explore the impact of emotional feedback and elaborated feedback provided by PA on learning processes and performance and investigates whether emotional feedback and elaborated feedback can produce a mutual effect on learning.</p>
<sec>
<title>PA and Learning</title>
<p>Pedagogical agents are animated anthropomorphic characters employed in the digital learning environment to convey information and enhance motivation by simulating social interaction with learners (Kim et al., <xref ref-type="bibr" rid="B27">2007</xref>; Castro-Alonso et al., <xref ref-type="bibr" rid="B8">2021</xref>). There are two propositions of theories to explain how PA affects multimedia learning. One proposition was based on Social Presence Theory and Social Agency Theory. The other was based on the Interference Theory of Social Agency.</p>
<p>Both the Social Presence Theory and the Social Agency Theory posit that PA might be beneficial for learning processes and performance. According to Social Presence Theory, the social presence of a PA contributes to the level of intimacy that depends on factors such as smiling, dialogue, and eye contact. Therefore, learners tend to perceive the PA as a &#x0201C;real person&#x0201D; and have a more positive emotional experience, stronger learning willingness, and greater satisfaction, and then achieve better academic performance than those who do not study with PA (Gunawardena and Zittle, <xref ref-type="bibr" rid="B20">1997</xref>). Another theoretical framework to explain the effect of PA on learning is Social Agency Theory. It supposes that social cues exhibited by PA make learners perceive a computer&#x02013;human interaction as a human&#x02013;human interaction, which primes the social interaction schema (Mayer et al., <xref ref-type="bibr" rid="B38">2003</xref>; Atkinson et al., <xref ref-type="bibr" rid="B3">2005</xref>). When learners interpret the learning environment as a social one, they might invest more mental efforts in processing information conveyed by PA, which in turn might improve transfer performance (Mayer and DaPra, <xref ref-type="bibr" rid="B37">2012</xref>; Fiorella and Mayer, <xref ref-type="bibr" rid="B16">2021</xref>).</p>
<p>However, the prediction of Interference Theory of Social Agency is different. It posits that PA, as a seductive detail, may hinder learners with retention and transfer performance of core materials because PA may occupy limited working-memory capacity at the selecting, organizing, or integrating stage (Paas et al., <xref ref-type="bibr" rid="B44">2003</xref>; Lehman et al., <xref ref-type="bibr" rid="B32">2007</xref>). Following this rationale, presenting a PA in a multimedia environment may be counterproductive.</p>
<p>Up to now, there is empirical evidence for Social Presence Theory and Social Agency Theory (Wang et al., <xref ref-type="bibr" rid="B64">2020</xref>; Castro-Alonso and Sweller, <xref ref-type="bibr" rid="B7">2021</xref>; Schneider et al., <xref ref-type="bibr" rid="B53">2022</xref>). However, there is also some evidence for Interference Theory of Social Agency (Lin et al., <xref ref-type="bibr" rid="B36">2020</xref>). Lin et al. (<xref ref-type="bibr" rid="B35">2013</xref>) and Lawson et al. (<xref ref-type="bibr" rid="B31">2021</xref>) pointed out that specific characteristics of agents, such as how to convey information, could affect the effectiveness of PA. Hereby, instead of generally discussing whether PA can promote learning, we should focus more on specific characteristics of PA. The necessity of a finer-grained analysis of PA&#x00027;s characteristics also has been suggested by Schroeder and Adesope (<xref ref-type="bibr" rid="B54">2014</xref>). This study investigated the effect of feedback, one of the internal PA&#x00027;s characteristics, on learning processes and performance.</p>
</sec>
<sec>
<title>PA&#x00027;s Emotional Feedback and Learning</title>
<p>Feedback is one of the most important elements of instructional guidance (Panadero and Lipnevich, <xref ref-type="bibr" rid="B46">2022</xref>). When a test-like event is launched, learners are encouraged to generate an answer on the basis of prior knowledge and evaluate their own current performance. Feedback is a powerful tool to help learners evaluate their learning so as to bridge the gap between current performance and the target (Hattie and Timperley, <xref ref-type="bibr" rid="B23">2007</xref>).</p>
<p>A study by Shute (<xref ref-type="bibr" rid="B57">2008</xref>) revealed that feedback could not only regulate motivation and emotions, but also supply personalized scaffolding through cognitive information. In this vein, PA&#x00027;s feedback can be classified by content into emotional feedback and cognitive feedback. Emotional feedback aims to ameliorate learners&#x00027; emotional states (Terzis et al., <xref ref-type="bibr" rid="B60">2012</xref>; Tung, <xref ref-type="bibr" rid="B62">2013</xref>), which can support learners through conveying inspiration, entertainment, empathy, praise, criticism, and so on (Economides, <xref ref-type="bibr" rid="B13">2005</xref>). Parallel empathy and reactive empathy are the two most important forms of emotional feedback. In parallel empathy, the PA identifies and reproduces learners&#x00027; emotions. In reactive empathy, the PA helps learners to regulate emotional states after identifying their emotions (Burleson and Picard, <xref ref-type="bibr" rid="B5">2007</xref>; Economides, <xref ref-type="bibr" rid="B15">2009</xref>; Terzis et al., <xref ref-type="bibr" rid="B60">2012</xref>).</p>
<p>Some researchers stressed that emotions are inherently interconnected with cognition. For example, Moreno and Mayer (<xref ref-type="bibr" rid="B40">2007</xref>) Cognitive Affective Theory of Learning with Media makes the case that the emotional interaction between learners and computers is a motivational factor, which influences the cognitive processing of multimedia information, including selection, organization, and integration. Plass and Kaplan (<xref ref-type="bibr" rid="B50">2016</xref>) later proposed the Integrated Cognitive Affective Model of Learning with the Multimedia (ICALM), which proposed that emotional processes are intertwined with, and inseparable from, cognitive processes. In cognitive-emotional processing of multimedia stimuli, emotional processes make demands on cognitive resources, and cognitive activities are affected by emotional factors to some extent. Given that PA&#x00027;s emotional feedback is a form of human&#x02013;computer emotional interaction, it may affect not only emotional processes but also cognitive processing. In this vein, a study by Schneider et al. (<xref ref-type="bibr" rid="B53">2022</xref>) confirmed that a PA merely with facial expressions contributed to happy and successful learning, and emotional feedback to provide learners with support was more likely to improve emotions, motivation, and performance (Kim et al., <xref ref-type="bibr" rid="B27">2007</xref>).</p>
<p>There is mounting evidence for PA&#x00027;s emotional feedback that facilitates learning processes. Emotional feedback can improve learning processes by triggering positive emotions, reducing negative emotions, enhancing motivation, and bringing better agent perception. For emotions, a PA with parallel empathy or reactive empathy reduced boredom and frustration among young adults (Hone, <xref ref-type="bibr" rid="B24">2006</xref>; Arroyo et al., <xref ref-type="bibr" rid="B1">2011</xref>). A similar result can be found in a study with children. In Burleson (<xref ref-type="bibr" rid="B4">2013</xref>) study, an effective PA with parallel and reactive empathy increased positive emotions alongside a decreased sense of stuck when children solved a Tower of Hanoi problem. Regarding motivation, PA with parallel empathy enhanced university students&#x00027; motivation in course of academic information seeking and course of accounting (Guo et al., <xref ref-type="bibr" rid="B22">2014</xref>; Lin et al., <xref ref-type="bibr" rid="B34">2014</xref>). Concerning agent perception, a study with high school students learning mathematics showed agent perception to be better when PA was featured with reactive-empathic behaviors as opposed to PA with neutral behaviors (Woolf et al., <xref ref-type="bibr" rid="B66">2010</xref>). Terzidou et al. (<xref ref-type="bibr" rid="B59">2018</xref>) also found similar results among college students in educational virtual environment courses. For cognitive load, to our knowledge, previous studies have barely explored whether emotional feedback can affect cognitive load. Nevertheless, based on Social Presence Theory (Gunawardena and Zittle, <xref ref-type="bibr" rid="B20">1997</xref>) and Social Agency Theory (Mayer and DaPra, <xref ref-type="bibr" rid="B37">2012</xref>; Fiorella and Mayer, <xref ref-type="bibr" rid="B16">2021</xref>), PA with emotional feedback can foster the social connection and create a human-to-human interaction atmosphere, which in turn encourages learners to invest more mental efforts in learning tasks.</p>
<p>In terms of learning performance, previous studies have not been able to convincingly determine whether PA with emotional feedback can promote learning achievement. Although Lin et al. (<xref ref-type="bibr" rid="B34">2014</xref>) and Shen (<xref ref-type="bibr" rid="B56">2009</xref>) have found that a PA featured with parallel and reactive empathy helped college students improve transfer performance in both accounting and mathematics, the majority of studies have revealed no significant impact on learning performance (Burleson and Picard, <xref ref-type="bibr" rid="B5">2007</xref>; Kim et al., <xref ref-type="bibr" rid="B27">2007</xref>, <xref ref-type="bibr" rid="B28">2017</xref>; Arroyo et al., <xref ref-type="bibr" rid="B2">2009</xref>; Guo et al., <xref ref-type="bibr" rid="B22">2014</xref>; Terzidou et al., <xref ref-type="bibr" rid="B59">2018</xref>). For instance, Kim et al. (<xref ref-type="bibr" rid="B27">2007</xref>) found that PA&#x00027;s parallel empathy did not promote pre-service teachers&#x00027; retention or transfer performance in pre-service training. Guo and Goh (<xref ref-type="bibr" rid="B21">2016</xref>) also examined whether using an affective PA could facilitate learning. The affective PA was designed to show reactive empathy when learners get answers. The result revealed that students in affective PA condition did not perform better than those with neutral PA or No-PA in retention performance. Some researchers suggested two opposite possible reasons for these results: first, emotional feedback may not be sufficient to affect the cognition of complex learning because it does not involve supportive information for cognitive processing (Kim et al., <xref ref-type="bibr" rid="B27">2007</xref>). Second, PA&#x00027;s emotional feedback may affect cognition, but the impact on cognitive processes is double-edged. On the one hand, emotional feedback can make the learning experience better and further expand working memory to help learners allocate cognitive resources. Learners are willing to invest more mental efforts in learning tasks (Frechette and Moreno, <xref ref-type="bibr" rid="B17">2010</xref>; Plass and Kalyuga, <xref ref-type="bibr" rid="B49">2019</xref>). On the other hand, emotional feedback may occupy cognitive resources, increase extraneous cognitive load, and distract attention (Li et al., <xref ref-type="bibr" rid="B33">2013</xref>; Guo et al., <xref ref-type="bibr" rid="B22">2014</xref>), then interfere with learning (Cabestrero et al., <xref ref-type="bibr" rid="B6">2018</xref>). In order to better understand the impact of PA&#x00027;s emotional feedback on cognitive processing, cognitive load is necessary to be taken into consideration. Moreover, it is important to highlight that the manipulation check of emotional feedback has barely been addressed in previous studies. As a premise, the manipulation of PA&#x00027;s emotional feedback should be proved to be effective in this study, and then we will investigate whether emotional feedback can affect learning processes and performance.</p>
</sec>
<sec>
<title>PA&#x00027;s Elaborated Feedback and Learning</title>
<p>Cognitive feedback serves learners with cognitive-related information targeting to support comprehension, problem-solving, and the elimination of misconceptions (Economides, <xref ref-type="bibr" rid="B14">2006</xref>; Kim et al., <xref ref-type="bibr" rid="B27">2007</xref>; Narciss, <xref ref-type="bibr" rid="B43">2008</xref>). Further, cognitive feedback can be classified by complexity into simple feedback and elaborated feedback (Shute, <xref ref-type="bibr" rid="B57">2008</xref>). Simple feedback is defined as either merely verifying whether the answer is correct called knowledge of results (KR), or showing the correct answer called knowledge of correct response (Lin et al., <xref ref-type="bibr" rid="B35">2013</xref>). Elaborated feedback can provide instructional information additionally including hints, problem-solving cues, supplementary materials, etc.</p>
<p>As a form of cognitive feedback, elaborated feedback contains problem-solving cues and error-correcting information for knowledge construction, and so might it be able to improve outcomes of high-order learning (Moreno, <xref ref-type="bibr" rid="B39">2004</xref>; Moreno and Mayer, <xref ref-type="bibr" rid="B41">2005</xref>; Lin et al., <xref ref-type="bibr" rid="B35">2013</xref>; Law and Chen, <xref ref-type="bibr" rid="B30">2016</xref>). For instance, Moreno (<xref ref-type="bibr" rid="B39">2004</xref>) found that learners in the elaborated feedback group performed better in retention and transfer tests than the KR group when learning plant discovery topics. Subsequent study by Lin et al. (<xref ref-type="bibr" rid="B35">2013</xref>) revealed that college learners in the elaborated feedback group outperformed their counterparts in the KR group when learning physics with a PA in a computer-based environment. A meta-analysis also demonstrated that elaborated feedback was more effective in boosting high-order learning than simple feedback (Van der Kleij et al., <xref ref-type="bibr" rid="B63">2014</xref>).</p>
<p>Furthermore, elaborated feedback is closely related to learning processes. According to the Five-Stage Model of Computer-Based Formative Assessment, learners&#x00027; emotions, motivation, or cognitive aspects can be adjusted by processing and self-evaluation based on feedback (Timmers et al., <xref ref-type="bibr" rid="B61">2015</xref>). Some studies have provided empirical evidence for the facilitation of elaborated feedback on motivation, agent perception, and germane cognitive load, as well as a decline in extraneous cognitive load (Moreno, <xref ref-type="bibr" rid="B39">2004</xref>; Xu, <xref ref-type="bibr" rid="B67">2018</xref>; Wang et al., <xref ref-type="bibr" rid="B65">2019</xref>). For example, Wang et al. (<xref ref-type="bibr" rid="B65">2019</xref>) found that more detailed feedback resulted in lower extraneous cognitive load, more positive feedback perception, higher germane cognitive load, and stronger intrinsic motivation in psychological statistics. Nevertheless, some studies showed no significance in learning processes between students who received elaborated feedback and those who received simple feedback. One such example is reported by Lin et al. (<xref ref-type="bibr" rid="B35">2013</xref>), in which KR and elaborated feedback groups showed similar motivation and cognitive load during the learning of thermodynamics materials among college students.</p>
<p>In sum, although elaborated feedback in most previous studies could improve performance, its effect on learning processes is still uncertain. In particular, the effect of elaborated feedback on emotions seems to be a black-box. According to the Control-Value Theory of Academic Emotions (Pekrun et al., <xref ref-type="bibr" rid="B47">2007</xref>), as part of a pedagogical environment, PA&#x00027;s elaborated feedback is posited to be antecedents of emotions, then emotions are assumed to affect motivation, cognitive resources, and achievement. With that in mind, we developed a learning system and investigated whether elaborated feedback could affect learners&#x00027; emotions, motivation, agent perception, cognitive load, and learning performance in the psychological statistics course.</p>
</sec>
<sec>
<title>The Current Study</title>
<p>Previous studies have revealed that PA&#x00027;s emotional feedback may improve learning processes, but emotional feedback alone has little effect on learning performance due to the lack of necessary cognitive support (Arroyo et al., <xref ref-type="bibr" rid="B1">2011</xref>; Guo et al., <xref ref-type="bibr" rid="B22">2014</xref>). Considering directly related to cognitive processing, PA&#x00027;s elaborated feedback is beneficial for learning performance but has uncertain impact on emotions, motivation, or cognitive load. Since emotional feedback and elaborated feedback have their own superiorities, it is necessary to further investigate whether presenting these two forms of feedback simultaneously can promote both learning processes and performance.</p>
<p>In the present study, we go beyond previous work by considering a manipulation check of emotional feedback to make sure the emotional feedback design was reasonable and valid. Then, we explore the impact of PA&#x00027;s emotional feedback and elaborated feedback on undergraduate students&#x00027; learning processes and performance. Specifically, the current study explores the following question: Can PA&#x00027;s emotional feedback and elaborated feedback affect learners&#x00027; emotions, intrinsic motivation, agent perception, cognitive load, and transfer performance? Can emotional feedback and elaborated feedback interact to influence emotions, intrinsic motivation, agent perception, cognitive load, and transfer performance?</p>
<p>In line with Social Presence Theory (Gunawardena and Zittle, <xref ref-type="bibr" rid="B20">1997</xref>) and Social Agency Theory (Mayer and DaPra, <xref ref-type="bibr" rid="B37">2012</xref>; Fiorella and Mayer, <xref ref-type="bibr" rid="B16">2021</xref>), PA with emotional feedback provides a social connection that fosters social interaction schema, which in turn results in more positive emotions, stronger learning motivation, more positive agent perception, and more mental efforts invested in learning tasks (Frechette and Moreno, <xref ref-type="bibr" rid="B17">2010</xref>; Plass and Kalyuga, <xref ref-type="bibr" rid="B49">2019</xref>). Since cognitive activities are affected by emotional factors (Plass and Kaplan, <xref ref-type="bibr" rid="B50">2016</xref>), it is hypothesized that similar results will occur in this study and the emotional feedback can facilitate learning performance.</p>
<sec>
<title>Hypothesis 1</title>
<p>Compared to learners studying with neutral PA (PA without emotional feedback), learners who are shown PA with emotional feedback have more positive emotions, less negative emotions (H1a), stronger intrinsic motivation (H1b), better agent perception (H1c), higher germane cognitive load (H1d), and better transfer performance (H1e).</p>
<p>Since several previous studies have proven the learning-beneficial effects of PA&#x00027;s elaborated feedback (Moreno, <xref ref-type="bibr" rid="B39">2004</xref>; Lin et al., <xref ref-type="bibr" rid="B35">2013</xref>; Van der Kleij et al., <xref ref-type="bibr" rid="B63">2014</xref>), it is assumed that a similar result will occur in this study. According to the Five-Stage Model of Computer- Based Formative Assessment (Timmers et al., <xref ref-type="bibr" rid="B61">2015</xref>) and Control-Value Theory of Academic Emotions (Pekrun et al., <xref ref-type="bibr" rid="B47">2007</xref>), implementing a PA with elaborated feedback leads to an increase in positive emotions, motivation, learner&#x00027;s perception of agent, germane cognitive load, and decrease in extraneous cognitive load (Lin et al., <xref ref-type="bibr" rid="B35">2013</xref>; Xu, <xref ref-type="bibr" rid="B67">2018</xref>; Wang et al., <xref ref-type="bibr" rid="B65">2019</xref>). Therefore, the following hypothesis is formulated:</p>
</sec>
<sec>
<title>Hypothesis 2</title>
<p>Compared to learners receiving the knowledge of results from PA, learners receiving elaborated feedback have more positive emotions, less negative emotions (H2a), stronger intrinsic motivation (H2b), better agent perception (H2c), higher germane cognitive load (H2d), and better transfer performance (H2e).</p>
<p>Until now, to our knowledge no study has simultaneously investigated the intertwining influence of PA&#x00027;s emotional feedback and elaborated feedback. From the above literature review, PA&#x00027;s emotional feedback benefits learning processes, and elaborated feedback facilitates learning performance. Based on ICALM, showing these two kinds of feedback should achieve better effects on both learning processes and results. For this, the present study looks at this supposed interaction exploratory:</p>
</sec>
<sec>
<title>Hypothesis 3</title>
<p>There are interaction effects of PA&#x00027;s emotional feedback and elaborated feedback in terms of emotions, intrinsic motivation, agent perception, cognitive load, and transfer performance. There is an advantage of PA with emotional feedback and elaborated feedback simultaneously over other conditions in all dependent variables (H3).</p>
</sec>
</sec>
</sec>
<sec id="s2">
<title>Method</title>
<p>This experiment investigated the impact of PA&#x00027;s emotional feedback (with vs. without) and elaborated feedback (elaborated feedback vs. KR) on learning, as determined by five measures: learners&#x00027; emotions, intrinsic motivation, agent perception, cognitive load, and transfer performance.</p>
<sec>
<title>Participants</title>
<p>Participants were 117 undergraduate students who had finished a psychological statistics course. The average age of the participants was 19.79 (<italic>SD</italic> = 0.89). Of these participants, 89 were females and 28 were males. Participants were randomly assigned to one of four conditions: PA with emotional and elaborated feedback, PA with emotional feedback and KR, neutral PA with elaborated feedback, and neutral PA with KR (cf. <xref ref-type="table" rid="T1">Table 1</xref>).</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p>Distribution of participants.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th/>
<th valign="top" align="center" style="border-bottom: thin solid #000000;" colspan="2"><bold>PA with emotional feedback</bold></th>
<th valign="top" align="center" style="border-bottom: thin solid #000000;" colspan="2"><bold>PA without emotional feedback</bold></th>
<th valign="top" align="center"><bold>Total</bold></th>
</tr>
<tr>
<th/>
<th valign="top" align="center"><bold>PA with KR</bold></th>
<th valign="top" align="center"><bold>PA with elaborated feedback</bold></th>
<th valign="top" align="center"><bold>PA with KR</bold></th>
<th valign="top" align="center"><bold>PA with elaborated feedback</bold></th>
<th/>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Male</td>
<td valign="top" align="center">7</td>
<td valign="top" align="center">7</td>
<td valign="top" align="center">7</td>
<td valign="top" align="center">7</td>
<td valign="top" align="center">28</td>
</tr>
<tr>
<td valign="top" align="left">Female</td>
<td valign="top" align="center">23</td>
<td valign="top" align="center">22</td>
<td valign="top" align="center">22</td>
<td valign="top" align="center">22</td>
<td valign="top" align="center">89</td>
</tr>
<tr>
<td valign="top" align="left">Total</td>
<td valign="top" align="center">30</td>
<td valign="top" align="center">29</td>
<td valign="top" align="center">29</td>
<td valign="top" align="center">29</td>
<td valign="top" align="center">117</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p><italic>PA, pedagogical agent; KR, knowledge of results</italic>.</p>
</table-wrap-foot>
</table-wrap>
</sec>
<sec>
<title>Design of PA and Feedback</title>
<p>The PA in this study was developed using MAYA, a 3D-animation-design tool. It was designed as a male teacher with pleasant, distressed, and neutral dynamic facial expression (cf. <xref ref-type="fig" rid="F1">Figure 1</xref>). The PA could nod or shake his head.</p>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p>Facial expressions of PA: <bold>(A)</bold> pleasure; <bold>(B)</bold> neutral; <bold>(C)</bold> distress.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fpsyg-13-810194-g0001.tif"/>
</fig>
<p>Given that confusion, boredom, frustration, enjoyment, and satisfaction were the most common emotions during online learning (D&#x00027;Mello and Graesser, <xref ref-type="bibr" rid="B12">2012</xref>; D&#x00027;Mello, <xref ref-type="bibr" rid="B11">2013</xref>), PA provided emotional feedback according to one of these five emotions every time reported by learners. In PA with emotional feedback condition, referring to a previous study (Terzis et al., <xref ref-type="bibr" rid="B60">2012</xref>), PA presented parallel empathy and reactive empathy through facial expression and text feedback. The facial expression of PA was the same-valence as emotions reported by participants. That is, PA showed a pleasant expression when the participant reported a positive emotion, or a distress expression when the participant reported a negative emotion. In terms of text feedback, PA reproduced participants&#x00027; emotions and provided additional supportive texts, which was referred to as Attribution Theory in previous studies (Chen et al., <xref ref-type="bibr" rid="B9">2012</xref>; Cabestrero et al., <xref ref-type="bibr" rid="B6">2018</xref>) to encourage participants (cf. <xref ref-type="table" rid="T2">Table 2</xref>). In PA without emotional feedback (neutral PA) condition, PA kept neutral expression all the time and did not support participants by text.</p>
<table-wrap position="float" id="T2">
<label>Table 2</label>
<caption><p>Rules of emotional feedback.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th/>
<th valign="top" align="left"><bold>Correct answer</bold></th>
<th valign="top" align="left"><bold>Wrong answer</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Confusion</td>
<td valign="top" align="left">Text: I am sad to see you confused. This question is really difficult!<break/> Facial expression: distress</td>
<td valign="top" align="left">Text: I am sad to see you confused. Cheer up, never give up!<break/> Facial expression: distress</td>
</tr>
<tr>
<td valign="top" align="left">Boredom</td>
<td valign="top" align="left">Text: I am sad to see you boring. Let us try some challenging tasks!<break/> Facial expression: distress</td>
<td valign="top" align="left">Text: I am sad to see you boring. Please pay attention.<break/> Facial expression: distress</td>
</tr>
<tr>
<td valign="top" align="left">Frustration</td>
<td valign="top" align="left">Text: I am sad to see you frustrated. Keep going, you can make it!<break/> Facial expression: distress</td>
<td valign="top" align="left">Text: I am sad to see you frustrated. This question is really difficult, let&#x00027;s try some other tasks.<break/> Facial expression: distress</td>
</tr>
<tr>
<td valign="top" align="left">Enjoyment</td>
<td valign="top" align="left">Text: I am glad to see you so pleasant. I am so happy for you!<break/> Facial expression: pleasure</td>
<td valign="top" align="left">Text: I am glad to see you so pleasant. Keep up the good work!<break/> Facial expression: pleasure</td>
</tr>
<tr>
<td valign="top" align="left">Satisfaction</td>
<td valign="top" align="left">Text: I am glad to see you so satisfied. I am so happy for you!<break/> Facial expression: pleasure</td>
<td valign="top" align="left">Text: I am glad to see you so satisfied. Keep up the good work!<break/> Facial expression: pleasure</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>Concerning elaborated feedback manipulation, PA with elaborated feedback provided information about the correctness of the answer (e.g., &#x0201C;the answer is wrong&#x0201D;), correct answer (e.g., &#x0201C;The correct answer is D&#x0201D;), formula (e.g., &#x0201C;the calculation formula of the harmonic mean is <inline-formula><mml:math id="M1"><mml:msub><mml:mrow><mml:mi>M</mml:mi></mml:mrow><mml:mrow><mml:mi>N</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mi>N</mml:mi></mml:mrow><mml:mrow><mml:mo stretchy="false">&#x02211;</mml:mo><mml:mfrac><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:msub><mml:mrow><mml:mi>X</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:mfrac></mml:mrow></mml:mfrac></mml:math></inline-formula>&#x0201D;), and problem-solving steps (e.g., &#x0201C;according to information of the question, N=3, <inline-formula><mml:math id="M2"><mml:mfrac><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:msub><mml:mrow><mml:mi>X</mml:mi></mml:mrow><mml:mrow><mml:mn>1</mml:mn></mml:mrow></mml:msub></mml:mrow></mml:mfrac><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mn>0</mml:mn><mml:mo>.</mml:mo><mml:mn>8</mml:mn></mml:mrow><mml:mrow><mml:mn>10</mml:mn></mml:mrow></mml:mfrac><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mn>2</mml:mn></mml:mrow><mml:mrow><mml:mn>25</mml:mn></mml:mrow></mml:mfrac><mml:mo>,</mml:mo><mml:mtext>&#x000A0;</mml:mtext><mml:mfrac><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:msub><mml:mrow><mml:mi>X</mml:mi></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msub></mml:mrow></mml:mfrac><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:mn>10</mml:mn></mml:mrow></mml:mfrac><mml:mo>,</mml:mo><mml:mtext>&#x000A0;</mml:mtext><mml:mfrac><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:msub><mml:mrow><mml:mi>X</mml:mi></mml:mrow><mml:mrow><mml:mn>3</mml:mn></mml:mrow></mml:msub></mml:mrow></mml:mfrac><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mn>1</mml:mn><mml:mo>.</mml:mo><mml:mn>2</mml:mn></mml:mrow><mml:mrow><mml:mn>10</mml:mn></mml:mrow></mml:mfrac><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mn>3</mml:mn></mml:mrow><mml:mrow><mml:mn>25</mml:mn></mml:mrow></mml:mfrac></mml:math></inline-formula>. Thus, <inline-formula><mml:math id="M3"><mml:mo stretchy="true">&#x02211;</mml:mo><mml:mfrac><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:msub><mml:mrow><mml:mi>X</mml:mi></mml:mrow><mml:mrow><mml:mi>i</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:mfrac><mml:mo>=</mml:mo><mml:mfrac><mml:mrow><mml:mn>3</mml:mn></mml:mrow><mml:mrow><mml:mn>10</mml:mn></mml:mrow></mml:mfrac></mml:math></inline-formula>, substituting into formula yields:<italic>M</italic><sub><italic>N</italic></sub> &#x0003D; 10<italic>s</italic>&#x0201D;). As for PA with KR condition, PA only stated the correctness of the answer (e.g., &#x0201C;the answer is correct&#x0201D; or &#x0201C;the answer is wrong&#x0201D;). All feedback provided by PA was in Chinese (cf. <xref ref-type="fig" rid="F2">Figure 2</xref>).</p>
<fig id="F2" position="float">
<label>Figure 2</label>
<caption><p>Examples for feedback presentation in the four conditions: <bold>(A)</bold> without emotional feedback &#x0002B; with knowledge of results; <bold>(B)</bold> with emotional feedback &#x0002B; with knowledge of results; <bold>(C)</bold> without emotional feedback &#x0002B; with elaborated feedback; <bold>(D)</bold> with emotional feedback &#x0002B; with elaborated feedback.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fpsyg-13-810194-g0002.tif"/>
</fig>
</sec>
<sec>
<title>Materials and Measures</title>
<sec>
<title>Learning Materials and Transfer Test</title>
<p>The learning materials and transfer test in this study were adopted from a previous study of Wang et al. (<xref ref-type="bibr" rid="B65">2019</xref>), which covered psychological statistics knowledge, such as descriptive statistics, hypotheses testing, ANOVA, and probability distribution. Ten multiple-choice items were contained in the learning materials and transfer test, respectively. Each item in initial learning had a homogeneous item in the transfer test. The difficulty coefficient of items ranged from 0.4 to 0.6.</p>
</sec>
<sec>
<title>Manipulation Check on Emotional Feedback</title>
<p>Manipulation check was conducted to ensure that the manipulation of emotional feedback was effective. Participants completed a 5-point item &#x0201C;PA understood my emotions and provided support for me&#x0201D; ranging from 1 (strongly disagree) to 5 (strongly agree) (Guo and Goh, <xref ref-type="bibr" rid="B21">2016</xref>).</p>
</sec>
<sec>
<title>Emotions</title>
<p>Three negative emotions (confusion, boredom, and frustration) and two positive emotions (enjoyment and satisfaction), which are mostly experienced during learning (D&#x00027;Mello and Graesser, <xref ref-type="bibr" rid="B12">2012</xref>; D&#x00027;Mello, <xref ref-type="bibr" rid="B11">2013</xref>) were measured in this study. During learning, participants reported their emotions by clicking one of the five emotion buttons after answering each item. Immediately, PA presented emotional feedback based on these self-reported emotions. Before learning, participants reported their emotions in psychological statistics classes (M&#x000FC;nchow and Bannert, <xref ref-type="bibr" rid="B42">2019</xref>). Post-test emotion questionnaire was used to measure participants&#x00027; overall emotional states during learning. Participants rated 5 items (confusion, boredom, frustration, enjoyment, and satisfaction) on a 5-point scale ranging from 1 (not at all) to 5 (extremely strong) in a pre-test and post-test emotion questionnaire.</p>
</sec>
<sec>
<title>Intrinsic Motivation</title>
<p>Intrinsic motivation was measured with a 11-item scale questionnaire adapted from Instructional Materials Motivation Scale (Keller, <xref ref-type="bibr" rid="B26">1983</xref>) (e.g., &#x0201C;I like using this system to learn&#x0201D;). Participants rated items on a scale of 1 (strongly disagree) to 5 (strongly agree). Cronbach&#x00027;s alpha for the scale in this study was 0.87.</p>
</sec>
<sec>
<title>Agent Perception</title>
<p>Participants&#x00027; agent perception was measured with the Agent Persona Instrument developed by Ryu and Baylor (<xref ref-type="bibr" rid="B52">2003</xref>). The scale consisted of 20 items, including four dimensions: facilitating learning (10 items) (e.g., &#x0201C;Agent focused me on the relevant information&#x0201D;), credible (5 items) (e.g., &#x0201C;Agent was knowledgeable&#x0201D;), human-like (5 items) (e.g., &#x0201C;Agent was human-like&#x0201D;), and engaging (5 items) (e.g., &#x0201C;Agent was friendly&#x0201D;). All items were translated into Chinese and then back-translated to ensure equivalent meaning and double-checked by a psychological professor. Items were rated on a scale from 1 (strongly disagree) to 5 (strongly agree). Cronbach&#x00027;s alpha of the four dimensions and combined scale were 0.81, 0.71, 0.76, 0.85, and 0.90, respectively.</p>
</sec>
<sec>
<title>Cognitive Load</title>
<p>Perceived learning system availability, task difficulty, and mental effort were used to assess participants&#x00027; extraneous cognitive load, intrinsic cognitive load, and germane cognitive load, respectively (Paas et al., <xref ref-type="bibr" rid="B45">1994</xref>; Gerjets et al., <xref ref-type="bibr" rid="B18">2009</xref>). Participants rated how convenient to work with the learning system ranging from 1 (extremely convenient) to 9 (extremely inconvenient), how difficult to learn psychological statistics a moment ago ranging from 1 (extremely easy) to 9 (extremely difficult), and how much effort exerted in learning ranging from 1 (extremely low) to 9 (extremely high).</p>
</sec>
</sec>
<sec>
<title>Procedures</title>
<p>The learning environment was programmed with Scala &#x0002B; Java mixed language on JVM platform, which supported the following three phases of this experiment. In the preparation phase, after completing informed consent, participants were randomly assigned to one of four conditions. Then, participants inputted demographic information and completed the emotion questionnaire. Before starting learning, participants were given two irrelevant exercises to become familiarized with the learning system. During the learning phase, after each item, participants were required to report their emotional state at that time by choosing one from five buttons representing confusion, boredom, frustration, enjoyment, and satisfaction. Immediately, PA presented emotional feedback through facial expressions and text feedback according to emotions reported by participants. The learning task lasted for 15&#x02013;20 min. In the post-test phase, participants completed the emotion questionnaire, manipulation check, questionnaires on agent perception, intrinsic motivation, cognitive load, and transfer test in sequence. The experiment lasted &#x0007E;30 min.</p>
</sec>
<sec>
<title>Research Design</title>
<p>This study employed a 2 &#x000D7;2 between-subjects design, in which independent variables included PA&#x00027;s emotional feedback (with vs. without) and elaborated feedback (elaborated feedback vs. KR). The dependent variables were emotions, intrinsic motivation, agent perception, cognitive load, and transfer performance.</p>
</sec>
</sec>
<sec sec-type="results" id="s3">
<title>Results</title>
<p>SPSS 24.0 was used to perform the two-way multivariate analysis of covariance (MANCOVA) for emotions, prior knowledge, manipulation check, intrinsic motivation, agent perception, cognitive load, and transfer performance. Scores in the learning phase (a measure of prior knowledge) and five pretest emotions were included as covariates for manipulation check, post-test emotions, intrinsic motivation, agent perception, cognitive load, and transfer performance. The result of means and standard deviations of all variables was shown in <xref ref-type="table" rid="T3">Table 3</xref>.</p>
<table-wrap position="float" id="T3">
<label>Table 3</label>
<caption><p>Means and standard deviations of all variables.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th/>
<th valign="top" align="center" style="border-bottom: thin solid #000000;" colspan="2"><bold>PA with emotional feedback (</bold><italic><bold>M</bold> <bold>&#x000B1;SD</bold></italic><bold>)</bold></th>
<th valign="top" align="center" style="border-bottom: thin solid #000000;" colspan="2"><bold>PA without emotional feedback (</bold><italic><bold>M</bold> <bold>&#x000B1;SD</bold></italic><bold>)</bold></th>
</tr>
<tr>
<th/>
<th valign="top" align="center"><bold>PA with KR</bold></th>
<th valign="top" align="center"><bold>PA with elaborated feedback</bold></th>
<th valign="top" align="center"><bold>PA with KR</bold></th>
<th valign="top" align="center"><bold>PA with elaborated feedback</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Pretest confusion</td>
<td valign="top" align="center">4.30 &#x000B1; 0.99</td>
<td valign="top" align="center">4.45 &#x000B1; 1.02</td>
<td valign="top" align="center">4.07 &#x000B1; 0.92</td>
<td valign="top" align="center">4.55 &#x000B1; 1.02</td>
</tr>
<tr>
<td valign="top" align="left">Pretest boredom</td>
<td valign="top" align="center">3.37 &#x000B1; 0.96</td>
<td valign="top" align="center">3.31 &#x000B1; 0.89</td>
<td valign="top" align="center">3.17 &#x000B1; 0.85</td>
<td valign="top" align="center">3.45 &#x000B1; 0.87</td>
</tr>
<tr>
<td valign="top" align="left">Pretest frustration</td>
<td valign="top" align="center">3.43 &#x000B1; 0.90</td>
<td valign="top" align="center">3.62 &#x000B1; 0.94</td>
<td valign="top" align="center">3.07 &#x000B1; 0.84</td>
<td valign="top" align="center">3.59 &#x000B1; 1.09</td>
</tr>
<tr>
<td valign="top" align="left">Pretest enjoyment</td>
<td valign="top" align="center">3.83 &#x000B1; 1.02</td>
<td valign="top" align="center">3.83 &#x000B1; 0.66</td>
<td valign="top" align="center">4.28 &#x000B1; 0.84</td>
<td valign="top" align="center">3.86 &#x000B1; 0.92</td>
</tr>
<tr>
<td valign="top" align="left">Pretest satisfaction</td>
<td valign="top" align="center">3.93 &#x000B1; 1.05</td>
<td valign="top" align="center">3.83 &#x000B1; 0.89</td>
<td valign="top" align="center">4.21 &#x000B1; 0.86</td>
<td valign="top" align="center">4.14 &#x000B1; 1.13</td>
</tr>
<tr>
<td valign="top" align="left">Prior knowledge</td>
<td valign="top" align="center">4.40 &#x000B1; 1.87</td>
<td valign="top" align="center">3.38 &#x000B1; 1.70</td>
<td valign="top" align="center">4.52 &#x000B1; 2.01</td>
<td valign="top" align="center">3.41 &#x000B1; 1.66</td>
</tr>
<tr>
<td valign="top" align="left">Manipulation check</td>
<td valign="top" align="center">4.37 &#x000B1; 1.10</td>
<td valign="top" align="center">4.28 &#x000B1; 1.03</td>
<td valign="top" align="center">3.17 &#x000B1; 0.76</td>
<td valign="top" align="center">3.79 &#x000B1; 1.26</td>
</tr>
<tr>
<td valign="top" align="left">Posttest confusion</td>
<td valign="top" align="center">4.57 &#x000B1; 1.10</td>
<td valign="top" align="center">4.79 &#x000B1; 1.15</td>
<td valign="top" align="center">5.07 &#x000B1; 0.53</td>
<td valign="top" align="center">5.14 &#x000B1; 0.79</td>
</tr>
<tr>
<td valign="top" align="left">Posttest boredom</td>
<td valign="top" align="center">2.70 &#x000B1; 0.95</td>
<td valign="top" align="center">2.83 &#x000B1; 0.97</td>
<td valign="top" align="center">3.00 &#x000B1; 0.96</td>
<td valign="top" align="center">2.90 &#x000B1; 1.11</td>
</tr>
<tr>
<td valign="top" align="left">Posttest frustration</td>
<td valign="top" align="center">4.13 &#x000B1; 1.20</td>
<td valign="top" align="center">4.48 &#x000B1; 1.21</td>
<td valign="top" align="center">4.59 &#x000B1; 1.02</td>
<td valign="top" align="center">4.66 &#x000B1; 1.17</td>
</tr>
<tr>
<td valign="top" align="left">Posttest enjoyment</td>
<td valign="top" align="center">3.53 &#x000B1; 0.97</td>
<td valign="top" align="center">3.14 &#x000B1; 0.95</td>
<td valign="top" align="center">3.24 &#x000B1; 0.91</td>
<td valign="top" align="center">3.31 &#x000B1; 1.04</td>
</tr>
<tr>
<td valign="top" align="left">Posttest satisfaction</td>
<td valign="top" align="center">3.23 &#x000B1; 1.01</td>
<td valign="top" align="center">3.14 &#x000B1; 1.13</td>
<td valign="top" align="center">3.14 &#x000B1; 0.92</td>
<td valign="top" align="center">3.03 &#x000B1; 0.98</td>
</tr>
<tr>
<td valign="top" align="left">Intrinsic motivation</td>
<td valign="top" align="center">4.00 &#x000B1; 0.60</td>
<td valign="top" align="center">4.29 &#x000B1; 0.59</td>
<td valign="top" align="center">3.79 &#x000B1; 0.60</td>
<td valign="top" align="center">4.16 &#x000B1; 0.72</td>
</tr>
<tr>
<td valign="top" align="left">Agent perception</td>
<td valign="top" align="center">3.91 &#x000B1; 0.64</td>
<td valign="top" align="center">4.24 &#x000B1; 0.51</td>
<td valign="top" align="center">3.72 &#x000B1; 0.54</td>
<td valign="top" align="center">3.96 &#x000B1; 0.55</td>
</tr>
<tr>
<td valign="top" align="left">Extraneous cognitive load</td>
<td valign="top" align="center">5.57 &#x000B1; 2.01</td>
<td valign="top" align="center">5.14 &#x000B1; 1.96</td>
<td valign="top" align="center">5.24 &#x000B1; 1.79</td>
<td valign="top" align="center">5.21 &#x000B1; 2.35</td>
</tr>
<tr>
<td valign="top" align="left">Intrinsic cognitive load</td>
<td valign="top" align="center">7.13 &#x000B1; 1.14</td>
<td valign="top" align="center">7.07 &#x000B1; 1.28</td>
<td valign="top" align="center">6.93 &#x000B1; 1.69</td>
<td valign="top" align="center">7.07 &#x000B1; 1.96</td>
</tr>
<tr>
<td valign="top" align="left">Germane cognitive load</td>
<td valign="top" align="center">7.63 &#x000B1; 1.10</td>
<td valign="top" align="center">7.14 &#x000B1; 1.64</td>
<td valign="top" align="center">7.86 &#x000B1; 1.06</td>
<td valign="top" align="center">7.28 &#x000B1; 1.71</td>
</tr>
<tr>
<td valign="top" align="left">Transfer performance</td>
<td valign="top" align="center">5.53 &#x000B1; 1.96</td>
<td valign="top" align="center">7.24 &#x000B1; 2.13</td>
<td valign="top" align="center">6.14 &#x000B1; 2.26</td>
<td valign="top" align="center">7.41 &#x000B1; 2.06</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p><italic>PA, pedagogical agent; KR, knowledge of results</italic>.</p>
</table-wrap-foot>
</table-wrap>
<sec>
<title>Manipulation Check</title>
<p>MANCOVA revealed that there was a significant difference on the manipulation of emotional feedback [<italic>F</italic><sub>(1, 107)</sub> = 16.76, <italic>p</italic> &#x0003C; 0.001, &#x003B7;<sub>p</sub> <sup>2</sup> = 0.135]. Participants reported that PA with emotional feedback identified their emotions better and provided more support for them than neutral PA. There was no significant main effect of cognitive feedback [<italic>F</italic><sub>(1, 107)</sub> = 1.495, <italic>p</italic> = 0.22, &#x003B7;<sub>p</sub> <sup>2</sup>= 0.014] or interaction [<italic>F</italic><sub>(1, 107)</sub> = 2.89, <italic>p</italic> = 0.09, <inline-formula><mml:math id="M4"><mml:msubsup><mml:mrow><mml:mtext>&#x003B7;</mml:mtext></mml:mrow><mml:mrow><mml:mtext>p</mml:mtext></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup></mml:math></inline-formula> = 0.026].</p>
</sec>
<sec>
<title>Post-test Emotions</title>
<p>Significant main effect was only found for emotional feedback on confusion. It could be shown that PA performing emotional feedback led to less confusion than neutral PA [<italic>F</italic><sub>(1, 107)</sub> = 6.66, <italic>p</italic> = 0.01, <inline-formula><mml:math id="M5"><mml:msubsup><mml:mrow><mml:mtext>&#x003B7;</mml:mtext></mml:mrow><mml:mrow><mml:mtext>p</mml:mtext></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup></mml:math></inline-formula> = 0.059]. However, the main effects of emotional feedback on boredom [<italic>F</italic><sub>(1, 107)</sub> = 1.28 <italic>p</italic> = 0.26, <inline-formula><mml:math id="M6"><mml:msubsup><mml:mrow><mml:mtext>&#x003B7;</mml:mtext></mml:mrow><mml:mrow><mml:mtext>p</mml:mtext></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup></mml:math></inline-formula> = 0.012], frustration [<italic>F</italic><sub>(1, 107)</sub> = 3.27, <italic>p</italic> = 0.08, <inline-formula><mml:math id="M7"><mml:msubsup><mml:mrow><mml:mtext>&#x003B7;</mml:mtext></mml:mrow><mml:mrow><mml:mtext>p</mml:mtext></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup></mml:math></inline-formula> = 0.030], enjoyment [<italic>F</italic><sub>(1, 107)</sub> =1.15, <italic>p</italic> = 0.29, <inline-formula><mml:math id="M8"><mml:msubsup><mml:mrow><mml:mtext>&#x003B7;</mml:mtext></mml:mrow><mml:mrow><mml:mtext>p</mml:mtext></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup></mml:math></inline-formula> = 0.011], and satisfaction [<italic>F</italic><sub>(1, 107)</sub> = 1.77, <italic>p</italic> = 0.19, <inline-formula><mml:math id="M9"><mml:msubsup><mml:mrow><mml:mtext>&#x003B7;</mml:mtext></mml:mrow><mml:mrow><mml:mtext>p</mml:mtext></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup></mml:math></inline-formula> = 0.016] were not significant. The main effects of elaborated feedback on emotions [confusion <italic>F</italic><sub>(1, 107)</sub> &#x0003C; 1; boredom <italic>F</italic><sub>(1, 107)</sub> &#x0003C; 1; frustration <italic>F</italic><sub>(1, 107)</sub> &#x0003C; 1; enjoyment <italic>F</italic><sub>(1, 107)</sub> &#x0003C; 1; satisfaction <italic>F</italic><sub>(1, 107)</sub> &#x0003C; 1] and interactions between emotional feedback and elaborated feedback on emotions [confusion <italic>F</italic><sub>(1, 107)</sub> &#x0003C; 1; boredom <italic>F</italic><sub>(1, 107)</sub> &#x0003C; 1; frustration <italic>F</italic><sub>(1, 107)</sub> = 1.03, <italic>p</italic> = 0.31, <inline-formula><mml:math id="M10"><mml:msubsup><mml:mrow><mml:mtext>&#x003B7;</mml:mtext></mml:mrow><mml:mrow><mml:mtext>p</mml:mtext></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup></mml:math></inline-formula> = 0.010; enjoyment <italic>F</italic><sub>(1, 107)</sub> = 1.77, <italic>p</italic> = 0.19, <inline-formula><mml:math id="M11"><mml:msubsup><mml:mrow><mml:mtext>&#x003B7;</mml:mtext></mml:mrow><mml:mrow><mml:mtext>p</mml:mtext></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup></mml:math></inline-formula> = 0.016; satisfaction <italic>F</italic><sub>(1, 107)</sub> &#x0003C; 1] were not significant.</p>
</sec>
<sec>
<title>Intrinsic Motivation</title>
<p>MANCOVA found significant main effects of emotional feedback and elaborated feedback on intrinsic motivation. Compared with the neutral PA, PA with emotional feedback led to higher intrinsic motivation (marginally significant) [<italic>F</italic><sub>(1, 107)</sub> = 3.72, <italic>p</italic> = 0.06, <inline-formula><mml:math id="M12"><mml:msubsup><mml:mrow><mml:mtext>&#x003B7;</mml:mtext></mml:mrow><mml:mrow><mml:mtext>p</mml:mtext></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup></mml:math></inline-formula> = 0.034]. In a similar way, PA with elaborated feedback resulted in stronger intrinsic motivation than PA with knowledge of results (KR) [<italic>F</italic><sub>(1, 107)</sub> = 14.76, <italic>p</italic> &#x0003C; 0.001, <inline-formula><mml:math id="M13"><mml:msubsup><mml:mrow><mml:mtext>&#x003B7;</mml:mtext></mml:mrow><mml:mrow><mml:mtext>p</mml:mtext></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup></mml:math></inline-formula> = 0.121]. However, the interaction failed to reach significance [<italic>F</italic><sub>(1, 107)</sub> &#x0003C; 1].</p>
</sec>
<sec>
<title>Agent Perception</title>
<p>Significant main effects were found on agent perception in MANCOVA for both emotional feedback and elaborated feedback. The PA with emotional feedback group perceived PA better than the neutral PA group [<italic>F</italic><sub>(1, 107)</sub> = 4.58, <italic>p</italic> = 0.04, <inline-formula><mml:math id="M14"><mml:msubsup><mml:mrow><mml:mtext>&#x003B7;</mml:mtext></mml:mrow><mml:mrow><mml:mtext>p</mml:mtext></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup></mml:math></inline-formula> = 0.041]. The same main effect occurred when PA provided an elaborated feedback while showing cognitive feedback [<italic>F</italic><sub>(1, 107)</sub> = 5.22, <italic>p</italic> = 0.02, <inline-formula><mml:math id="M15"><mml:msubsup><mml:mrow><mml:mtext>&#x003B7;</mml:mtext></mml:mrow><mml:mrow><mml:mtext>p</mml:mtext></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup></mml:math></inline-formula> = 0.046]. The interaction between these two factors was not significant [<italic>F</italic><sub>(1, 107)</sub> &#x0003C; 1].</p>
</sec>
<sec>
<title>Cognitive Load</title>
<p>Only the main effect of elaborated feedback on germane cognitive load was revealed, indicating that learners reported lower germane cognitive load when they received elaborated feedback from PA [<italic>F</italic><sub>(1, 107)</sub> = 3.87, <italic>p</italic> = 0.05, <inline-formula><mml:math id="M16"><mml:msubsup><mml:mrow><mml:mtext>&#x003B7;</mml:mtext></mml:mrow><mml:mrow><mml:mtext>p</mml:mtext></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup></mml:math></inline-formula> = 0.035], but emotional feedback had no significant main effect on germane cognitive load [<italic>F</italic><sub>(1, 107)</sub> &#x0003C; 1]. In terms of extraneous cognitive load and intrinsic cognitive load, main effects of neither emotional feedback [extraneous cognitive load <italic>F</italic><sub>(1, 107)</sub> &#x0003C; 1; intrinsic cognitive load <italic>F</italic><sub>(1, 107)</sub> &#x0003C; 1] nor elaborated feedback [extraneous cognitive load <italic>F</italic><sub>(1, 107)</sub> &#x0003C; 1; intrinsic cognitive load <italic>F</italic><sub>(1, 107)</sub> = 2.65, <italic>p</italic> = 0.11, <inline-formula><mml:math id="M17"><mml:msubsup><mml:mrow><mml:mtext>&#x003B7;</mml:mtext></mml:mrow><mml:mrow><mml:mtext>p</mml:mtext></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup></mml:math></inline-formula> = 0.024] reached significance. Moreover, the interaction failed to reach significance [extraneous cognitive load <italic>F</italic><sub>(1, 107)</sub> &#x0003C; 1; intrinsic cognitive load <italic>F</italic><sub>(1, 107)</sub> &#x0003C; 1; germane cognitive load <italic>F</italic><sub>(1, 107)</sub> &#x0003C; 1].</p>
</sec>
<sec>
<title>Transfer Performance</title>
<p>For transfer performance, MANCOVA only found a significant main effect of elaborated feedback. On Comparing PA with the KR group, learners in PA with an elaborated feedback condition performed better in transfer performance [<italic>F</italic> <sub>(1, 107)</sub> = 34.79, <italic>p</italic> &#x0003C; 0.001, <inline-formula><mml:math id="M18"><mml:msubsup><mml:mrow><mml:mtext>&#x003B7;</mml:mtext></mml:mrow><mml:mrow><mml:mtext>p</mml:mtext></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup></mml:math></inline-formula> = 0.046]. Learners who received emotional feedback from PA performed similarly to those studying with neutral PA in transfer test [<italic>F</italic><sub>(1, 107)</sub> = 1.38, <italic>p</italic> = 0.24, <inline-formula><mml:math id="M19"><mml:msubsup><mml:mrow><mml:mtext>&#x003B7;</mml:mtext></mml:mrow><mml:mrow><mml:mtext>p</mml:mtext></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msubsup></mml:math></inline-formula> = 0.013], and the interaction between emotional feedback and elaborated feedback was not significant [<italic>F</italic><sub>(1, 107)</sub> &#x0003C; 1].</p>
</sec>
</sec>
<sec sec-type="discussion" id="s4">
<title>Discussion</title>
<sec>
<title>The Role of PA&#x00027;s Emotional Feedback in Learning</title>
<p>The present study found that PA&#x00027;s emotional feedback affected learning processes, such as emotions, motivation, and agent perception, whereas it had no significant effect on cognitive load or transfer performance.</p>
<p>Firstly, PA&#x00027;s emotional feedback reduced learners&#x00027; confusion, which was in line with past studies (Klein et al., <xref ref-type="bibr" rid="B29">2002</xref>; Prendinger et al., <xref ref-type="bibr" rid="B51">2003</xref>; Hone, <xref ref-type="bibr" rid="B24">2006</xref>; Shen, <xref ref-type="bibr" rid="B56">2009</xref>; Woolf et al., <xref ref-type="bibr" rid="B66">2010</xref>), whereas it did not increase positive emotions. H1a was partially supported. In line with Social Presence Theory, our results showed to some extent the beneficial nature of PA&#x00027;s emotional feedback in improving learners&#x00027; emotional experience by enhancing proximity between PA and learners. In the present study, learners made 1,170 emotional reports during the learning phase, including 45% confusion, 22% enjoyment, 14% satisfaction, 14% frustration, and 5% boredom. Confusion was most reported by learners, so emotional feedback that learner received mainly targeted to reduce confusion. Other emotions appeared too infrequent to be further affected by PA&#x00027;s emotional feedback.</p>
<p>Secondly, as expected in H1b and H1c, learners&#x00027; intrinsic motivation and agent perception were higher in PA with emotional feedback condition than in neutral PA condition. Consistent with Social Presence Theory and Social Agency Theory, PA&#x00027;s empathic behaviors created supportive atmosphere and minimized the communication barriers in human&#x02013;computer interaction (Lin et al., <xref ref-type="bibr" rid="B35">2013</xref>). As a result, learners perceived PA to be more intimate and were motivated to engage in learning (Guo and Goh, <xref ref-type="bibr" rid="B21">2016</xref>).</p>
<p>However, inconsistent with H1d and H1e, PA&#x00027;s emotional feedback influenced neither cognitive load nor transfer performance. According to previous studies, the lack of direct useful information for cognitive processing kept learners far from constructing knowledge (Kim et al., <xref ref-type="bibr" rid="B27">2007</xref>). PA&#x00027;s emotional feedback in this study only reproduced learners&#x00027; emotions and provided emotional support so that it regulated emotional or motivational factors rather than cognitive factors. The good news was that PA&#x00027;s emotional feedback did not increase extraneous cognitive load or hinder learning. That is, PA&#x00027;s emotional feedback did not occupy learners&#x00027; mental resources or act as distracting elements that drew learners&#x00027; attention away from the learning content.</p>
</sec>
<sec>
<title>The Role of PA&#x00027;s Elaborated Feedback in Learning</title>
<p>In terms of learning processes, our findings supported H2b and H2c, showing that elaborated feedback enhanced intrinsic motivation and positive agent perception. The Five-Stage Model of Computer-Based Formative Assessment suggests that learners adjust their motivational and cognitive states according to feedback received in a test-like task (Timmers et al., <xref ref-type="bibr" rid="B61">2015</xref>). Elaborated feedback contained more useful information that helped learners narrow the knowledge gap between the current state and the target state. From this, learners perceived PA as a facilitator for learning, believed that they had control over their own studying, and engaged themselves in learning tasks (Pekrun and Perry, <xref ref-type="bibr" rid="B48">2014</xref>; Wang et al., <xref ref-type="bibr" rid="B65">2019</xref>). These results also provided supportive evidence for ICALM, where cognitive factors and motivation interweave so that elaborated feedback can support cognitive processing and motivational adjustment. Nevertheless, elaborated feedback had no impact on learners&#x00027; post-test emotions, and H2a was not verified. An explanation might be that different attribution styles have opposite effects on emotions (Sixte et al., <xref ref-type="bibr" rid="B58">2020</xref>). For example, when receiving elaborated feedback for correcting a wrong answer, learners with internal attribution style experience negative emotions on account of attributing failures to insufficient capability. Conversely, learners with external style attribute failure to high difficulty, so they hold the view that elaborated feedback can help them learn new things better, thereby experiencing more positive emotions and less negative emotions. For this reason, we wonder if the valences of effects of attribution styles on emotions are converse so that the total effect is not significant. Future research can bring learners&#x00027; attribution style into consideration as a moderator. Besides, contrary to H2d, learners in PA with elaborated feedback group reported lower germane cognitive load compared to those in PA with KR group. It might be that since learners in PA with elaborated feedback condition were provided with detailed information for knowledge construction, they cut down on cognitive resources to process materials, i.e., they proactively reduced mental effort (Zhao, <xref ref-type="bibr" rid="B68">2014</xref>) so that germane cognitive load was decreased. Given that KR only contained information about whether the answer was correct, cognitive resources were still highly required when learners needed to invest mental effort a lot in analyzing errors and correcting misunderstandings (Johnson and Priest, <xref ref-type="bibr" rid="B25">2014</xref>). Although there was a significant difference between the two groups, the germane cognitive load of all learners was maintained at a high level (M &#x0003E; 7.28 on a 9-point scale).</p>
<p>As for learning performance, participants performed better in the transfer test when they received elaborated feedback than KR. The finding supported that H2e and was in line with previous studies (Lin et al., <xref ref-type="bibr" rid="B35">2013</xref>; Law and Chen, <xref ref-type="bibr" rid="B30">2016</xref>). In the present study, elaborated feedback not only verified whether the answer was correct, but also showed the correct answer, formula, and cues for the solution. Such cognitive information helped learners bridge the gap between old and new knowledge easier and promoted knowledge construction to the improve transfer performance (Gong et al., <xref ref-type="bibr" rid="B19">2019</xref>; Wang et al., <xref ref-type="bibr" rid="B65">2019</xref>).</p>
</sec>
<sec>
<title>The Mutual Effect of PA&#x00027;s Emotional Feedback and Elaborated Feedback</title>
<p>This study did not find any significant interaction between emotional feedback and elaborated feedback on learning processes or performance. As a result, H3 was not supported. No matter which kind of cognitive feedback learners received, emotional feedback could improve learners&#x00027; emotions and motivation. Containing detailed cognitive information, elaborated feedback successfully supported cognitive processing. Both emotional feedback and elaborated feedback provided means to activate learners&#x00027; intrinsic motivation and had their own distinctive advantages, so their effects may be relatively stable and could not substitute for each other.</p>
</sec>
<sec>
<title>Limitations and Future Directions</title>
<p>By exploring the impact of emotional feedback and elaborated feedback on multimedia learning, this study provided empirical evidence for Social Presence Theory, Social Agency Theory and ICALM. This study found that PA&#x00027;s emotional feedback facilitated learning processes, including better emotional experience, stronger intrinsic motivation, and enhanced agent perception; PA&#x00027;s elaborated feedback improved learning processes by affecting intrinsic motivation, agent perception, and finally improved transfer performance. What stands out in this study leads to strong recommendations for PA&#x00027;s emotional design and feedback optimization.</p>
<p>Three features of this work limited the conclusions we can draw about PA&#x00027;s emotional and elaborated feedback on multimedia learning.</p>
<p>First, PA&#x00027;s emotional feedback was not diverse enough to fully improve emotions, where emotional feedback reduced confusion but did neither reduce other negative emotions nor increase positive emotions. In this study, confusion was mostly triggered by moderately difficult tasks, and it was easiest to be affected by emotional feedback than other emotions. Nevertheless, a textual library is needed to present more personalized feedback for better experience in future studies, in which emotional feedback can be customized on learners&#x00027; characteristics, current emotional states, and task performance. Besides, according to the modality principle for managing essential processing in multimedia learning (Castro-Alonso and Sweller, <xref ref-type="bibr" rid="B7">2021</xref>), emotional feedback can be delivered by both auditory and visual channels (e.g., voice and facial expressions) to reduce the redundancy effect as much as possible in future studies.</p>
<p>Second, self-report of emotions after each item may interrupt learning. In spite of accurate identification of emotions, self-report in learning sessions scattered cognitive resources into cognitive processing of core materials and emotional awareness. Future studies can introduce artificial intelligence technology, biofeedback technology, and observation method to automate the identification of emotions. In addition, we only used self-report measures to assess learning processes. To gain more objective evidence and holistic understanding, future work should use multimodal data (the fusion of information extracted from multiple data sources, such as eye-tracking, EEG, facial data streams, physiological indexes, etc.). For example, data sources from self-report-scale and eye-tracking during learners&#x00027; interaction with a learning system can be integrated and used to measure cognitive load (Sharma et al., <xref ref-type="bibr" rid="B55">2022</xref>).</p>
<p>Third, this study was conducted with learning materials on undergraduate psychological statistics. Therefore, conclusions should be treated with prudence when generalized to other groups or courses. It will be worthwhile to repeat the experiment with learners from different grades and diverse learning materials, as well as explore whether learners&#x00027; characteristics moderate the effects of feedback on learning processes and performance.</p>
</sec>
</sec>
<sec sec-type="conclusions" id="s5">
<title>Conclusions</title>
<p>This study examined the impact of PA&#x00027;s emotional feedback and elaborated feedback on learning. Results showed that emotional feedback decreased confusion, triggered intrinsic motivation, and enhanced agent perception, but had no impact on cognitive variables such as cognitive load and learning performance. Elaborated feedback improved intrinsic motivation, agent perception, and transfer performance but reduced germane cognitive load compared to KR. This study confirms that either emotional feedback or elaborated feedback has an essential function in multimedia learning.</p>
</sec>
<sec sec-type="data-availability" id="s6">
<title>Data Availability Statement</title>
<p>The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.</p>
</sec>
<sec id="s7">
<title>Ethics Statement</title>
<p>Ethical review and approval was not required for the study on human participants in accordance with the local legislation and institutional requirements. The patients/participants provided their written informed consent to participate in this study.</p>
</sec>
<sec id="s8">
<title>Author Contributions</title>
<p>YL contributed to data collection, data analysis, and paper writing. KX contributed to experimental design and data collection. SG contributed to experimental design and paper writing. YW and YC contributed to paper writing. All authors contributed to the article and approved the submitted version.</p>
</sec>
<sec sec-type="funding-information" id="s9">
<title>Funding</title>
<p>This study was supported by National Natural Science Foundation of China (Grant Number: 61877025) and Open Research Grant from Key Laboratory of Adolescent Cyberpsychology and Behavior (CCNU), Ministry of Education/ Hubei Key Laboratory of Human Development and Mental Health (CCNU) (Grant Number: 2019B04).</p>
</sec>
<sec sec-type="COI-statement" id="conf1">
<title>Conflict of Interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="s10">
<title>Publisher&#x00027;s Note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
</body>
<back>
<ack><p>Special thank to the National Experimental Teaching Demonstration Center of Psychology (CCNU) for supporting this work.</p>
</ack>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Arroyo</surname> <given-names>I.</given-names></name> <name><surname>Woolf</surname> <given-names>B. P.</given-names></name> <name><surname>Cooper</surname> <given-names>D. G.</given-names></name> <name><surname>Burleson</surname> <given-names>W.</given-names></name> <name><surname>Muldner</surname> <given-names>K.</given-names></name></person-group> (<year>2011</year>). <article-title>The impact of animated pedagogical agents on girls&#x00027; and boys&#x00027; emotions, attitudes, behaviors and learning</article-title>. In: <italic>2011 IEEE 11th International Conference on Advanced Learning Technologies</italic>. Athens, GA, USA: IEEE, p. 506&#x02013;510. <pub-id pub-id-type="doi">10.1109/ICALT.2011.157</pub-id></citation>
</ref>
<ref id="B2">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Arroyo</surname> <given-names>I.</given-names></name> <name><surname>Woolf</surname> <given-names>B. P.</given-names></name> <name><surname>Royer</surname> <given-names>J. M.</given-names></name> <name><surname>Tai</surname> <given-names>M.</given-names></name></person-group> (<year>2009</year>). <article-title>&#x0201C;Affective gendered learning companions,&#x0201D;</article-title> in <source>International Conference on Artificial Intelligence in Education: Building Learning Systems That Care: From Knowledge Representation to Affective Modelling</source> (<publisher-loc>DBLP</publisher-loc>).<pub-id pub-id-type="pmid">23249410</pub-id></citation></ref>
<ref id="B3">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Atkinson</surname> <given-names>R. K.</given-names></name> <name><surname>Mayer</surname> <given-names>R. E.</given-names></name> <name><surname>Merrill</surname> <given-names>M. M.</given-names></name></person-group> (<year>2005</year>). <article-title>Fostering social agency in multimedia learning: Examining the impact of an animated agent&#x00027;s voice</article-title>. <source>Contemp. Educ. Psychol.</source> <volume>30</volume>, <fpage>117</fpage>&#x02013;<lpage>139</lpage>. <pub-id pub-id-type="doi">10.1016/j.cedpsych.2004.07.001</pub-id></citation>
</ref>
<ref id="B4">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Burleson</surname> <given-names>W.</given-names></name></person-group> (<year>2013</year>). <article-title>Affective learning companions and the adoption of metacognitive strategies</article-title>. <source>International Handbook of Metacognition and Learning Technologies.</source> <volume>28</volume>, <fpage>645</fpage>&#x02013;<lpage>657</lpage>. <pub-id pub-id-type="doi">10.1007/978-1-4419-5546-3_42</pub-id></citation>
</ref>
<ref id="B5">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Burleson</surname> <given-names>W.</given-names></name> <name><surname>Picard</surname> <given-names>R. W.</given-names></name></person-group> (<year>2007</year>). <article-title>Gender-specific approaches to developing emotionally intelligent learning companions</article-title>. <source>IEEE Intell. Syst.</source> <volume>22</volume>, <fpage>62</fpage>&#x02013;<lpage>69</lpage>. <pub-id pub-id-type="doi">10.1109/MIS.2007.69</pub-id></citation>
</ref>
<ref id="B6">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cabestrero</surname> <given-names>R.</given-names></name> <name><surname>Quir&#x000F3;s</surname> <given-names>P.</given-names></name> <name><surname>Santos</surname> <given-names>O. C.</given-names></name> <name><surname>Salmeron-Majadas</surname> <given-names>S.</given-names></name> <name><surname>Uria-Rivas</surname> <given-names>R.</given-names></name> <name><surname>Boticario</surname> <given-names>J. G.</given-names></name> <etal/></person-group>. (<year>2018</year>). <article-title>Some insights into the impact of affective information when delivering feedback to students</article-title>. <source>Behav. Inf. Technol</source>. <volume>37</volume>, <fpage>1252</fpage>&#x02013;<lpage>1263</lpage>. <pub-id pub-id-type="doi">10.1080/0144929X.2018.1499803</pub-id></citation>
</ref>
<ref id="B7">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Castro-Alonso</surname> <given-names>J. C.</given-names></name> <name><surname>Sweller</surname> <given-names>J.</given-names></name></person-group> (<year>2021</year>). <article-title>&#x0201C;The modality principle in multimedia learning.&#x0201D;</article-title> in <source>The Cambridge Handbook of Multimedia Learning</source>, Eds. R. E. Mayer (<publisher-loc>Cambridge</publisher-loc>: <publisher-name>Cambridge University Press</publisher-name>), <fpage>261</fpage>&#x02013;<lpage>267</lpage>. <pub-id pub-id-type="doi">10.1017/9781108894333.026</pub-id></citation>
</ref>
<ref id="B8">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Castro-Alonso</surname> <given-names>J. C.</given-names></name> <name><surname>Wong</surname> <given-names>R. M.</given-names></name> <name><surname>Adesope</surname> <given-names>O. O.</given-names></name> <name><surname>Paas</surname> <given-names>F.</given-names></name></person-group> (<year>2021</year>). <article-title>Effectiveness of multimedia pedagogical agents predicted by diverse theories: a meta-analysis</article-title>. <source>Educ. Psychol. Rev</source>. 33, 1&#x02212;27. <pub-id pub-id-type="doi">10.1007/s10648-020-09587-1</pub-id></citation>
</ref>
<ref id="B9">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Chen</surname> <given-names>G. D.</given-names></name> <name><surname>Lee</surname> <given-names>J. H.</given-names></name> <name><surname>Wang</surname> <given-names>C. Y.</given-names></name> <name><surname>Chao</surname> <given-names>P. Y.</given-names></name> <name><surname>Li</surname> <given-names>L. Y.</given-names></name> <name><surname>Lee</surname> <given-names>T. Y.</given-names></name></person-group> (<year>2012</year>). <article-title>An empathic avatar in a computer-aided learning program to encourage and persuade learners</article-title>. <source>J. Educ. Techno. Soc.</source> <volume>15</volume>, <fpage>62</fpage>&#x02013;<lpage>72</lpage>. Available online at: <ext-link ext-link-type="uri" xlink:href="http://www.jstor.org/stable/jeductechsoci.15.2.62">http://www.jstor.org/stable/jeductechsoci.15.2.62</ext-link></citation>
</ref>
<ref id="B10">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dennis</surname> <given-names>M.</given-names></name> <name><surname>Masthoff</surname> <given-names>J.</given-names></name> <name><surname>Mellish</surname> <given-names>C.</given-names></name></person-group> (<year>2015</year>). <article-title>Adapting progress feedback and emotional support to learner personality</article-title>. <source>Int J Artif Intell Educ.</source> <volume>26</volume>, <fpage>1</fpage>&#x02013;<lpage>47</lpage>. <pub-id pub-id-type="doi">10.1007/s40593-015-0059-7</pub-id></citation>
</ref>
<ref id="B11">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>D&#x00027;Mello</surname> <given-names>S.</given-names></name></person-group> (<year>2013</year>). <article-title>A selective meta-analysis on the relative incidence of discrete affective states during learning with technology</article-title>. <source>J. Educ. Psychol.</source> <volume>105</volume>:<fpage>1082</fpage>. <pub-id pub-id-type="doi">10.1037/a0032674</pub-id></citation>
</ref>
<ref id="B12">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>D&#x00027;Mello</surname> <given-names>S.</given-names></name> <name><surname>Graesser</surname> <given-names>A.</given-names></name></person-group> (<year>2012</year>). <article-title>Dynamics of affective states during complex learning</article-title>. <source>Learn. Instr</source>. <volume>22</volume>, <fpage>145</fpage>&#x02013;<lpage>157</lpage>. <pub-id pub-id-type="doi">10.1016/j.learninstruc.2011.10.001</pub-id></citation>
</ref>
<ref id="B13">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Economides</surname> <given-names>A. A.</given-names></name></person-group> (<year>2005</year>). <article-title>Personalized feedback in CAT</article-title>. <source>WSEAS Transactions on Advances in Engineering Education.</source> <volume>2</volume>, <fpage>174</fpage>&#x02013;<lpage>181</lpage>. Available online at: <ext-link ext-link-type="uri" xlink:href="http://www.conta.uom.gr/conta/publications/PDF/Personalized%20Feedback%20in%20CAT.pdf">http://www.conta.uom.gr/conta/publications/PDF/Personalized%20Feedback%20in%20CAT.pdf</ext-link></citation>
</ref>
<ref id="B14">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Economides</surname> <given-names>A. A.</given-names></name></person-group> (<year>2006</year>). <article-title>Adaptive feedback characteristics in CAT (Computer Adaptive Testing). <italic>Int. J</italic></article-title>. <source>Distance Educ. Technol.</source> <volume>3</volume>, <fpage>15</fpage>&#x02013;<lpage>26</lpage>. Available online at: <ext-link ext-link-type="uri" xlink:href="https://www.researchgate.net/publication/292327682_Adaptive_feedback_characteristics_in_CAT_Computer_Adaptive_Testing">https://www.researchgate.net/publication/292327682_Adaptive_feedback_characteristics_in_CAT_Computer_Adaptive_Testing</ext-link></citation>
</ref>
<ref id="B15">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Economides</surname> <given-names>A. A.</given-names></name></person-group> (<year>2009</year>). <article-title>Conative feedback in computer-based assessment</article-title>. <source>Comput. Sch</source>. <volume>26</volume>, <fpage>207</fpage>&#x02013;<lpage>223</lpage>. <pub-id pub-id-type="doi">10.1080/07380560903095188</pub-id></citation>
</ref>
<ref id="B16">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Fiorella</surname> <given-names>L.</given-names></name> <name><surname>Mayer</surname> <given-names>R. E.</given-names></name></person-group> (<year>2021</year>). &#x0201C;Principles based on social cues in multimedia learning.&#x0201D; In: <italic>The Cambridge Handbook of Multimedia Learning</italic>, Ed. R. E. Mayer (<publisher-loc>Cambridge</publisher-loc>: <publisher-name>Cambridge University Press</publisher-name>), <fpage>277</fpage>&#x02013;<lpage>285</lpage>. <pub-id pub-id-type="doi">10.1017/9781108894333.029</pub-id></citation>
</ref>
<ref id="B17">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Frechette</surname> <given-names>C.</given-names></name> <name><surname>Moreno</surname> <given-names>R.</given-names></name></person-group> (<year>2010</year>). <article-title>The roles of animated pedagogical agents&#x00027; presence and nonverbal communication in multimedia learning environments</article-title>. <source>J. Media Psychol</source>. <volume>22</volume>, <fpage>61</fpage>&#x02013;<lpage>72</lpage>. <pub-id pub-id-type="doi">10.1027/1864-1105/a000009</pub-id></citation>
</ref>
<ref id="B18">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gerjets</surname> <given-names>P.</given-names></name> <name><surname>Scheiter</surname> <given-names>K.</given-names></name> <name><surname>Opfermann</surname> <given-names>M.</given-names></name> <name><surname>Hesse</surname> <given-names>F. W.</given-names></name> <name><surname>Eysink</surname> <given-names>T. H. S.</given-names></name></person-group> (<year>2009</year>). <article-title>Learning with hypermedia: the influence of representational formats and different levels of learner control on performance and learning behavior</article-title>. <source>Comput. Hum. Behav</source>. <volume>25</volume>, <fpage>360</fpage>&#x02013;<lpage>370</lpage>. <pub-id pub-id-type="doi">10.1016/j.chb.2008.12.015</pub-id></citation>
</ref>
<ref id="B19">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gong</surname> <given-names>S. Y.</given-names></name> <name><surname>Han</surname> <given-names>Y. S.</given-names></name> <name><surname>Wang</surname> <given-names>Z.</given-names></name> <name><surname>Xu</surname> <given-names>S.</given-names></name> <name><surname>Liu</surname> <given-names>X. X.</given-names></name></person-group> (<year>2019</year>). <article-title>Effects of complexity of computer-based feedback and prior knowledge on learning</article-title>. <source>Studies of Psychology and Behavior.</source> <volume>17</volume>, <fpage>765</fpage>&#x02013;<lpage>772</lpage>. <pub-id pub-id-type="doi">10.3969/j.issn.1672-0628.2019.06.007</pub-id></citation>
</ref>
<ref id="B20">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gunawardena</surname> <given-names>C. N.</given-names></name> <name><surname>Zittle</surname> <given-names>F. J.</given-names></name></person-group> (<year>1997</year>). <article-title>Social presence as a predictor of satisfaction within a computer-mediated conferencing environment</article-title>. <source>Am. J. Distance. Educ</source>. <volume>11</volume>, <fpage>8</fpage>&#x02013;<lpage>26</lpage>. <pub-id pub-id-type="doi">10.1080/08923649709526970</pub-id></citation>
</ref>
<ref id="B21">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Guo</surname> <given-names>Y. R.</given-names></name> <name><surname>Goh</surname> <given-names>D. H. L.</given-names></name></person-group> (<year>2016</year>). <article-title>Evaluation of affective embodied agents in an information literacy game</article-title>. <source>Comput. Educ.</source> <volume>103</volume>, <fpage>59</fpage>&#x02013;<lpage>75</lpage>. <pub-id pub-id-type="doi">10.1016/j.compedu.2016.09.013</pub-id></citation>
</ref>
<ref id="B22">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Guo</surname> <given-names>Y. R.</given-names></name> <name><surname>Goh</surname> <given-names>D. H. L.</given-names></name> <name><surname>Luyt</surname> <given-names>B.</given-names></name></person-group> (<year>2014</year>). <article-title>Using affective embodied agents in information literacy education</article-title>. In: <italic>IEEE/ACM Joint Conference on Digital Libraries</italic>. London, United Kingdom: <volume>IEEE</volume>, <fpage>389</fpage>&#x02013;<lpage>398</lpage>.</citation>
</ref>
<ref id="B23">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hattie</surname> <given-names>J.</given-names></name> <name><surname>Timperley</surname> <given-names>H.</given-names></name></person-group> (<year>2007</year>). <article-title>The power of feedback</article-title>. <source>Rev. Educ. Res</source>. <volume>77</volume>, <fpage>81</fpage>&#x02013;<lpage>112</lpage>. <pub-id pub-id-type="doi">10.3102/003465430298487</pub-id></citation>
</ref>
<ref id="B24">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hone</surname> <given-names>K.</given-names></name></person-group> (<year>2006</year>). <article-title>Empathic agents to reduce user frustration: The effects of varying agent characteristics</article-title>. <source>Interact. Comput</source>. <volume>18</volume>, <fpage>227</fpage>&#x02013;<lpage>245</lpage>. <pub-id pub-id-type="doi">10.1016/j.intcom.2005.05.003</pub-id></citation>
</ref>
<ref id="B25">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Johnson</surname> <given-names>C. I.</given-names></name> <name><surname>Priest</surname> <given-names>H. A.</given-names></name></person-group> (<year>2014</year>). <article-title>&#x0201C;The feedback principle in multimedia learning.&#x0201D;</article-title> in <source>Cambridge handbook of multimedia learning</source>, 2<sup>nd</sup> ed, Eds. R. E. Mayer (New York: Cambridge University Press), <fpage>449</fpage>&#x02013;<lpage>463</lpage>. <pub-id pub-id-type="doi">10.1017/CBO9781139547369.023</pub-id></citation>
</ref>
<ref id="B26">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Keller</surname> <given-names>J. M.</given-names></name></person-group> (<year>1983</year>). <article-title>&#x0201C;Motivational design of instruction,&#x0201D;</article-title> in <source>Instructional Design Theories and Models</source>, ed C. M. Riegeluth (Hillsdale, NJ: Lawrence Erlbaum), <fpage>386</fpage>&#x02013;<lpage>434</lpage>.</citation>
</ref>
<ref id="B27">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kim</surname> <given-names>Y.</given-names></name> <name><surname>Baylor</surname> <given-names>A. L.</given-names></name> <name><surname>Shen</surname> <given-names>E.</given-names></name></person-group> (<year>2007</year>). <article-title>Pedagogical agents as learning companions: the impact of agent emotion and gender: learning companions</article-title>. <source>J. Comput. Assist. Learn</source>. <volume>23</volume>, <fpage>220</fpage>&#x02013;<lpage>234</lpage>. <pub-id pub-id-type="doi">10.1111/j.1365-2729.2006.00210.x</pub-id></citation>
</ref>
<ref id="B28">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kim</surname> <given-names>Y.</given-names></name> <name><surname>Thayne</surname> <given-names>J.</given-names></name> <name><surname>Wei</surname> <given-names>Q.</given-names></name></person-group> (<year>2017</year>). <article-title>An embodied agent helps anxious students in mathematics learning</article-title>. <source>Educ. Technol. Res. Dev.</source> <volume>65</volume>, <fpage>219</fpage>&#x02013;<lpage>235</lpage>. <pub-id pub-id-type="doi">10.1007/s11423-016-9476-z</pub-id></citation>
</ref>
<ref id="B29">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Klein</surname> <given-names>J.</given-names></name> <name><surname>Moon</surname> <given-names>Y.</given-names></name> <name><surname>Picard</surname> <given-names>R. W.</given-names></name></person-group> (<year>2002</year>). <article-title>This computer responds to user frustration: theory, design, and results</article-title>. <source>Interact. Comput</source>. 14. 119&#x02013;140. <pub-id pub-id-type="doi">10.1016/S0953-5438(01)00053-4</pub-id></citation>
</ref>
<ref id="B30">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Law</surname> <given-names>V.</given-names></name> <name><surname>Chen</surname> <given-names>C.-H.</given-names></name></person-group> (<year>2016</year>). <article-title>Promoting science learning in game-based learning with question prompts and feedback</article-title>. <source>Comput. Educ</source>. <volume>103</volume>, <fpage>134</fpage>&#x02013;<lpage>143</lpage>. <pub-id pub-id-type="doi">10.1016/j.compedu.2016.10.005</pub-id></citation>
</ref>
<ref id="B31">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Lawson</surname> <given-names>A. P.</given-names></name> <name><surname>Mayer</surname> <given-names>R. E.</given-names></name> <name><surname>Adamo-Villani</surname> <given-names>N.</given-names></name> <name><surname>Benes</surname> <given-names>B.</given-names></name> <name><surname>Lei</surname> <given-names>X.</given-names></name> <name><surname>Cheng</surname> <given-names>J.</given-names></name></person-group> (<year>2021</year>). <article-title>Recognizing the emotional state of human and virtual instructors</article-title>. <source>Comput. Hum. Behav</source>. 114,106554. <pub-id pub-id-type="doi">10.1016/j.chb.2020.106554</pub-id></citation>
</ref>
<ref id="B32">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lehman</surname> <given-names>S.</given-names></name> <name><surname>Schraw</surname> <given-names>G.</given-names></name> <name><surname>McCrudden</surname> <given-names>M. T.</given-names></name> <name><surname>Hartley</surname> <given-names>K.</given-names></name></person-group> (<year>2007</year>). <article-title>Processing and recall of seductive details in scientific text</article-title>. <source>Contemp. Educ. Psychol.</source> <volume>32</volume>, <fpage>569</fpage>&#x02013;<lpage>587</lpage>. <pub-id pub-id-type="doi">10.1016/j.cedpsych.2006.07.002</pub-id></citation>
</ref>
<ref id="B33">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Li</surname> <given-names>L. Y.</given-names></name> <name><surname>Xu</surname> <given-names>R.</given-names></name> <name><surname>Zhen</surname> <given-names>Y. L.</given-names></name></person-group> (<year>2013</year>). <article-title>Feedback design of online learning from the perspective of ARCS Model</article-title>. <source>Modern Distance Education.</source> 3, 66&#x02212;71. <pub-id pub-id-type="doi">10.3969/j.issn.1001-8700.2013.03.012</pub-id></citation>
</ref>
<ref id="B34">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lin</surname> <given-names>H.-C. K.</given-names></name> <name><surname>Wu</surname> <given-names>C.-H.</given-names></name> <name><surname>Hsueh</surname> <given-names>Y.-P.</given-names></name></person-group> (<year>2014</year>). <article-title>The influence of using affective tutoring system in accounting remedial instruction on learning performance and usability</article-title>. <source>Comput. Hum. Behav</source>. <volume>41</volume>, <fpage>514</fpage>&#x02013;<lpage>522</lpage>. <pub-id pub-id-type="doi">10.1016/j.chb.2014.09.052</pub-id></citation>
</ref>
<ref id="B35">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lin</surname> <given-names>L.</given-names></name> <name><surname>Atkinson</surname> <given-names>R. K.</given-names></name> <name><surname>Christopherson</surname> <given-names>R. M.</given-names></name> <name><surname>Joseph</surname> <given-names>S. S.</given-names></name> <name><surname>Harrison</surname> <given-names>C. J.</given-names></name></person-group> (<year>2013</year>). <article-title>Animated agents and learning: Does the type of verbal feedback they provide matter?</article-title> <source>Comput. Educ</source>. <volume>67</volume>, <fpage>239</fpage>&#x02013;<lpage>249</lpage>. <pub-id pub-id-type="doi">10.1016/j.compedu.2013.04.017</pub-id></citation>
</ref>
<ref id="B36">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Lin</surname> <given-names>L.</given-names></name> <name><surname>Ginns</surname> <given-names>P.</given-names></name> <name><surname>Wang</surname> <given-names>T.</given-names></name> <name><surname>Zhang</surname> <given-names>P.</given-names></name></person-group> (<year>2020</year>). <article-title>Using a pedagogical agent to deliver conversational style instruction: What benefits can you obtain?</article-title> <source>Comput. Educ.</source> 143,103658. <pub-id pub-id-type="doi">10.1016/j.compedu.2019.103658</pub-id></citation>
</ref>
<ref id="B37">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mayer</surname> <given-names>R. E.</given-names></name> <name><surname>DaPra</surname> <given-names>C. S.</given-names></name></person-group> (<year>2012</year>). <article-title>An embodiment effect in computer-based learning with animated pedagogical agents</article-title>. <source>J. Exp. Psychol. Appl</source>. <volume>18</volume>, <fpage>239</fpage>&#x02013;<lpage>252</lpage>. <pub-id pub-id-type="doi">10.1037/a0028616</pub-id><pub-id pub-id-type="pmid">22642688</pub-id></citation></ref>
<ref id="B38">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mayer</surname> <given-names>R. E.</given-names></name> <name><surname>Sobko</surname> <given-names>K.</given-names></name> <name><surname>Mautone</surname> <given-names>P. D.</given-names></name></person-group> (<year>2003</year>). <article-title>Social cues in multimedia learning: Role of speaker&#x00027;s voice</article-title>. <source>J. Educ. Psychol</source>. <volume>95</volume>, <fpage>419</fpage>&#x02013;<lpage>425</lpage>. <pub-id pub-id-type="doi">10.1037/0022-0663.95.2.419</pub-id></citation>
</ref>
<ref id="B39">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Moreno</surname> <given-names>R.</given-names></name></person-group> (<year>2004</year>). <article-title>Decreasing cognitive load for novice students: Effects of explanatory versus corrective feedback in discovery-based multimedia</article-title>. <source>Instr. Sci</source>. <volume>32</volume>, <fpage>99</fpage>&#x02013;<lpage>113</lpage>. <pub-id pub-id-type="doi">10.1023/B:TRUC.0000021811.66966.1d</pub-id></citation>
</ref>
<ref id="B40">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Moreno</surname> <given-names>R.</given-names></name> <name><surname>Mayer</surname> <given-names>R.</given-names></name></person-group> (<year>2007</year>). <article-title>Interactive multimodal learning environments</article-title>. <source>Educ. Psychol. Rev.</source> <volume>19</volume>, <fpage>309</fpage>&#x02013;<lpage>326</lpage>. <pub-id pub-id-type="doi">10.1007/s10648-007-9047-2</pub-id></citation>
</ref>
<ref id="B41">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Moreno</surname> <given-names>R.</given-names></name> <name><surname>Mayer</surname> <given-names>R. E.</given-names></name></person-group> (<year>2005</year>). <article-title>Role of guidance, reflection, and interactivity in an agent-based multimedia game</article-title>. <source>J. Educ. Psychol</source>. <volume>97</volume>, <fpage>117</fpage>&#x02013;<lpage>128</lpage>. <pub-id pub-id-type="doi">10.1037/0022-0663.97.1.117</pub-id></citation>
</ref>
<ref id="B42">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>M&#x000FC;nchow</surname> <given-names>H.</given-names></name> <name><surname>Bannert</surname> <given-names>M.</given-names></name></person-group> (<year>2019</year>). <article-title>Feeling good, learning better? effectivity of an emotional design procedure in multimedia learning</article-title>. <source>Educ. Psychol</source>. <volume>39</volume>, <fpage>530</fpage>&#x02013;<lpage>549</lpage>. <pub-id pub-id-type="doi">10.1080/01443410.2018.1524852</pub-id></citation>
</ref>
<ref id="B43">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Narciss</surname> <given-names>S.</given-names></name></person-group> (<year>2008</year>). <article-title>&#x0201C;Feedback strategies for interactive learning tasks.&#x0201D;</article-title> In: <italic>Handbook of Research on Educational Communications and Technology</italic>, Eds J. M. Spector, M. D. Merrill, J. J. G. van Merri&#x000EB;nboer, and M. P. Driscoll (<publisher-loc>Mahwah, NJ</publisher-loc>: <publisher-name>LEA</publisher-name>), <fpage>125</fpage>&#x02013;<lpage>144</lpage>.</citation>
</ref>
<ref id="B44">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Paas</surname> <given-names>F.</given-names></name> <name><surname>Renkl</surname> <given-names>A.</given-names></name> <name><surname>Sweller</surname> <given-names>J.</given-names></name></person-group> (<year>2003</year>). <article-title>Cognitive load theory and instructional design: Recent developments</article-title>. <source>Educ. Psychol</source>. <volume>38</volume>, <fpage>1</fpage>&#x02013;<lpage>4</lpage>. <pub-id pub-id-type="doi">10.1207/S15326985EP3801_1</pub-id></citation>
</ref>
<ref id="B45">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Paas</surname> <given-names>F.</given-names></name> <name><surname>Van Merrienboer</surname> <given-names>J.</given-names></name> <name><surname>Adam</surname> <given-names>J</given-names></name></person-group>. (<year>1994</year>). <article-title>Measurement of cognitive load in instructional research</article-title>. <source>Percept. Mot. Skills</source>. <volume>79</volume>, <fpage>419</fpage>&#x02013;<lpage>430</lpage>. <pub-id pub-id-type="doi">10.2466/pms.1994.79.1.419</pub-id><pub-id pub-id-type="pmid">7808878</pub-id></citation></ref>
<ref id="B46">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Panadero</surname> <given-names>E.</given-names></name> <name><surname>Lipnevich</surname> <given-names>A. A.</given-names></name></person-group> (<year>2022</year>). <article-title>A review of feedback models and typologies: Towards an integrative model of feedback element</article-title>. <source>Educ. Res. Rev.</source> <volume>35</volume>, <fpage>100416</fpage>. <pub-id pub-id-type="doi">10.1016/j.edurev.2021.100416</pub-id></citation>
</ref>
<ref id="B47">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Pekrun</surname> <given-names>R.</given-names></name> <name><surname>Frenzel</surname> <given-names>A. C.</given-names></name> <name><surname>Goetz</surname> <given-names>T.</given-names></name> <name><surname>Perry</surname> <given-names>R. P.</given-names></name></person-group> (<year>2007</year>). <article-title>&#x0201C;The control-value theory of achievement emotions : An integrative approach to emotions in education,&#x0201D;</article-title> in <source>Emotion in Education</source>, eds P. A. Schutz, and R. Pekrun (Amsterdam: Academic Press), <fpage>13</fpage>&#x02013;<lpage>6</lpage>. <pub-id pub-id-type="doi">10.1016/B978-012372545-5/50003-4</pub-id></citation>
</ref>
<ref id="B48">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Pekrun</surname> <given-names>R.</given-names></name> <name><surname>Perry</surname> <given-names>R. P.</given-names></name></person-group> (<year>2014</year>). <article-title>&#x0201C;Control-value theory of achievement emotions,&#x0201D;</article-title> in <source>International Handbook of Emotions in Education</source> (<publisher-loc>Taylor and Francis</publisher-loc>), <fpage>120</fpage>&#x02013;<lpage>141</lpage>. <pub-id pub-id-type="doi">10.4324/9780203148211</pub-id></citation>
</ref>
<ref id="B49">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Plass</surname> <given-names>J. L.</given-names></name> <name><surname>Kalyuga</surname> <given-names>S.</given-names></name></person-group> (<year>2019</year>). <article-title>Four ways of considering emotion in cognitive load theory</article-title>. <source>Educ. Psychol. Rev</source>. <volume>31</volume>, <fpage>339</fpage>&#x02013;<lpage>359</lpage>. <pub-id pub-id-type="doi">10.1007/s10648-019-09473-5</pub-id></citation>
</ref>
<ref id="B50">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Plass</surname> <given-names>J. L.</given-names></name> <name><surname>Kaplan</surname> <given-names>U.</given-names></name></person-group> (<year>2016</year>). <article-title>&#x0201C;Emotional design in digital media for learning,&#x0201D;</article-title> in <source>Emotions, Technology, and Learning</source>, eds S. Y. Tettegah and M. P. McCreery (Academic Press), <fpage>131</fpage>&#x02013;<lpage>161</lpage>. <pub-id pub-id-type="doi">10.1016/B978-0-12-801856-9.00007-4</pub-id></citation>
</ref>
<ref id="B51">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Prendinger</surname> <given-names>H.</given-names></name> <name><surname>Mayer</surname> <given-names>S.</given-names></name> <name><surname>Mori</surname> <given-names>J.</given-names></name> <name><surname>Ishizuka</surname> <given-names>M.</given-names></name></person-group> (<year>2003</year>). <article-title>&#x0201C;Persona effect revisited.&#x0201D; In: <italic>Intelligent Virtual Agents</italic></article-title>, eds T. Rist, R. S. Aylett, D. Ballin, and J. Rickel (Berlin, Heidelberg: Springer Berlin Heidelberg), <fpage>283</fpage>&#x02013;<lpage>291</lpage>. <pub-id pub-id-type="doi">10.1007/978-3-540-39396-2_48</pub-id></citation>
</ref>
<ref id="B52">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Ryu</surname> <given-names>J.</given-names></name> <name><surname>Baylor</surname> <given-names>A.</given-names></name></person-group> (<year>2003</year>). <article-title>The psychometric structure of pedagogical agent persona</article-title>. <source>Technology Instruction Cognition and Learning.</source> <volume>2</volume>, <fpage>291</fpage>&#x02013;<lpage>314</lpage>. Available online at: <ext-link ext-link-type="uri" xlink:href="https://www.researchgate.net/publication/228356035_The_psychometric_structure_of_pedagogical_agent_persona">https://www.researchgate.net/publication/228356035_The_psychometric_structure_of_pedagogical_agent_persona</ext-link></citation>
</ref>
<ref id="B53">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schneider</surname> <given-names>S.</given-names></name> <name><surname>Krieglstein</surname> <given-names>F.</given-names></name> <name><surname>Beege</surname> <given-names>M.</given-names></name> <name><surname>Rey</surname> <given-names>G. D.</given-names></name></person-group> (<year>2022</year>). <article-title>The impact of video lecturers&#x00027; nonverbal communication on learning&#x02013;an experiment on gestures and facial expressions of pedagogical agents</article-title>. <source>Comput. Educ.</source> <volume>176</volume>:<fpage>104350</fpage>. <pub-id pub-id-type="doi">10.1016/j.compedu.2021.104350</pub-id></citation>
</ref>
<ref id="B54">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schroeder</surname> <given-names>N. L.</given-names></name> <name><surname>Adesope</surname> <given-names>O. O.</given-names></name></person-group> (<year>2014</year>). <article-title>A systematic review of pedagogical agents&#x00027; persona, motivation, and cognitive load implications for learners</article-title>. <source>J. Res. Technol. Educ</source>. <volume>46</volume>, <fpage>229</fpage>&#x02013;<lpage>251</lpage>. <pub-id pub-id-type="doi">10.1080/15391523.2014.888265</pub-id></citation>
</ref>
<ref id="B55">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Sharma</surname> <given-names>K.</given-names></name> <name><surname>Lee-Cultura</surname> <given-names>S.</given-names></name> <name><surname>Giannakos</surname> <given-names>M.</given-names></name></person-group> (<year>2022</year>). <article-title>Keep calm and do not carry-forward: Toward sensor-data driven AI agent to enhance human learning</article-title>. <source>Front. Artif. Intell</source>. 4, 713176. <pub-id pub-id-type="doi">10.3389/frai.2021.713176</pub-id><pub-id pub-id-type="pmid">35098109</pub-id></citation></ref>
<ref id="B56">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Shen</surname> <given-names>E.</given-names></name></person-group> (<year>2009</year>). <source>The Effects of Agent Emotional Support and Cognitive Motivational Messages on Math Anxiety, Learning, and Motivation</source> (<publisher-loc>Doctoral Dissertation</publisher-loc>). Florida State University, Tallahassee.</citation>
</ref>
<ref id="B57">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shute</surname> <given-names>V. J.</given-names></name></person-group> (<year>2008</year>). <article-title>Focus on formative feedback</article-title>. <source>Rev. Educ. Res</source>. <volume>78</volume>, <fpage>153</fpage>&#x02013;<lpage>189</lpage>. <pub-id pub-id-type="doi">10.3102/0034654307313795</pub-id></citation>
</ref>
<ref id="B58">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sixte</surname> <given-names>R. D.</given-names></name> <name><surname>Ma,&#x000F1;&#x000E1;</surname> <given-names>A.</given-names></name> <name><surname>&#x000C1;vila</surname> <given-names>V.</given-names></name> <name><surname>S&#x000E1;nchez</surname> <given-names>E.</given-names></name></person-group> (<year>2020</year>). <article-title>Warm elaborated feedback. Exploring its benefits on post-feedback behavior</article-title>. <source>Educ. Psychol.</source> <volume>40</volume>, <fpage>1094</fpage>&#x02013;<lpage>1112</lpage>. <pub-id pub-id-type="doi">10.1080/01443410.2019.1687853</pub-id></citation>
</ref>
<ref id="B59">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Terzidou</surname> <given-names>T.</given-names></name> <name><surname>Tsiatsos</surname> <given-names>T.</given-names></name> <name><surname>Apostolidis</surname> <given-names>H.</given-names></name></person-group> (<year>2018</year>). <article-title>Architecture and interaction protocol for pedagogical&#x02013;empathic agents in 3D virtual learning environments</article-title>. <source>Multimed. Tools Appl</source>. <volume>77</volume>, <fpage>27661</fpage>&#x02013;<lpage>27684</lpage>. <pub-id pub-id-type="doi">10.1007/s11042-018-5942-4</pub-id></citation>
</ref>
<ref id="B60">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Terzis</surname> <given-names>V.</given-names></name> <name><surname>Moridis</surname> <given-names>C. N.</given-names></name> <name><surname>Economides</surname> <given-names>A. A.</given-names></name></person-group> (<year>2012</year>). <article-title>The effect of emotional feedback on behavioral intention to use computer-based assessment</article-title>. <source>Comput. Educ</source>. <volume>59</volume>, <fpage>710</fpage>&#x02013;<lpage>721</lpage>. <pub-id pub-id-type="doi">10.1016/j.compedu.2012.03.003</pub-id></citation>
</ref>
<ref id="B61">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Timmers</surname> <given-names>C. F.</given-names></name> <name><surname>Walraven</surname> <given-names>A.</given-names></name> <name><surname>Veldkamp</surname> <given-names>B. P.</given-names></name></person-group> (<year>2015</year>). <article-title>The effect of regulation feedback in a computer-based formative assessment on information problem solving</article-title>. <source>Comput. Educ.</source> <volume>87</volume>, <fpage>1</fpage>&#x02013;<lpage>9</lpage>. <pub-id pub-id-type="doi">10.1016/j.compedu.2015.03.012</pub-id></citation>
</ref>
<ref id="B62">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tung</surname> <given-names>F.-W.</given-names></name></person-group> (<year>2013</year>). <article-title>Effects of emotional feedback on children, using different modalities</article-title>. <source>Interact. Learn. Environ</source>. <volume>21</volume>, <fpage>3</fpage>&#x02013;<lpage>17</lpage>. <pub-id pub-id-type="doi">10.1080/10494820.2010.542758</pub-id><pub-id pub-id-type="pmid">6156712</pub-id></citation></ref>
<ref id="B63">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Van der Kleij</surname> <given-names>F.</given-names></name> <name><surname>Feskens</surname> <given-names>C. W. R.</given-names></name> <name><surname>Eggen</surname> <given-names>J. H. M. T.</given-names></name></person-group> (<year>2014</year>). <article-title>Effects of feedback in a computer-based learning environment on students learning outcomes: A meta-analysis</article-title>. <source>Rev. Res</source>. <volume>85</volume>, <fpage>475</fpage>&#x02013;<lpage>511</lpage>.</citation>
</ref>
<ref id="B64">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wang</surname> <given-names>J.</given-names></name> <name><surname>Antonenko</surname> <given-names>P.</given-names></name> <name><surname>Dawson</surname> <given-names>K.</given-names></name></person-group> (<year>2020</year>). <article-title>Does visual attention to the instructor in online video affect learning and learner perceptions? an eye-tracking analysis</article-title>. <source>Comput. Educ.</source> <volume>146</volume>, <fpage>103779</fpage>. <pub-id pub-id-type="doi">10.1016/j.compedu.2019.103779</pub-id></citation>
</ref>
<ref id="B65">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wang</surname> <given-names>Z.</given-names></name> <name><surname>Gong</surname> <given-names>S. Y.</given-names></name> <name><surname>Xu</surname> <given-names>S.</given-names></name> <name><surname>Hu</surname> <given-names>X. E.</given-names></name></person-group> (<year>2019</year>). <article-title>Elaborated feedback and learning: examining cognitive and motivational influences</article-title>. <source>Comput. Educ.</source> <volume>136</volume>, <fpage>130</fpage>&#x02013;<lpage>140</lpage>. <pub-id pub-id-type="doi">10.1016/j.compedu.2019.04.003</pub-id></citation>
</ref>
<ref id="B66">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Woolf</surname> <given-names>B. P.</given-names></name> <name><surname>Arroyo</surname> <given-names>I.</given-names></name> <name><surname>Muldner</surname> <given-names>K.</given-names></name> <name><surname>Burleson</surname> <given-names>W.</given-names></name> <name><surname>Cooper</surname> <given-names>D. G.</given-names></name> <name><surname>Dolan</surname> <given-names>R.</given-names></name> <etal/></person-group>. (<year>2010</year>). <article-title>&#x0201C;The effect of motivational learning companions on low achieving students and students with disabilities.&#x0201D;</article-title> in <source>Intelligent Tutoring Systems</source>, Eds V. Aleven, J. Kay, and J. Mostow (Berlin, Heidelberg: Springer Berlin Heidelberg), <fpage>327</fpage>&#x02013;<lpage>337</lpage>. <pub-id pub-id-type="doi">10.1007/978-3-642-13388-6_37</pub-id></citation>
</ref>
<ref id="B67">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Xu</surname> <given-names>Y.</given-names></name></person-group> (<year>2018</year>). <source>Computer Feedback, Agents, and Pitch Effects on Multimedia Learning</source> (<publisher-loc>Master&#x00027;s Dissertation</publisher-loc>). Central China Normal University, Wuhan.</citation>
</ref>
<ref id="B68">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Zhao</surname> <given-names>L. Y.</given-names></name></person-group> (<year>2014</year>). <source>Expertise Reversal Effect in Multimedia Learning</source> (<publisher-loc>Doctoral Dissertation</publisher-loc>). <publisher-name>East China Normal University, Shanghai</publisher-name>.</citation>
</ref>
</ref-list> 
</back>
</article>