<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article article-type="research-article" dtd-version="2.3" xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Robot. AI</journal-id>
<journal-title>Frontiers in Robotics and AI</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Robot. AI</abbrev-journal-title>
<issn pub-type="epub">2296-9144</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">676123</article-id>
<article-id pub-id-type="doi">10.3389/frobt.2021.676123</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Robotics and AI</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Do Shy Preschoolers Interact Differently When Learning Language With a Social Robot? An Analysis of Interactional Behavior and Word Learning</article-title>
<alt-title alt-title-type="left-running-head">Tolksdorf et&#x20;al.</alt-title>
<alt-title alt-title-type="right-running-head">Shy Children&#x2019;s Interactional- and Learning Behavior</alt-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name>
<surname>Tolksdorf</surname>
<given-names>Nils F.</given-names>
</name>
<xref ref-type="corresp" rid="c001">&#x2a;</xref>
<uri xlink:href="https://loop.frontiersin.org/people/964125/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Viertel</surname>
<given-names>Franziska E.</given-names>
</name>
<uri xlink:href="https://loop.frontiersin.org/people/1321252/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Rohlfing</surname>
<given-names>Katharina J.</given-names>
</name>
<uri xlink:href="https://loop.frontiersin.org/people/14126/overview"/>
</contrib>
</contrib-group>
<aff>Faculty of Arts and Humanities, Psycholinguistics, Paderborn University, <addr-line>Paderborn</addr-line>, <country>Germany</country>
</aff>
<author-notes>
<fn fn-type="edited-by">
<p>
<bold>Edited by:</bold> <ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/9158/overview">Tony Belpaeme</ext-link>, Ghent University, Belgium</p>
</fn>
<fn fn-type="edited-by">
<p>
<bold>Reviewed by:</bold> <ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/786902/overview">Samuel Spaulding</ext-link>, Massachusetts Institute of Technology, United&#x20;States</p>
<p>
<ext-link ext-link-type="uri" xlink:href="https://loop.frontiersin.org/people/582018/overview">Sofia Serholt</ext-link>, University of Gothenburg, Sweden</p>
</fn>
<corresp id="c001">&#x2a;Correspondence: Nils F. Tolksdorf, <email>nils.tolksdorf@upb.de</email>
</corresp>
<fn fn-type="other">
<p>This article was submitted to Human-Robot Interaction, a section of the journal Frontiers in Robotics and&#x20;AI</p>
</fn>
</author-notes>
<pub-date pub-type="epub">
<day>31</day>
<month>05</month>
<year>2021</year>
</pub-date>
<pub-date pub-type="collection">
<year>2021</year>
</pub-date>
<volume>8</volume>
<elocation-id>676123</elocation-id>
<history>
<date date-type="received">
<day>04</day>
<month>03</month>
<year>2021</year>
</date>
<date date-type="accepted">
<day>23</day>
<month>04</month>
<year>2021</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#xa9; 2021 Tolksdorf, Viertel and Rohlfing.</copyright-statement>
<copyright-year>2021</copyright-year>
<copyright-holder>Tolksdorf, Viertel and Rohlfing</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these&#x20;terms.</p>
</license>
</permissions>
<abstract>
<p>Temperamental traits can decisively influence how children enter into social interaction with their environment. Yet, in the field of child&#x2013;robot interaction, little is known about how individual differences such as shyness impact on how children interact with social robots in educational settings. The present study systematically assessed the temperament of 28 preschool children aged 4&#x2013;5&#x2002;years in order to investigate the role of shyness within a dyadic child&#x2013;robot interaction. Over the course of four consecutive sessions, we observed how shy compared to nonshy children interacted with a social robot during a word-learning educational setting and how shyness influenced children&#x2019;s learning outcomes. Overall, results suggested that shy children not only interacted differently with a robot compared to nonshy children, but also changed their behavior over the course of the sessions. Critically, shy children interacted less expressively with the robot in general. With regard to children&#x2019;s language learning outcomes, shy children scored lower on an initial posttest, but were able to close this gap on a later test, resulting in all children retrieving the learned words on a similar level. When intertest learning gain was considered, regression analyses even confirmed a positive predictive role of shyness on language learning gains. Findings are discussed with regard to the role of shyness in educational settings with social robots and the implications for future interaction design.</p>
</abstract>
<kwd-group>
<kwd>child&#x2013;robot interaction</kwd>
<kwd>temperament</kwd>
<kwd>shyness</kwd>
<kwd>early childhood education</kwd>
<kwd>social robot</kwd>
<kwd>personality and behavior</kwd>
<kwd>word learning</kwd>
<kwd>individual differences</kwd>
</kwd-group>
</article-meta>
</front>
<body>
<sec id="s1">
<title>Introduction</title>
<p>Recent years have seen a substantial growth in the applicability of social robots in educational learning environments with young learners. Examples are therapeutic settings (<xref ref-type="bibr" rid="B13">Boccanfuso et&#x20;al., 2017</xref>; <xref ref-type="bibr" rid="B18">Cao et&#x20;al., 2019</xref>), science learning (<xref ref-type="bibr" rid="B19">Causo et&#x20;al., 2016</xref>; <xref ref-type="bibr" rid="B52">Park et&#x20;al., 2017</xref>; <xref ref-type="bibr" rid="B38">Ioannou and Makridou, 2018</xref>), or language learning (<xref ref-type="bibr" rid="B81">van den Berghe et&#x20;al., 2019</xref>; <xref ref-type="bibr" rid="B85">Vogt et&#x20;al., 2019</xref>). More specifically, with the benefits of an embodied agent (<xref ref-type="bibr" rid="B12">Belpaeme et&#x20;al., 2018</xref>), social robots offer versatile possibilities to engage children systematically in social interaction. Indeed, current research suggests that children accept social robots as trustworthy social actors from whom they can obtain reliable information (<xref ref-type="bibr" rid="B14">Breazeal et&#x20;al., 2016</xref>; <xref ref-type="bibr" rid="B86">Vollmer et&#x20;al., 2018</xref>; <xref ref-type="bibr" rid="B51">Oran&#xe7; and K&#xfc;ntay, 2020</xref>). However, whereas these findings consider the demonstrated behavior displayed by children on average, individual differences in child&#x2013;robot interactions have received little attention. Nonetheless, the way children enter into social interaction with their environment is mediated crucially by their individual temperament&#x2014;specifically, by their shyness (<xref ref-type="bibr" rid="B24">Coplan and Evans, 2009</xref>). In fact, past research has demonstrated that a child&#x2019;s shyness significantly influences her or his social behavior in familiar and unfamiliar contexts (<xref ref-type="bibr" rid="B55">Reddy, 2000</xref>; <xref ref-type="bibr" rid="B30">Evans, 2001</xref>; <xref ref-type="bibr" rid="B25">Coplan and Weeks, 2009</xref>; <xref ref-type="bibr" rid="B26">Crozier and Badawood, 2009</xref>; <xref ref-type="bibr" rid="B31">Feinberg et&#x20;al., 2012</xref>; <xref ref-type="bibr" rid="B21">Colonnesi et&#x20;al., 2014</xref>; <xref ref-type="bibr" rid="B72">Smith Watts et&#x20;al., 2014</xref>). Additionally, shyness has a substantial impact on children&#x2019;s performance in educational settings, insofar as shy children can either struggle to demonstrate their abilities in such situations or implicitly reduce their learning opportunities because they avoid social interaction (<xref ref-type="bibr" rid="B30">Evans, 2001</xref>; <xref ref-type="bibr" rid="B74">Spere et&#x20;al., 2004</xref>; <xref ref-type="bibr" rid="B72">Smith Watts et&#x20;al., 2014</xref>). Although some work has focused on how individual personality traits of adults affect interaction with a robot (<xref ref-type="bibr" rid="B87">Walters et&#x20;al., 2005</xref>; <xref ref-type="bibr" rid="B65">Salter et&#x20;al., 2006</xref>; <xref ref-type="bibr" rid="B64">Salam et&#x20;al., 2017</xref>), research accounting for children&#x2019;s behavior lags behind. Thus, our aim is to raise awareness in the area of child&#x2013;robot interaction about how children&#x2019;s personality traits such as shyness are reflected in their behavior when interacting with a social robot. Specifically, we aim to understand how the behavior of shy children might develop over a long-term interaction and influence learning gains with a social&#x20;robot.</p>
<p>Extensive past research underlines the prevalence of shyness, indicating that up to 90% of the population experience shyness at some point in their lives with about 15% of individuals displaying a shyness that emerges in early development and remains stable across contexts (<xref ref-type="bibr" rid="B90">Zimbardo et&#x20;al., 1975</xref>; <xref ref-type="bibr" rid="B39">Kagan, 1994</xref>; <xref ref-type="bibr" rid="B68">Schmidt et&#x20;al., 2020</xref>). Shyness in children can be conceptualized as an increased and persistent behavioral inhibition in unfamiliar social situations or during perceived social evaluation that can result in withdrawal from interaction (<xref ref-type="bibr" rid="B54">Putnam et&#x20;al., 2006</xref>; <xref ref-type="bibr" rid="B63">Rubin et&#x20;al., 2009</xref>; <xref ref-type="bibr" rid="B9">Barker et&#x20;al., 2014</xref>; see <xref ref-type="bibr" rid="B67">Schmidt and Buss, 2010</xref>, for a review). In developmental research, the effects of shyness are well documented, showing that the behavior of shy children toward their environment is reflected in both their verbal (<xref ref-type="bibr" rid="B25">Coplan and Weeks, 2009</xref>; <xref ref-type="bibr" rid="B26">Crozier and Badawood, 2009</xref>; <xref ref-type="bibr" rid="B72">Smith Watts et&#x20;al., 2014</xref>) and nonverbal behavior (<xref ref-type="bibr" rid="B55">Reddy, 2000</xref>; <xref ref-type="bibr" rid="B30">Evans, 2001</xref>; <xref ref-type="bibr" rid="B54">Putnam et&#x20;al., 2006</xref>; <xref ref-type="bibr" rid="B31">Feinberg et&#x20;al., 2012</xref>; <xref ref-type="bibr" rid="B21">Colonnesi et&#x20;al., 2014</xref>). For example, shy children are less talkative in familiar and unfamiliar contexts (<xref ref-type="bibr" rid="B8">Asendorpf and Meier, 1993</xref>; <xref ref-type="bibr" rid="B29">Evans, 1996</xref>; <xref ref-type="bibr" rid="B26">Crozier and Badawood, 2009</xref>) and display shyness through their facial expressions (e.g., by showing coy smiles) or their gaze behavior (e.g., duration of eye contact or gaze and head aversion; see <xref ref-type="bibr" rid="B56">Reddy, 2005</xref>; <xref ref-type="bibr" rid="B21">Colonnesi et&#x20;al., 2014</xref>; <xref ref-type="bibr" rid="B22">Colonnesi et&#x20;al., 2017</xref>). Importantly, recent research emphasizes that such expressions of shyness provide a positive and socially adaptive function for shy children within an interaction that enables them to regulate their emotions in unknown situations while also increasing prosociality and trust (<xref ref-type="bibr" rid="B56">Reddy, 2005</xref>; <xref ref-type="bibr" rid="B20">Colonnesi et&#x20;al., 2013</xref>; <xref ref-type="bibr" rid="B23">Colonnesi et&#x20;al., 2020</xref>).</p>
<p>Beyond the fact that shyness is reflected in children&#x2019;s behavior toward an interaction partner, shyness also has an effect on the measured learning performance in educational contexts and particularly in the domain of language learning. <xref ref-type="bibr" rid="B74">Spere et&#x20;al. (2004)</xref> and <xref ref-type="bibr" rid="B73">Spere and Evans (2009)</xref> have demonstrated that temperamentally shy preschoolers perform more poorly on both expressive and receptive vocabulary tests compared to nonshy children. Similarly, <xref ref-type="bibr" rid="B35">Hilton and Westermann (2017)</xref>, recently investigated shy children&#x2019;s retention abilities for learned word&#x2013;object mappings and compared their learning outcomes with those of nonshy children. They looked at long-term word learning processes when the children were engaged in a word learning task: After a 5&#x2002;min break, shy children did not retain any novel word they had formed during the learning situation; less shy children, in contrast, were able to retain the trained words. In line with work indicating that shy children are less likely to take risks in&#x20;situations that are unknown or in which they are being evaluated (<xref ref-type="bibr" rid="B4">Addison and Schmidt, 1999</xref>; <xref ref-type="bibr" rid="B44">Levin and Hart, 2003</xref>), the authors suggested that shy children rely less on a guess in their responses, and that this might be detrimental in a situation in which they have to retrieve a novel word with ambiguous referents (<xref ref-type="bibr" rid="B35">Hilton and Westermann, 2017</xref>). Additionally, they argued that shyness may affect not only performance during an evaluation situation but also the immediate learning process&#x2014;that is, due to shy children&#x2019;s aversion to the unfamiliar, they might be less inclined to use novelty as a cue to the appropriate referent of a novel label when familiar/competitor objects are present. However, in this respect, it has been suggested that these differences in learning achievements could be context-dependent and not genuine, and that they should disappear under conditions that minimize anxiety or fear of evaluation (<xref ref-type="bibr" rid="B73">Spere et al., 2004</xref>; <xref ref-type="bibr" rid="B35">Hilton and Westermann, 2017</xref>). Along these lines, it should be borne in mind that conducting an experiment typically represents a fundamentally unfamiliar social situation for a child through, for instance, being exposed to unfamiliar people and unfamiliar settings. Thus, and against the background of evidence that shy children tend to show difficulties in experimental tasks (<xref ref-type="bibr" rid="B27">Crozier and Hostettler, 2003</xref>), it can be argued that the unfamiliar contextual environment during the testing situation might have influenced the recall abilities of shy children. Furthermore, <xref ref-type="bibr" rid="B35">Hilton and Westermann (2017)</xref>, did not assess children&#x2019;s general linguistic skills, although research has shown that existing linguistic knowledge should be considered when measuring word-learning processes (<xref ref-type="bibr" rid="B75">Stelmachowicz et&#x20;al., 2004</xref>; <xref ref-type="bibr" rid="B48">McMurray et&#x20;al., 2012</xref>). Therefore, investigations that include children&#x2019;s linguistic abilities, are extended over a longer period of time, and are not limited to a single occasion could increase familiarity with the contextual environment and shed a more nuanced light on shy children&#x2019;s learning outcomes in comparison to their nonshy peers. In sum, the currently available evidence shows that shy children&#x2019;s behavior and learning is highly sensitive to contextual changes that may be particularly pronounced in social interactions such as in unfamiliar face-to-face encounters or during testing situations (<xref ref-type="bibr" rid="B74">Spere et&#x20;al., 2004</xref>; <xref ref-type="bibr" rid="B54">Putnam et&#x20;al., 2006</xref>; <xref ref-type="bibr" rid="B46">Matsuda et&#x20;al., 2013</xref>).</p>
<p>Turning to the area of child&#x2013;robot interaction, only a few attempts have been made to explore shy children&#x2019;s behavior during interaction with a social robot, although possible implications of shyness for child&#x2013;robot interaction in educational contexts are acknowledged (<xref ref-type="bibr" rid="B10">Baxter and Belpaeme, 2016</xref>; <xref ref-type="bibr" rid="B11">Baxter et&#x20;al., 2017</xref>). Instead, most studies dealing with personality traits in this field examine approaches to provide the robotic system with the ability to automatically estimate the personality of a child based on predefined behavioral characteristics (<xref ref-type="bibr" rid="B1">Abe et&#x20;al., 2014</xref>; <xref ref-type="bibr" rid="B2">Abe et&#x20;al., 2017</xref>; <xref ref-type="bibr" rid="B69">Schodde et&#x20;al., 2017</xref>; <xref ref-type="bibr" rid="B3">Abe et&#x20;al., 2020</xref>; <xref ref-type="bibr" rid="B66">Sano et&#x20;al., 2020</xref>) or to equip the robot itself with certain personality traits (<xref ref-type="bibr" rid="B32">Fischer et&#x20;al., 2019</xref>; <xref ref-type="bibr" rid="B17">Calvo-Barajas et&#x20;al., 2020</xref>). One of the few studies to address shyness in child&#x2013;robot interaction investigated preschooler&#x2019;s perceptions during a free-play situation in a kindergarten setting (<xref ref-type="bibr" rid="B1">Abe et&#x20;al., 2014</xref>). In this study, parents evaluated their children&#x2019;s shyness on a 5-point scale before estimating the social relationship between their child and the robot after a single &#x201c;one-off&#x201d; interaction. The study found that shyness clearly affected the relationship with the robot; and, according to the parents, one third of the shy children lacked a friendly relationship with the robot, whereas almost all nonshy children were friendly with the robot (<xref ref-type="bibr" rid="B1">Abe et&#x20;al., 2014</xref>). Although examining parental reports about an experienced child&#x2013;robot interaction is a proven methodological approach to assess and contextualize a child&#x2019;s behavior (<xref ref-type="bibr" rid="B77">Tolksdorf and Rohlfing, 2020</xref>), how shy children actually behave within a child&#x2013;robot interaction setting remains an open question. Additionally, given that familiarity with a situation strongly influences shyness (<xref ref-type="bibr" rid="B57">Rimm-Kaufman and Kagan, 2005</xref>), there is a general lack of a perspective that would include the long-term effects over multiple interactions.</p>
<p>Other studies that consider the effects of children&#x2019;s individual personality traits are based on more implicit findings: <xref ref-type="bibr" rid="B85">Vogt et&#x20;al. (2019)</xref> reported that in an educational child&#x2013;robot interaction, certain preschoolers dropped out of the entire interaction due to shyness, or they needed additional support from the caregiver to successfully interact with the robot because they were reluctant or anxious even after an initial introduction to it. <xref ref-type="bibr" rid="B70">Shiomi et&#x20;al. (2016)</xref> made a similar observation, showing that in a free-play situation, almost one quarter of the children hesitated to interact with the robot or avoided interaction entirely. The authors explained this rejection behavior as a result of the inhibition of these children (<xref ref-type="bibr" rid="B70">Shiomi et&#x20;al., 2016</xref>). However, because they did not assess the children&#x2019;s temperament, it is not clear whether their behavior can be linked to their shyness.</p>
<p>In a more recent work, <xref ref-type="bibr" rid="B79">Tolksdorf et&#x20;al. (2020b)</xref> were the first to investigate which expressions of shyness are displayed by a child during an educational child&#x2013;robot interaction. Their pilot study measured preschool children&#x2019;s shyness with a standardized and validated questionnaire (<xref ref-type="bibr" rid="B89">Zentner, 2011</xref>) and analyzed children&#x2019;s expressions of shyness toward the social robot across three sessions. In interaction with the robot, shy children not only behaved differently, but also changed their behavior over the course of the sessions: Although they showed significantly less positive behavior in the first interaction compared to the nonshy children, these differences disappeared in subsequent sessions. The authors argued that this could be explained in terms of increasing familiarity with the novel interaction partner, and that shy children might be able to overcome their reluctance to interact with a robotic system. In fact, these results are in line with work suggesting that young children react with uncertainty when facing a robot for the first time, and that they rely on an adequate introduction by a familiar caregiver to establish a beneficial learning environment (<xref ref-type="bibr" rid="B61">Rohlfing et&#x20;al., 2020</xref>).</p>
<p>Taken together, these few studies indicate clearly that individual differences in the behavioral style toward a social robot exist in children, and they can be related to children&#x2019;s shyness. However, any generalization across previous reports on the relation between shyness and children&#x2019;s interaction behavior toward a robot is difficult because of the differences in the precise operationalization and assessment of shyness. Importantly, considering that social robots are being evaluated increasingly as learning partners, we do not know how far temperamental characteristics such as shyness might influence a child&#x2019;s learning gain. Furthermore, although earlier studies evidenced that some behavioral effects in shy children&#x2019;s behavior disappear when they are given the opportunity to familiarize themselves with the situation (<xref ref-type="bibr" rid="B30">Evans, 2001</xref>; <xref ref-type="bibr" rid="B57">Rimm-Kaufman and Kagan, 2005</xref>; <xref ref-type="bibr" rid="B7">Arbeau et&#x20;al., 2010</xref>), the literature lacks a perspective focusing on how the behavior of shy children develops during a long-term child&#x2013;robot interaction over multiple points in time and including multiple exposures to a test situation. Therefore, following up on our previous work, the current study aimed to address this research gap: We investigated the impact of shyness during an educational child&#x2013;robot interaction by systematically examining children&#x2019;s learning performance as well as their interaction behavior in terms of shyness markers and their signals of pleasure and distress toward the robot over the course of a long-term study on language learning.</p>
<p>In the present study, preschool-age children took part in a child&#x2013;robot interaction over three consecutive learning situations followed by two test situations within a time period of two weeks. In line with recent accounts arguing that young children react with uncertainty when initially encountering a robot (<xref ref-type="bibr" rid="B84">Vogt et&#x20;al., 2017</xref>; <xref ref-type="bibr" rid="B61">Rohlfing et&#x20;al., 2020</xref>), we assumed that all children would interact with a certain reluctance at the beginning of the long-term interaction because they were faced with a novel and unfamiliar situation. Our main research interest was to explore how shy children&#x2019;s behavior and language learning would develop with increasing familiarity during the sessions. We formulated the following hypotheses:<list list-type="simple">
<list-item>
<p>1. <bold>(H1)</bold> Based on the aforementioned work demonstrating shy children&#x2019;s behavioral inhibition in unfamiliar social situations (<xref ref-type="bibr" rid="B29">Evans, 1996</xref>; <xref ref-type="bibr" rid="B55">Reddy, 2000</xref>; <xref ref-type="bibr" rid="B54">Putnam et&#x20;al., 2006</xref>; <xref ref-type="bibr" rid="B31">Feinberg et&#x20;al., 2012</xref>; <xref ref-type="bibr" rid="B1">Abe et&#x20;al., 2014</xref>; <xref ref-type="bibr" rid="B21">Colonnesi et&#x20;al., 2014</xref>; <xref ref-type="bibr" rid="B85">Vogt et&#x20;al., 2019</xref>; <xref ref-type="bibr" rid="B79">Tolksdorf et&#x20;al., 2020b</xref>), we expected that shy children would show less positive reactions (H1a) and more negative reactions (H1b) than nonshy children in both the learning situations and the test situations with the social robot just like they would be expected to do in human&#x2013;human face-to-face interactions.</p>
</list-item>
<list-item>
<p>2. <bold>(H2)</bold> We also expected that negative reactions would decrease and positive reactions would increase with the repetition of a situation, especially among the shy children&#x2014;both when there was a repetition of the learning situation (H2a) as well as when the test situation was repeated (H2b). This was because prior research has shown that the repetition of an interaction leads to an environment that becomes more predictable for a child while also increasing familiarity with the situation (<xref ref-type="bibr" rid="B15">Bruner, 1983</xref>; <xref ref-type="bibr" rid="B59">Rohlfing et&#x20;al., 2016</xref>), and this might result in more positive expressions and minimize children&#x2019;s social discomfort during the interaction (<xref ref-type="bibr" rid="B21">Colonnesi et&#x20;al., 2014</xref>).</p>
</list-item>
<list-item>
<p>3. <bold>(H3)</bold> With regard to children&#x2019;s language learning, we hypothesized that shy children would display lower learning achievements compared to nonshy children. This hypothesis is consistent with work indicating that shy children tend to perform on a lower level when their linguistic knowledge is tested in unfamiliar social situations (<xref ref-type="bibr" rid="B74">Spere et&#x20;al., 2004</xref>; <xref ref-type="bibr" rid="B35">Hilton and Westermann, 2017</xref>). However, if growing familiarity with the testing environment allows shy children to feel more comfortable (<xref ref-type="bibr" rid="B36">Hilton et&#x20;al., 2019</xref>), we expected that in the second test situation, the gap between shy and the nonshy children in displayed learning outcomes would decrease or disappear.</p>
</list-item>
</list>
</p>
</sec>
<sec sec-type="materials|methods" id="s2">
<title>Materials and Methods</title>
<sec id="s2-1">
<title>Participants</title>
<p>Thirty preschool children participated in the study. The data from two children were excluded because they did not participate in all sessions. This left 28 children (11 female, 17 male) aged 4.00&#x2013;5.83&#x2002;years (mean age &#x3d; 4.98, <italic>SD</italic> &#x3d; 0.48) for the final analysis. The children and their parents came from relatively high socioeconomic status backgrounds and were recruited from the wider Paderborn region (North Rhine-Westphalia, Germany). Recruitment was conducted in local kindergartens and libraries or through newspapers and our database of families willing to participate in our research studies. In addition, we assessed the level of parental education. None of the children or the parents had ever seen the robot before the experiment. Prior to their children&#x2019;s participation, parents provided written consent and filled out a questionnaire on their child&#x2019;s general and language development. Criteria for inclusion in the sample were: a) age between 4 and 6&#x2002;years; b) normal general development such as normal sensory and cognitive skills; and 3) no developmental language delays. Additionally, detailed information regarding children&#x2019;s language skills was obtained by measuring their receptive language abilities with a subtest of the standardized SETK 3&#x2013;5 (<xref ref-type="bibr" rid="B33">Grimm et&#x20;al., 2001</xref>) and their expressive vocabulary with the AWST-R (<xref ref-type="bibr" rid="B42">Kiese-Himmel, 2005</xref>). Parents were present during all interactions, but did not participate actively in the interaction. Children also provided verbal assent prior to taking part in the interaction, and the interaction could be discontinued at any time at no disadvantage to the child. Moreover, each child received stickers and a toy to thank them for their participation.</p>
</sec>
<sec id="s2-2">
<title>Experimental Procedure</title>
<p>The children and their parents were invited to visit our laboratory at Paderborn University for four sessions within a period of two weeks. Each session lasted around 20&#x2013;35&#x2002;min, and all sessions were recorded on video. Each participating child was accompanied by one parent. <xref ref-type="fig" rid="F1">Figure&#x20;1</xref> displays the seating arrangement. The experimenter operated the robot, avoiding any interaction with either parent or child. In addition, parents were instructed to avoid talking to their child during the experimental part of the child&#x2019;s interaction with the social&#x20;robot.</p>
<fig id="F1" position="float">
<label>FIGURE 1</label>
<caption>
<p>Setup of the&#x20;study.</p>
</caption>
<graphic xlink:href="frobt-08-676123-g001.tif"/>
</fig>
<p>Based on previous work and ethical considerations (<xref ref-type="bibr" rid="B85">Vogt et&#x20;al., 2019</xref>; <xref ref-type="bibr" rid="B78">Tolksdorf et&#x20;al., 2020a</xref>; <xref ref-type="bibr" rid="B76">Tolksdorf and Mertens, 2020</xref>), we conducted a warm-up phase with each child and her or his parent before the learning situation with the robot. This introduced the robot to the children in a comfortable way with their caregiver as an available resource (<xref ref-type="bibr" rid="B45">Manner et&#x20;al., 2018</xref>; <xref ref-type="bibr" rid="B78">Tolksdorf et&#x20;al., 2020a</xref>) and reduced the novelty effect (<xref ref-type="bibr" rid="B40">Kanero et&#x20;al., 2018</xref>). During the warm-up, the experimenter first introduced the robot in a powered-off state to the child and parent and explained its functions. For example, it was explained that the robot can talk and move with the help of small motors, because a pilot study had shown that some children were surprised when they heard that the robot&#x2019;s movements were loud. In a second step, children and parents were further familiarized with the capabilities of the robot: The robot introduced itself and performed a short game by imitating animal movements and asking the child, the parent, and the experimenter to repeat the movements. Although the experimenter structured the situation and was the main interaction partner for the child, parental involvement was considered as an important element during the warm-up phase, because prior work has demonstrated that young children may rely on the emotions with which their familiar caregiver interprets the ongoing situation, especially during first encounters with a social robot (<xref ref-type="bibr" rid="B61">Rohlfing et&#x20;al., 2020</xref>; <xref ref-type="bibr" rid="B80">Tolksdorf et&#x20;al., 2021</xref>). After the game was completed, the robot said goodbye for the moment and announced that it had prepared a story that it wanted to share with the child. Subsequently, the experiment started and the script for the first learning situation was launched.</p>
<p>When designing the learning situation, we were guided by theoretical concepts of learning postulating that interaction partners jointly co-construct the communicative situation in a goal-oriented way (<xref ref-type="bibr" rid="B59">Rohlfing et&#x20;al., 2016</xref>; <xref ref-type="bibr" rid="B60">Rohlfing et&#x20;al., 2019</xref>). Therefore, we chose a setting that included activities with which preschoolers are familiar. Specifically, the robot told the child a story that had been created to frame the learning situation. The story contained the plot of the robot&#x2019;s trip to Paderborn University and the things it had seen on its journey. This narrative served as the context in which the children encountered six novel words (color adjectives) during the interaction. The referents of the novel words were presented as pictures hanging on the wall. They were covered by a small cloth, and the robot asked the child to uncover them one by one over the course of the interaction (see <xref ref-type="fig" rid="F2">Figure&#x20;2A</xref>). This context was also chosen because past work has shown that the context of a story is particularly conducive to children&#x2019;s learning of new words (<xref ref-type="bibr" rid="B37">Horst, 2013</xref>; <xref ref-type="bibr" rid="B49">Nachtig&#xe4;ller et&#x20;al., 2013</xref>).</p>
<fig id="F2" position="float">
<label>FIGURE 2</label>
<caption>
<p>The learning situation <bold>(A)</bold> and test situation <bold>(B)</bold>.</p>
</caption>
<graphic xlink:href="frobt-08-676123-g002.tif"/>
</fig>
<p>Furthermore, in order to render the robot&#x2019;s interaction behavior child-oriented and to fulfill the important role of multimodal joint activities (<xref ref-type="bibr" rid="B60">Rohlfing et&#x20;al., 2019</xref>; <xref ref-type="bibr" rid="B76">Tolksdorf and Mertens, 2020</xref>), the robot also performed a number of actions such as accompanying the novel words with pointing gestures to coordinate the child&#x2019;s attention and establish a shared reference. In the same way, the robot coordinated its gaze between the child and the referents of the target words. Additionally, after naming the first four target words, the robot also walked with the child to the two remaining target referents in order to make the situation more natural and to take advantage of the physical presence of the robot (<xref ref-type="bibr" rid="B81">van den Berghe et&#x20;al., 2019</xref>). Once the robot had finished the story, it thanked the child and said goodbye.</p>
<p>Subsequently, in the second and third sessions, a similar learning situation with the robot took place again in which the robot shared the story, and the children were exposed to the novel&#x20;words.</p>
<p>Following the third learning situation in the third session and a 5&#xa0;min break, children&#x2019;s learning achievements were assessed by testing their ability to generalize the acquired knowledge. In this generalization task, comprehension was defined as the child&#x2019;s ability to extend or transfer the target words to new objects, and whether they were able to transfer the learned pattern of word formation to new colors when presented with separated units of a compound. This method ensured assessment of whether the children were able to transfer their knowledge to other objects and whether their knowledge was stable. We used a routinized activity for children and embedded the test procedure within a shared picture book reading situation (<xref ref-type="bibr" rid="B34">Grimminger and Rohlfing, 2017</xref>). In this test, the child was asked to turn the pages while the robot talked about the pictures with the child and elicited the trained words (see <xref ref-type="fig" rid="F2">Figure&#x20;2B</xref>).</p>
<p>Two to three days later, the last, fourth session was conducted, in which a delayed test using the same procedure was administered to assess the children&#x2019;s knowledge&#x20;again.</p>
</sec>
<sec id="s2-3">
<title>Stimuli</title>
<p>Our study used the Nao robot from Softbank Robotics. This is a small, toy-like, humanoid robot used widely in child&#x2013;robot interaction studies (<xref ref-type="bibr" rid="B12">Belpaeme et&#x20;al., 2018</xref>). It is 58&#xa0;cm high with 25 degrees of freedom. Teleoperation was employed to enable the robot to act contingently (<xref ref-type="bibr" rid="B41">Kennedy et&#x20;al., 2017</xref>). We implemented the behaviors in the NAO robot by using <italic>Choregraphe</italic> and used the integrated text-to-speech production of the robot with German language enabled and speech reduced to 85% speed to achieve a more natural pronunciation. The target words imparted by the robot were spoken at a speed of 75% in order to emphasize them verbally. The target items consisted of six morphologically complex words (noun&#x2013;adjective compounds such as &#x201c;quince yellow [<italic>quittengelb</italic>]&#x201d;) that represented different colors as features of different objects. Each item was presented on a picture measuring 14.8 &#xd7; 21.0&#xa0;cm.</p>
</sec>
<sec id="s2-4">
<title>Coding of Children&#x2019;s Behavior</title>
<p>Because we were interested in children&#x2019;s behavior during all the learning and testing situations with the social robot, we followed <xref ref-type="bibr" rid="B20">Colonnesi et&#x20;al. (2013)</xref> and <xref ref-type="bibr" rid="B21">Colonnesi et&#x20;al. (2014)</xref> and coded positive as well as negative reactions with and without signs of aversion such as body or head aversion. Positive behaviors of the children were measured by, for example, smiling identified by raising the corners of the lips, constriction of the eyes, raising of the cheeks, or opening of the mouth. Negative behaviors were frowning or sad facial expressions. When these behaviors were accompanied by an aversion (of gaze, head, and body), they fell into the category of positive or negative expressions of shyness. We measured this behavior across the time period of the interaction during which the robot a) shared the story and taught the new words (learning situation T 1&#x2013;3) and 2) tested the child within the shared picture book situation (Test 1 and Test 2), (see <xref ref-type="fig" rid="F3">Figure&#x20;3</xref>).</p>
<fig id="F3" position="float">
<label>FIGURE 3</label>
<caption>
<p>Sequence of the interaction during sessions and annotated section.</p>
</caption>
<graphic xlink:href="frobt-08-676123-g003.tif"/>
</fig>
<p>We decided to analyze this sequence because, at this stage, all children had already achieved a certain familiarity with the new interaction partner, and our focus was on investigating development across different sessions. Additionally, the analyzed sequence represented the main part of the interaction, whereas a welcome or farewell situation would reflect a different social situation with its own contextually appropriate social behaviors (<xref ref-type="bibr" rid="B82">Vaughn and La Greca, 1992</xref>). Examining this sequence is particularly relevant, because it provides an opportunity to understand how shy children interact during a learning situation with a social robot. Because the duration of the interactions varied slightly between children, children&#x2019;s behavior was expressed in proportion per minute. To evaluate coding reliability, two coders independently coded a random subset of 15% of the data. We used Cohen&#x2019;s Kappa to measure the agreement between the coders for positive and negative reactions, expressions of shyness, and children&#x2019;s aversion. The mean Kappa values were between 0.88 and 0.94, indicating a high level of internal consistency.</p>
</sec>
<sec id="s2-5">
<title>Assessment of Naming Performance</title>
<p>Following recent methodological accounts (<xref ref-type="bibr" rid="B58">Rohlfing and Grimminger, 2019</xref>), we chose to assess children&#x2019;s word-learning performance in detail on different linguistic layers rather than in a binary way (e.g., only correct or incorrect). To provide a measure of word learning, we created a composite score by averaging each of the children&#x2019;s naming performances in percentages on a phonological, morphosyntactic, and pragmatic&#x2013;semantic level. Thus, on a phonological level, we calculated the proportion of correctly produced syllables of a target word. On a morphosyntactic level, and independent of the semantic meaning, we assessed the sophistication with which the children constructed a noun&#x2013;adjective compound and distinguished between no compounding, partial compounding, and fully correct compounding. Finally, we evaluated each child&#x2019;s response on a pragmatic&#x2013;semantic level, differentiating between no response, a semantically adequate response, a partial retrieval of the target word, and a fully correct retrieval. The maximum composite score that could be achieved in each test session was 3, which would reflect a fully accurate performance on each of the three linguistic levels.</p>
</sec>
<sec id="s2-6">
<title>Assessment of Shyness and Shyness Questionnaire</title>
<p>To assess the children&#x2019;s degree of shyness, we used the Inventory on Integrative Assessment of Child Temperament (German: <italic>IKT</italic>&#x2014;<italic>Inventar zur integrativen Erfassung des Kind-Temperaments</italic>, <xref ref-type="bibr" rid="B89">Zentner, 2011</xref>). This is a standardized questionnaire that is widely used in clinical practice and is specifically designed for the age group addressed. The IKT has been validated with a normative sample of over 4,400 children, possesses convergent validity with equivalent English-language temperament diagnostics (e.g., the CBQ by <xref ref-type="bibr" rid="B62">Rothbart et&#x20;al., 2001</xref>), and measures the temperament of 2- to 8-year-olds on five levels based on the integrative approach of <xref ref-type="bibr" rid="B88">Zentner and Bates (2008)</xref>. With their approach, the authors pursue the goal of overcoming the manifold conceptions of child temperament research and providing a questionnaire that is valid across theories (<xref ref-type="bibr" rid="B88">Zentner and Bates, 2008</xref>). The levels comprise shyness (behavioral inhibition), susceptibility to frustration, activity level, attention span/task persistence and perceptual sensitivity. In our study, caregivers were asked during the first session (T1) to fill out the questionnaire and to estimate how often their child shows a described behavior using a 6-point Likert scale ranging from 1 (<italic>never</italic>) to 6 (<italic>always</italic>). This included behavioral aspects such as &#x201c;hides behind her mother when she meets strangers.&#x201d; Based on the raw scores obtained from the responses to the questions, the evaluation procedure of the test requires a conversion into percentile ranks to allow an adequate interpretation of the child&#x2019;s temperament according to age and gender in relation to the normative sample of the test. The higher the percentile rank value, the shyer the child, with the minimum and maximum value being 0 and 100 respectively. In this vein, the IKT allows children to be considered as notably shy if they have a clearly above-average score of over 75. Additionally, the shyness scale used in the test procedure provides a good internal consistency (<italic>&#x3b1;</italic> &#x3d; 0.81). In the normative sample, the agreement of both parents as a measure of interrater reliability was clearly above average (<italic>r</italic>&#x20;&#x3d; 0.73) and thus highest on the shyness level compared to the other levels (<xref ref-type="bibr" rid="B89">Zentner, 2011</xref>). Finally, in accordance with the evaluation procedure and based on the percentile ranks obtained, we grouped our sample into two levels: nonshy (<italic>n</italic>&#x20;&#x3d; 18) and shy (<italic>n</italic>&#x20;&#x3d;&#x20;10).</p>
</sec>
</sec>
<sec sec-type="results" id="s3">
<title>Results</title>
<p>
<xref ref-type="table" rid="T1">Table&#x20;1</xref> presents an overview of all demographic data as well as the group means and standard deviations of the language and temperament measures.</p>
<table-wrap id="T1" position="float">
<label>TABLE 1</label>
<caption>
<p>Mean participant characteristics for shy and nonshy children and standard deviation (SD).</p>
</caption>
<table>
<thead valign="top">
<tr>
<th rowspan="2" align="left">Independent variable</th>
<th colspan="2" align="center">Total (<italic>N</italic>&#x20;&#x3d; 28)</th>
</tr>
<tr>
<th align="center">Nonshy (<italic>n</italic>&#x20;&#x3d; 18)</th>
<th align="center">Shy (<italic>n</italic>&#x20;&#x3d; 10)</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left">Age in years</td>
<td align="center">
<italic>5.0 (0.5)</italic>
</td>
<td align="center">
<italic>5.0 (0.4)</italic>
</td>
</tr>
<tr>
<td align="left">Parental education level<xref ref-type="table-fn" rid="Tfn1">
<sup>1</sup>
</xref>
</td>
<td align="center">4.7 (<italic>1.0</italic>)</td>
<td align="center">
<italic>4.1 (1.3)</italic>
</td>
</tr>
<tr>
<td align="left">Gender</td>
<td align="left"/>
<td align="left"/>
</tr>
<tr>
<td align="left">&#x2003;Female</td>
<td align="center">7 (39%)</td>
<td align="center">4 (40%)</td>
</tr>
<tr>
<td align="left">&#x2003;Male</td>
<td align="center">11 (61%)</td>
<td align="center">6 (60%)</td>
</tr>
<tr>
<td align="left">SETK 3&#x2013;5 sentence comprehension<xref ref-type="table-fn" rid="Tfn2">
<sup>2</sup>
</xref>
</td>
<td align="center">53.9 (<italic>8.2</italic>)</td>
<td align="center">46.3 (<italic>8.3</italic>)</td>
</tr>
<tr>
<td align="left">AWST-R expressive vocabulary</td>
<td align="center">60.1 (<italic>11.8</italic>)</td>
<td align="center">51.9 (<italic>10.6</italic>)</td>
</tr>
<tr>
<td align="left">IKT shyness score<xref ref-type="table-fn" rid="Tfn2">
<sup>2</sup>
</xref>
</td>
<td align="center">40.4 (<italic>24</italic>)</td>
<td align="center">87.2 (<italic>6.3</italic>)</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn id="Tfn1">
<label>1</label>
<p>Level of parental education on a scale from 1 (<italic>lowest</italic>) to 6 (<italic>highest</italic>).</p>
</fn>
<fn id="Tfn2">
<label>2</label>
<p>Converted raw values into percentile&#x20;ranks.</p>
</fn>
</table-wrap-foot>
</table-wrap>
<sec id="s3-1">
<title>Positive and Negative Shyness Reactions</title>
<p>A statistical analysis of shyness markers was not possible, because values tended toward zero in almost all training and testing periods. Therefore, we focused on analyzing the behavioral markers indicating pleasure and distress described in the following. In the <italic>Limitations</italic> section, we shall discuss some issues that may have led to the very rare occurrence of typical shyness reactions.</p>
</sec>
<sec id="s3-2">
<title>Expression of Pleasure</title>
<p>First, we wanted to know how far positive reactions were more likely in the nonshy group. We also assumed that due to the familiarity of the situation, positive reactions would increase over time in both groups, but especially in the shy group that would start off being more reserved but become more uninhibited over the course of the sessions.</p>
<p>Parametric statistical tests could not be used to analyze this dependent variable due to nonnormally distributed data and the small sample size. Therefore, we used the ANOVA type statistic (ATS)&#x2014;a nonparametric equivalent of a mixed ANOVA (<xref ref-type="bibr" rid="B5">Akritas et&#x20;al., 1997</xref>)&#x2014;performed with the software R (package: nparLD, <xref ref-type="bibr" rid="B50">Noguchi et&#x20;al., 2012</xref>). The ATS is regarded as a distribution-free test, but is mathematically more appropriate than classical rank-sum statistics such as Wilcoxon&#x2019;s rank-sum test. The test statistic is quite similar to ANOVA&#x2019;s <italic>F</italic> tests and exactly meets the <italic>&#x3b1;</italic> level while being conservative. It has been applied in developmental studies (<xref ref-type="bibr" rid="B83">Viertel, 2019</xref>; <xref ref-type="bibr" rid="B80">Tolksdorf et&#x20;al., 2021</xref>). In addition, the ATS can tolerate unequal group sizes in the sample and is robust when studying longitudinal data because it considers their progression over time rather than comparisons between groups at each timepoint that may inflate type I error. The relative treatment effect (RTE) is a measure of the effect size and is estimated based on the actual sample. It can be determined for main effects as well as for interaction effects&#x2014;that is, even for multifactorial designs with repeated measurements (<xref ref-type="bibr" rid="B50">Noguchi et&#x20;al., 2012</xref>) as in the present study. The value of the relative effect RTE ranges between 0 and 1, whereby the occurrence of 0 and 1 means completely different conditions (e.g., for the shy and nonshy group); 0.5 indicates that the conditions do not differ at all (<xref ref-type="bibr" rid="B16">Brunner and Munzel, 2002</xref>; <xref ref-type="bibr" rid="B50">Noguchi et&#x20;al., 2012</xref>).</p>
<p>A significant main effect demonstrated that nonshy children (<italic>Mdn</italic> &#x3d; 1.14, <italic>IQR</italic> &#x3d; 1.67, <italic>RTE</italic> &#x3d; 0.57) used positive behaviors significantly more often than their shy peers (<italic>Mdn</italic> &#x3d; 0.50, <italic>IQR</italic> &#x3d; 1.37, <italic>RTE</italic> &#x3d; 0.37), <italic>F</italic>(1.00, 17.33) &#x3d; 6.51, <italic>p</italic>&#x20;&#x3c; 0.05, regardless of the situation (learning and testing). This supported Hypothesis&#x20;H1a.</p>
<p>Additionally, the ATS revealed a highly significant main effect of time, <italic>F</italic>(3.00, &#x221e;) &#x3d; 7.77, <italic>p</italic>&#x20;&#x3c; 0.001. Positive reactions were highest at the beginning of the training of novel words (T1: <italic>Mdn</italic> &#x3d; 1.71, <italic>IQR</italic> &#x3d; 1.54, <italic>RTE</italic> &#x3d; 0.61), decreased steadily over the course of training (T2: <italic>Mdn</italic> &#x3d; 1.27, <italic>IQR</italic> &#x3d; 1.06, <italic>RTE</italic> &#x3d; 0.56; T3: <italic>Mdn</italic> &#x3d; 0.63, <italic>IQR</italic> &#x3d; 0.97, <italic>RTE</italic> &#x3d; 0.40), and then remained relatively stable in both tests (Test 1: <italic>Mdn</italic> &#x3d; 0.55, <italic>IQR</italic> &#x3d; 1.15, <italic>RTE</italic> &#x3d; 0.39; Test 2: <italic>Mdn</italic> &#x3d; 0.60, <italic>IQR</italic> &#x3d; 1.03, <italic>RTE</italic> &#x3d; 0.40). Post hoc tests were applied with Bonferroni corrections. A significant decrease of positive reactions was detected from training T1 to Test 1 (difference &#x3d; 34.0) and Test 2 (difference &#x3d; 38.0) respectively, <italic>&#x3c7;</italic>
<sup>2</sup>(4) &#x3d; 15.86, <italic>p</italic>&#x20;&#x3c; 0.01. In all cases, the critical difference was 33.21. This observed development of positive reactions contradicted Hypotheses H2a and H2b that positive reactions would increase with the repetition of a learning or test situation.</p>
<p>Moreover, contrary to our hypotheses, there was no interaction between time and shyness level, <italic>F</italic>(3.00, &#x221e;) &#x3d; 0.65, <italic>p</italic>&#x20;&#x3d; 0.58. Hence, shy children remained reserved over time by demonstrating fewer positive reactions such as smiles over the course of both the learning and the testing situations.</p>
</sec>
<sec id="s3-3">
<title>Expression of Distress</title>
<p>In a further step, we asked how far the frequency of negative reactions differed between shyness groups and training conditions depending on the time of training and testing situation. We hypothesized that the shy group would show negative reactions more frequently (H1b), but that these would decline more rapidly among the shy group than among the nonshy group in both the training situation (H2a) and the testing situation (H2b). Again, we refrained from using parametric statistics and used the&#x20;ATS.</p>
<p>The ATS revealed a highly significant effect of time, <italic>F</italic>(3.34, &#x221e;) &#x3d; 14.22, <italic>p</italic>&#x20;&#x3c; 0.001. It was evident that negative reactions were stable across the first two training sessions (T1: <italic>Mdn</italic> &#x3d; 0.45, <italic>IQR</italic> &#x3d; 1.04, <italic>RTE</italic> &#x3d; 0.58; T2: <italic>Mdn</italic> &#x3d; 0.51, <italic>IQR</italic> &#x3d; 0.75, <italic>RTE</italic> &#x3d; 0.56), decreased during last training (T3: <italic>Mdn</italic> &#x3d; 0.00, <italic>IQR</italic> &#x3d; 0.32, <italic>RTE</italic>&#x20;&#x3d;&#x20;0.29), briefly increased during the first test (Test 1: <italic>Mdn</italic> &#x3d; 0.57, <italic>IQR</italic> &#x3d; 1.00, <italic>RTE</italic> &#x3d; 0.62), and finally, flattened in the second test (Test 2: <italic>Mdn</italic> &#x3d; 0.19, <italic>IQR</italic> &#x3d; 0.20, <italic>RTE</italic> &#x3d;&#x20;0.35).</p>
<p>There was also a trend toward a significant difference between shyness groups, with shy children (<italic>Mdn</italic> &#x3d; 0.16, <italic>IQR</italic> &#x3d; 0.50, <italic>RTE</italic> &#x3d; 0.42) demonstrating negative reactions less frequently than nonshy children (<italic>Mdn</italic> &#x3d; 0.33, <italic>IQR</italic> &#x3d; 0.64, <italic>RTE</italic> &#x3d; 0.55) in all training and test situations, <italic>F</italic>(1.00, 18.21) &#x3d; 3.33, <italic>p</italic>&#x20;&#x3d; 0.07. Therefore, we rejected Hypothesis&#x20;H1b.</p>
<p>However, both factors need to be interpreted in relation to each other, because there was a significant interaction effect between time and shyness group, <italic>F</italic>(3.34, &#x221e;) &#x3d; 2.58, <italic>p</italic>&#x20;&#x3c; 0.05. Post hoc tests showed that shy children expressed negative reactions less frequently, especially during the second training (<italic>Mdn</italic> &#x3d; 0.24, <italic>IQR</italic> &#x3d; 0.46, <italic>RTE</italic> &#x3d; 0.41) as well as during the second test (<italic>Mdn</italic> &#x3d; 0.12, <italic>IQR</italic> &#x3d; 0.17, <italic>RTE</italic> &#x3d; 0.26) compared to nonshy children (T2: <italic>Mdn</italic> &#x3d; 0.66, <italic>IQR</italic> &#x3d; 1.43, <italic>RTE</italic> &#x3d; 0.71; Test 2: <italic>Mdn</italic> &#x3d; 0.26, <italic>IQR</italic> &#x3d; 0.19, <italic>RTE</italic> &#x3d; 0.45). Differences during training (<italic>W</italic>&#x20;&#x3d; 144.5, <italic>p</italic>&#x20;&#x3c; 0.01, <italic>r</italic>&#x20;&#x3d; &#x2212;0.49) and testing (<italic>W</italic>&#x20;&#x3d; 146.5, <italic>p</italic>&#x20;&#x3c; 0.01, <italic>r</italic>&#x20;&#x3d; &#x2212;0.51) were both very significant. Thus, the result that only shy children showed negative reactions significantly less often when a situation was repeated supported Hypotheses H2a and&#x20;H2b.</p>
<p>Additionally, in the shy group, multiple comparisons across time revealed that negative reactions decreased significantly from first to third training (T1&#x20;<italic>vs.</italic> T3: <italic>&#x3c7;</italic>
<sup>2</sup>(4) &#x3d; 16.17, <italic>p</italic>&#x20;&#x3c; 0.01), with the observed difference of 20.5 exceeding the critical difference of 19.85. In the nonshy group, a significant reduction of negative reactions from T2 to T3 could be identified in the training situations, <italic>&#x3c7;</italic>
<sup>2</sup>(4) &#x3d; 19.34, <italic>p</italic>&#x20;&#x3c; 0.001. The observed difference was 30.5 and thus higher than the critical difference of 26.63. Surprisingly, in the group of nonshy children, there was a significant increase in negative reactions from the last training session (T3) to the first testing session (Test 1) with an observed difference of 29.5. In the shy group, a tendency toward an increase was identified based on the observed difference of 19.5 (critical difference: 19.85). In conclusion, over the course of the training phase for novel words (T1&#x2013;T3), negative reactions decreased in both groups, but this familiarization effect occurred more rapidly in the group of shy children.</p>
<p>Summarizing the frequency of both positive and negative reactions in the learning and test situations, it can be concluded that the group of shy children was generally less expressive compared to the group of less shy&#x20;peers.</p>
</sec>
<sec id="s3-4">
<title>Shyness Score and Condition as Predictors of Word Learning</title>
<p>Finally, we focused on shy children&#x2019;s word learning, which we assumed would be less successful than that of nonshy children&#x2013;&#x2013;but only during the first test session (H3). Children&#x2019;s word learning was measured based on the calculated linguistic composite score (0&#x2013;3) reflecting their performance during the test tasks (cf. section <italic>Assessment of Naming Performance</italic>). As hypothesized, a strong trend could be observed during the first test, and shy children (<italic>Mdn</italic> &#x3d; 0.51, <italic>IQR</italic> &#x3d; 0.36, <italic>range</italic> &#x3d; 0&#x2013;1.52) tended to be less successful in retrieving the taught words than their nonshy peers (<italic>Mdn</italic> &#x3d; 0.64, <italic>IQR</italic> &#x3d; 0.27, <italic>range</italic> &#x3d; 0&#x2013;2.54), <italic>W</italic>&#x20;&#x3d; 122, <italic>p</italic>&#x20;&#x3d; 0.06, <italic>r</italic>&#x20;&#x3d; &#x2212;0.35. Furthermore, also as hypothesized, both groups (shy: <italic>Mdn</italic> &#x3d; 0.48, <italic>IQR</italic> &#x3d; 0.27, <italic>range</italic> &#x3d; 0&#x2013;2.54; nonshy: <italic>Mdn</italic> &#x3d; 0.72, <italic>IQR</italic> &#x3d; 0.72, <italic>range</italic> &#x3d; 0&#x2013;2.06) did not differ significantly in their success at retrieving the words during the second test session (<italic>W</italic>&#x20;&#x3d; 119.5, <italic>p</italic>&#x20;&#x3d; 0.16, <italic>r</italic>&#x20;&#x3d; &#x2212;0.26), which was a repetition of the first test a few days&#x20;later.</p>
<p>Last of all, we wanted to go beyond the dichotomous group comparison and ask how the entire range of the shyness spectrum as an influencing factor predicted a gain in word learning when the children were already familiarized with the experienced testing situation during Test 1. As described, the testing situation took place in two different sessions (Test 1 and Test 2). Thus, we calculated the gain in word learning by measuring the difference scores between the first and the second test as a metric of learning gain. As a predictor variable, we did not use the categories <italic>nonshy</italic> and <italic>shy</italic>, but the calculated percentile ranks taken from the IKT described above (cf. section <italic>Assessment of Shyness and Shyness Questionnaire</italic>) that represented the full shyness spectrum and would allow us to take a closer look at the link between temperamental characteristics and word-learning processes.</p>
<p>Therefore, our hierarchical regression model included the shyness score as a predictor of a gain in word learning (first step). Moreover, when measuring children&#x2019;s word learning, it is known from the literature that existing linguistic knowledge should be taken into account because it contributes to word learning success (<xref ref-type="bibr" rid="B75">Stelmachowicz et&#x20;al., 2004</xref>; <xref ref-type="bibr" rid="B48">McMurray et&#x20;al., 2012</xref>). Therefore, in the second step, we integrated a language measure of children&#x2019;s receptive linguistic abilities (SETK 3&#x2013;5 subtest sentence comprehension, cf. <xref ref-type="table" rid="T1">Table&#x20;1</xref>).</p>
<p>In Step 1, the model did not differ significantly from zero, <italic>F</italic>(1, 26) &#x3d; 2.72, <italic>p</italic>&#x20;&#x3d; 0.11, with shyness level accounting for 9.48% of the variance in learning gain. In Step 2, the model approached statistical significance and accounted for an increased portion of gain in word learning, <italic>F</italic>(2, 25) &#x3d; 3.18, <italic>p</italic>&#x20;&#x3d; 0.06, and could explain 20.28% of the variance. Shyness scores related significantly to a gain in word learning (<italic>B</italic>&#x20;&#x3d; 0.005, <italic>t</italic>&#x20;&#x3d; 2.18, <italic>p</italic>&#x20;&#x3d; 0.04) and uniquely contributed 14.63% to the total variance of our dependent variable (see <xref ref-type="fig" rid="F4">Figure&#x20;4</xref>). The shyer the children were, the higher their growth of learning as suggested by the significant positive semipartial correlation (<italic>r</italic>&#x20;&#x3d; 0.38, <italic>p</italic>&#x20;&#x3d; 0.05). In terms of receptive linguistic abilities, we detected a nonsignificant trend (<italic>B</italic>&#x20;&#x3d; 0.01, <italic>t</italic>&#x20;&#x3d; 1.84, <italic>p</italic>&#x20;&#x3d; 0.08) toward a positive association between children&#x2019;s receptive language and word learning gain (<italic>r</italic>&#x20;&#x3d; 0.33, <italic>p</italic>&#x20;&#x3d; 0.09), whereas language abilities independently accounted for 10.96% of the variance. A comparison of both models confirmed that in Step 2, <italic>R</italic>
<sup>2</sup> tended to change, <italic>F</italic>(1, 25) &#x3d; 3.38, <italic>p</italic>&#x20;&#x3d;&#x20;0.08.</p>
<fig id="F4" position="float">
<label>FIGURE 4</label>
<caption>
<p>Scatterplot with linear regression line (including 95% confidence interval) illustrating the predictive relation between level of shyness and gain in word learning (difference scores of word learning between T2 and T1). Receptive linguistic skills are integrated as converted percentile&#x20;ranks.</p>
</caption>
<graphic xlink:href="frobt-08-676123-g004.tif"/>
</fig>
<p>Finally, we checked whether other factors, which had not been considered in the multiple regression model before, were associated with word learning. Neither age (<italic>r</italic>&#x20;&#x3d; 0.12, <italic>p</italic>&#x20;&#x3d; 0.27, one-sided) nor expressive vocabulary collected by the AWST-R (<italic>r &#x3d;</italic> &#x2212;0.02, <italic>p</italic>&#x20;&#x3d; 0.55, one-sided) related significantly to a gain in word learning. In summary, this means that shy children showed greater gains in word learning than children who were less to moderately shy, but only when their receptive skills were considered in the model as&#x20;well.</p>
</sec>
</sec>
<sec sec-type="discussion" id="s4">
<title>Discussion</title>
<p>The present study examined how shy children, compared to nonshy children, enter into and maintain social interaction with a social robot during a word-learning educational setting, and how children&#x2019;s learning outcomes relate to their temperament. The study was motivated by previous research suggesting that shy children exhibit marked differences in their learning and social behavior toward interaction partners including social robots. In this respect, the contribution of our study is twofold: First, despite the importance of shy children&#x2019;s familiarization with a situation (<xref ref-type="bibr" rid="B30">Evans, 2001</xref>; <xref ref-type="bibr" rid="B57">Rimm-Kaufman and Kagan, 2005</xref>; <xref ref-type="bibr" rid="B7">Arbeau et&#x20;al., 2010</xref>), we could not find any research investigating the behavior of shy children over a long-term interaction with a social robot. Therefore, we systematically assessed children&#x2019;s personality trait of shyness and investigated their behavior. More specifically, we specified markers of shyness and their signals of pleasure and distress toward the robot during multiple learning situations and during repeat testing situations in which children&#x2019;s learning was evaluated. Second, this study expands previous research by identifying different learning trajectories linked to the effects of shyness on children&#x2019;s learning performance. Whereas some work in human&#x2013;human interaction indicates that shy children tend to perform more poorly in unfamiliar test procedures (<xref ref-type="bibr" rid="B74">Spere et&#x20;al., 2004</xref>; <xref ref-type="bibr" rid="B35">Hilton and Westermann, 2017</xref>), findings on the impact of shyness on learning outcomes in the field of child&#x2013;robot interaction are scarce.</p>
<p>Overall, results show that shy children not only interact differently with a robot compared to nonshy children, but also change their behavior over the course of the sessions. In fact, shy children interacted significantly less expressively with the robot in general. With regard to children&#x2019;s learning outcomes, shy children tended to score significantly lower on the first test, although they were able to close this gap during the second test, resulting in all children retrieving the learned words on a similar level. Surprisingly, we could even observe that once a certain familiarization with the test procedure was established, shyness related significantly to a gain in word learning when the receptive linguistic abilities were taken into account at the same time. In the following subsections, we shall interpret our findings one at a&#x20;time.</p>
<sec id="s4-1">
<title>Children&#x2019;s Expressions of Pleasure and Distress Toward the Robot</title>
<p>As expected, and in accordance with previous literature (<xref ref-type="bibr" rid="B55">Reddy, 2000</xref>; <xref ref-type="bibr" rid="B54">Putnam et&#x20;al., 2006</xref>; <xref ref-type="bibr" rid="B31">Feinberg et&#x20;al., 2012</xref>; <xref ref-type="bibr" rid="B1">Abe et&#x20;al., 2014</xref>; <xref ref-type="bibr" rid="B85">Vogt et&#x20;al., 2019</xref>; <xref ref-type="bibr" rid="B79">Tolksdorf et&#x20;al., 2020b</xref>), we found that shy children were more reserved in their positive reactions toward the robot compared to their nonshy peers in all learning and testing situations. This lower level of positive reactions could be explained by the typical expressive pattern of shyness in novel social situations (<xref ref-type="bibr" rid="B55">Reddy, 2000</xref>; <xref ref-type="bibr" rid="B21">Colonnesi et&#x20;al., 2014</xref>)&#x2014;that is, shy children tend to display reduced emotional reactions and be more inhibited in unfamiliar social interactions (<xref ref-type="bibr" rid="B53">Poole and Schmidt, 2019</xref>). Surprisingly, we did not find support for our hypothesis that the number of positive reactions would increase with the repetition of a situation and increasing familiarity. Instead, our results revealed an opposite trend. Overall, the frequency of occurrences of positive reactions was most pronounced in the first two learning situations and then decreased steadily, reaching its lowest level in the final two test situations. With regard to the nonshy children, the results might be explained by the fact that precisely the novelty of the situation (e.g., the novel interaction partner and storytelling setting as suggested in <xref ref-type="bibr" rid="B40">Kanero et&#x20;al., 2018</xref>) led to higher levels of engagement that were reflected in more positive reactions. In this vein, our results corroborate existing research in the area of child&#x2013;robot interaction demonstrating that with the increasing duration of an interaction and repetitive behavior of a robot, children&#x2019;s engagement in terms of enjoyment could drop (<xref ref-type="bibr" rid="B28">de Wit et&#x20;al., 2020</xref>). Thus, the repeated sessions with the robot might have led to a habituation effect and resulted in decreasing positive reactions. However, we could not observe a significant change in the expressiveness of the shy children&#x2019;s positive reactions over the course of the sessions, suggesting that their display of enjoyment of the situation remained constant on a low level, even during the learning situations.</p>
<p>Regarding the negative reactions as an expression of discomfort in a new situation, results show that behaviors such as frowning or narrowing the eyes reduced significantly more quickly over time in the group of shy children, probably due to the fact that they had become accustomed to the learning and testing situation. In particular, when the shy children were already familiarized with a specific setting (first learning situation or first test), reactions of distress were significantly lower in comparison to nonshy children. A decrease in reactions of distress also occurred in the nonshy children&#x2013;but at a slower rate. In addition, in the latter group, the significant increase in negative reactions stood out when the setting (from learning to testing) and the associated demands on the children changed.</p>
<p>This finding has strong implications not only for studies evaluating social robots as interaction partners in educational settings, but also for studies examining word learning processes or other cognitive abilities in young children in general. Negative reactions (of distress) relate positively to general and social anxiety (<xref ref-type="bibr" rid="B21">Colonnesi et&#x20;al., 2014</xref>), and negative shy reactions are associated with physiological changes that can activate the fight-or-flight system (<xref ref-type="bibr" rid="B23">Colonnesi et&#x20;al., 2020</xref>) that consequently inhibit adaptive behavior and cognitive processes. During learning with others, they are often inhibited, which is reflected in deviant attentional processes (<xref ref-type="bibr" rid="B36">Hilton et&#x20;al., 2019</xref>) as well as infrequent eye gaze to the other (<xref ref-type="bibr" rid="B54">Putnam et&#x20;al., 2006</xref>). Thus, in our view, a warm-up that usually takes place a few minutes before the training or testing may not be sufficient for a specific population such as very shy children. Considering the fact that especially nonshy children expressed the highest proportion of reactions of distress during the first two learning sessions (T1 and T2), our conclusion is not exclusively of relevance for shy children, but also for children with different temperament traits.</p>
</sec>
<sec id="s4-2">
<title>Children&#x2019;s Word Learning</title>
<p>Our third hypothesis addressed how word learning in shy children differs from that in their nonshy peers at different time points. Motivated by the literature (<xref ref-type="bibr" rid="B35">Hilton and Westermann, 2017</xref>), we assumed that shy children would be less successful at retrieving the learned words than nonshy children, especially in the first test situation. We further hypothesized that the difference between groups would decline during the second test due to familiarization with the test procedure. At first impression, the performance of both shy and nonshy children in the word learning tests seems to be in line with our hypothesis, because in both tests, shy children were less successful in retrieving the trained words. Although the difference was marginally significant in the first test session, it disappeared in the second session. However, we considered that a further, more nuanced approach was needed, because there could be legitimate objections to our categorization into shy and nonshy. In particular, because children who were not at all shy fell into the same category as children who were on the threshold of being very shy (according to the questionnaire), we regarded our dichotomization as not being precise enough. Therefore, we conducted a regression analysis to determine the relation between the degree of shyness and word learning. Moreover, our multilevel model also took into account the children&#x2019;s linguistic knowledge, and we were able to show that, in addition to a shy temperament, the children&#x2019;s receptive abilities also tend to contribute to a success in word learning. Surprisingly, past studies on learning words with shy children (<xref ref-type="bibr" rid="B35">Hilton and Westermann, 2017</xref>; <xref ref-type="bibr" rid="B36">Hilton et&#x20;al., 2019</xref>) or language learning studies with robots (<xref ref-type="bibr" rid="B85">Vogt et&#x20;al., 2019</xref>) have not considered these linguistic abilities; therefore, our study marks another novelty in this&#x20;field.</p>
<p>Interestingly, the children who were the shyest according to their parents made the largest gains in word learning, whereas those with the lowest shyness scores remained stable or even scored lower on the second test. This contrasts with results obtained in studies concluding that shy children are a) less likely to learn and retain new words (<xref ref-type="bibr" rid="B35">Hilton and Westermann, 2017</xref>) or b) have poorer productive vocabularies (e.g., <xref ref-type="bibr" rid="B27">Crozier and Hostettler, 2003</xref>). Additionally, these prior studies drew their findings from a single test&#x2014;that is, word learning or vocabulary of shy children is typically assessed in a new environment with unknown people without any prior familiarization with the situation. This raises the question whether the shy children&#x2019;s test performance would be similar to that of nonshy children if they were already familiar with the situation (as realized in our study). As described above, shy children are afraid of being evaluated in unfamiliar situations, which consequently inhibits their performance, as evidenced by studies that a) examine vocabulary less invasively, for example by parents or in familiar school settings (<xref ref-type="bibr" rid="B73">Spere and Evans, 2009</xref>); or 2) in more anonymous group settings (<xref ref-type="bibr" rid="B27">Crozier and Hostettler, 2003</xref>); but also by studies that 3) determine the receptive vocabulary (<xref ref-type="bibr" rid="B29">Evans, 1996</xref>). These studies conclude that the linguistic performance of shy children does not differ from that of nonshy children. Therefore, based on our data, we assume that the shy children were more confident during the second testing and verbally expressed themselves more often once they were familiarized with the exact procedure and the demands of the test situation.</p>
<p>As well as the repetition of the testing situation, another possible reason could contribute to a short familiarization: the pragmatic frame of the situation of joint book reading that is structurally anchored in the test situation (<xref ref-type="bibr" rid="B59">Rohlfing et&#x20;al., 2016</xref>). Accordingly, we can assume that the test situation recedes into the background or is not perceived as such by the children, so that their cognitive abilities can unfold (<xref ref-type="bibr" rid="B59">Rohlfing et&#x20;al., 2016</xref>). Additionally, because our robot was introduced as a coequal peer (<xref ref-type="bibr" rid="B43">Kory Westlund et&#x20;al., 2016</xref>; <xref ref-type="bibr" rid="B84">Vogt et&#x20;al., 2017</xref>), it might not be perceived as an authoritative character, as other examiners are often perceived to be by shy children, but rather as an interaction partner who elicits learned words or, in general, verbal responses in a familiar situation. Therefore, shy children may feel less evaluated during an interaction with a robot, especially in terms of their performance, and this could lead them to be less cognitively inhibited and more confident when attempting to guess an answer.</p>
</sec>
</sec>
<sec id="s5">
<title>Limitations</title>
<p>Finally, it is worth discussing why shyness markers appeared so rarely during training and testing that we were unable to carry out any analysis on this basis, but instead concentrated on behaviors expressing the children&#x2019;s emotionality of pleasure and distress but without any aversion. In 4-year-olds, state shyness is measured differently than in our study: Children are asked to sing a song on a stage in an unfamiliar location in front of a small group of strangers and their caregivers&#x2013;&#x2013;the so-called performance task (<xref ref-type="bibr" rid="B22">Colonnesi et&#x20;al., 2017</xref>). This scenario differs clearly from our setting in which the child is neither required to perform nor is her performance exposed to the other&#x2019;s attention. Hence, one objection might therefore be that the setting applied in our study failed to elicit shy reactions (<xref ref-type="bibr" rid="B21">Colonnesi et&#x20;al., 2014</xref>). On the other hand, many factors triggering shyness reactions existed in our setting such as unknown interaction partners (and among them a robot), a new situation with novel words in an unfamiliar location, and the recall of a previously taught object of learning. Interestingly, the age of the children, which ranged from 48 to 70&#x2002;months, may have contributed to the fact that (in particular negative) shyness reactions were rare&#x2013;even in shy children. In this context, <xref ref-type="bibr" rid="B23">Colonnesi et&#x20;al. (2020, p. 49)</xref> discuss their results with 72-month-olds: &#x201c;A possible explanation is that later individual socio-cognitive development (e.g., advanced social cognition, social skills) and effortful control are responsible for less frequent and more regulated shy reactions.&#x201d; Instead, preschoolers express their shyness by reactions of distress and avoidance as well as ambivalence in their behavior&#x2013;a pattern we were able to identify in our study as well. In this respect, <xref ref-type="bibr" rid="B21">Colonnesi et&#x20;al. (2014)</xref> demonstrated that positive and negative reactions correlated positively with the corresponding shyness markers, thus concluding that they represent expressions of the same emotion but with a different emotional valence. In this context, it should be emphasized that we used a parental assessment of trait shyness based on a questionnaire. We regarded this as being the most reliable and valid for our study design rather than concentrating merely on state shyness measured in a specific situation. Finally, it is also important to recognize that one limitation of this study is its relatively small sample size. However, we wish to highlight that according to recent methodological findings, conducting long-term studies with small samples over multiple sessions while repeatedly measuring the variable of interest over time enhances replicability and robustness (<xref ref-type="bibr" rid="B71">Smith and Little, 2018</xref>). In this vein, the approach adopted here allows a particularly nuanced view of children&#x2019;s behavioral development. Additionally, the statistical procedures used were rather conservative in terms of determining significant effects and tolerant of both small sample sizes and unequal groups (<xref ref-type="bibr" rid="B50">Noguchi et&#x20;al., 2012</xref>). Lastly, although the sample size used is consistent with previous studies utilizing a similar paradigm (<xref ref-type="bibr" rid="B47">McGregor et&#x20;al., 2009</xref>) and we found clear differences between groups, more research is needed to further validate our findings.</p>
</sec>
<sec id="s6">
<title>Conclusions and Future Considerations</title>
<p>In conclusion, the results presented here offer new input for not only research with social robots in educational settings and the design of future learner&#x2013;robot interactions but also for evaluating and measuring children&#x2019;s achieved learning outcomes. In fact, most past research in child&#x2013;robot interaction has tested hypotheses by comparing average effects across the sample but ignored that effects may vary across individuals depending on existing intrinsic factors such as shyness. In this vein, the present study provides evidence that shy children do indeed demonstrate a distinctive behavior in terms of their interactions with a robot as well as their language learning. Our findings show that it is important to include the learner&#x2019;s temperamental characteristics, such as shyness, during child&#x2013;robot interactions to inform the use of robots in the educational field. In this regard, current research strongly suggests the need to consider children&#x2019;s temperament in everyday practice in institutional settings such as kindergarten or school and provide a supportive climate for a variety of children and temperament types (<xref ref-type="bibr" rid="B6">Ann Sealy et&#x20;al., 2021</xref>). Whereas approaches to automatically assessing a child&#x2019;s personality based on predefined behavioral traits have made substantial progress (<xref ref-type="bibr" rid="B2">Abe et&#x20;al., 2017</xref>; <xref ref-type="bibr" rid="B3">Abe et&#x20;al., 2020</xref>; <xref ref-type="bibr" rid="B66">Sano et&#x20;al., 2020</xref>), the present study has taken first steps to determine which behaviors can actually be observed in shy children and how they develop in the long term over a period of several sessions.</p>
<p>From our results, we can derive some crucial aspects for designing future interactions with child-oriented social robots: On the one hand, testing shy children requires a greater familiarity with the situation, and this can be achieved by a prior acquaintance with the interaction partner, the location, and the items. For example, an extended warm-up session in advance of a learning <italic>and</italic> testing situation could be a solution in future interaction designs. This could be conducted individually in addition to carrying out an introduction in a group of children. Additionally, based on our data, we also suggest that future studies examining learning processes such as word learning should create scenarios in which children are tested at multiple time points, because this allows for a more precise focus on the specific learning processes, especially in shy children. On the other hand, given the high incidence of shyness as a normal variation in human personality in the overall population (<xref ref-type="bibr" rid="B90">Zimbardo et&#x20;al., 1975</xref>; <xref ref-type="bibr" rid="B39">Kagan, 1994</xref>; <xref ref-type="bibr" rid="B68">Schmidt et&#x20;al., 2020</xref>), our results also demonstrate that a nuanced assessment of shyness (e.g., parental assessment via a standardized questionnaire) is preferable, especially when it is central to the research question. In this vein, it is worth noting that temperamental characteristics are rarely collected in studies, and tests assessing children&#x2019;s linguistic and cognitive abilities are often administered by (almost) unfamiliar interaction partners.</p>
<p>We postulate that addressing children&#x2019;s individual differences and taking into account the personality of the interacting child can further guide future digital technologies and facilitate their integration into the educational landscape. However, at this point, we would like to be clear in our objective: We also see it as an ethical challenge to clarify whether future technologies should make automatic inferences about a child&#x2019;s temperament. Instead, it is important to gain further insights into how children&#x2019;s interactions with digital technologies such as social robots depend on their individual differences in order to enable educators and teachers to design future learning scenarios that allow all children to participate.</p>
<p>In future work, it would also be of interest to explore the effects of other dimensions of temperamental traits on interaction behavior such as susceptibility to frustration or attention span/task persistence. This would shed further light on how individual adaptation to the learner and appropriate learning environments can be designed in the digital world of the future.</p>
</sec>
</body>
<back>
<sec id="s7">
<title>Data Availability Statement</title>
<p>Based on the options within consent to future reuse of their data by other researcher that was given by the caregivers, the datasets presented in this article are not readily available and will not be made publicly available. Requests to access the datasets should be directed to Nils F. Tolksdorf, <ext-link ext-link-type="uri" xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="http://nils.tolksdorf@upb.de">nils.tolksdorf@upb.de</ext-link>.</p>
</sec>
<sec id="s8">
<title>Ethics Statement</title>
<p>The studies involving human participants were reviewed and approved by Review Board of Bielefeld University (EUB 2014-043). Written informed consent to participate in this study was provided by the participants&#x2019; legal guardian/next of kin. Written informed consent was obtained from the individual(s), and minor(s)&#x2019; legal guardian/next of kin, for the publication of any potentially identifiable images or data included in this article.</p>
</sec>
<sec id="s9">
<title>Author Contributions</title>
<p>NT, FV, and KR conceived the study. NT and KR designed, and piloted the study. NT recruited participants. NT conducted the data collection. FV analyzed the data. NT, FV, and KR drafted the manuscript. All authors commented on, edited, and revised the manuscript prior to submission.</p>
</sec>
<sec id="s10">
<title>Funding</title>
<p>This research was supported by the Digital Society research program funded by the Ministry of Culture and Science of the German State of North Rhine-Westphalia and the research fund of the Faculty of Arts and Humanities of Paderborn University.</p>
</sec>
<sec sec-type="COI-statement" id="s11">
<title>Conflict of Interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<ack>
<p>We gratefully thank all the parents and children who participated in this study. We also thank our research assistants, Theresa Trieu and Dirk H&#x00F6;nemann, who were involved in the data annotation.</p>
</ack>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Abe</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Hieida</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Attamimi</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Nagai</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Shimotomai</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Omori</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Oka</surname>
<given-names>N.</given-names>
</name>
</person-group> (<year>2014</year>). &#x201c;<article-title>Toward playmate robots that can play with children considering personality</article-title>,&#x201d; in <italic>Proceedings of the second international conference on Human-agent interaction</italic> (<publisher-loc>Tsukuba Japan</publisher-loc>: <publisher-name>ACM)</publisher-name>, <fpage>165</fpage>&#x2013;<lpage>168</lpage>. <pub-id pub-id-type="doi">10.1145/2658861.2658913</pub-id> </citation>
</ref>
<ref id="B2">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Abe</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Hamada</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Nagai</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Shiomi</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Omori</surname>
<given-names>T.</given-names>
</name>
</person-group> (<year>2017</year>). &#x201c;<article-title>Estimation of Child Personality for Child-Robot Interaction</article-title>,&#x201d; in <italic>2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN)</italic>. (<publisher-loc>Lisbon</publisher-loc>: <publisher-name>IEEE</publisher-name>). <fpage>910</fpage>&#x2013;<lpage>915</lpage>. <pub-id pub-id-type="doi">10.1109/ROMAN.2017.8172411</pub-id> </citation>
</ref>
<ref id="B3">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Abe</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Nagai</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Hieida</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Omori</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Shiomi</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Estimating Children&#x27;s Personalities through Their Interaction Activities with a Tele-Operated Robot</article-title>. <source>J.&#x20;Robot. Mechatron.</source> <volume>32</volume>, <fpage>21</fpage>&#x2013;<lpage>31</lpage>. <pub-id pub-id-type="doi">10.20965/jrm.2020.p0021</pub-id> </citation>
</ref>
<ref id="B4">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Addison</surname>
<given-names>T. L.</given-names>
</name>
<name>
<surname>Schmidt</surname>
<given-names>L. A.</given-names>
</name>
</person-group> (<year>1999</year>). <article-title>Are Women Who Are Shy Reluctant to Take Risks? Behavioral and Psychophysiological Correlates</article-title>. <source>J.&#x20;Res. Personal.</source> <volume>33</volume>, <fpage>352</fpage>&#x2013;<lpage>357</lpage>. <pub-id pub-id-type="doi">10.1006/jrpe.1999.2249</pub-id> </citation>
</ref>
<ref id="B5">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Akritas</surname>
<given-names>M. G.</given-names>
</name>
<name>
<surname>Arnold</surname>
<given-names>S. F.</given-names>
</name>
<name>
<surname>Brunner</surname>
<given-names>E.</given-names>
</name>
</person-group> (<year>1997</year>). <article-title>Nonparametric Hypotheses and Rank Statistics for Unbalanced Factorial Designs</article-title>. <source>J.&#x20;Am. Stat. Assoc.</source> <volume>92</volume>, <fpage>258</fpage>&#x2013;<lpage>265</lpage>. <pub-id pub-id-type="doi">10.1080/01621459.1997.10473623</pub-id> </citation>
</ref>
<ref id="B6">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Ann Sealy</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Moritz Rudasill</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>S. Barrett</surname>
<given-names>J.&#x20;J.</given-names>
</name>
<name>
<surname>Eum</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Adams</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Hinrichs</surname>
<given-names>A.</given-names>
</name>
<etal/>
</person-group> (<year>2021</year>). &#x201c;<article-title>Temperament in the Early Elementary Classroom: Implications for Practice</article-title>,&#x201d; in <source>Teacher Education In the 21st Century - Emerging Skills For a Changing World</source>. (<publisher-loc>London, United Kingdom</publisher-loc>: <publisher-name>IntechOpen</publisher-name>). <pub-id pub-id-type="doi">10.5772/intechopen.96270</pub-id> </citation>
</ref>
<ref id="B7">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Arbeau</surname>
<given-names>K. A.</given-names>
</name>
<name>
<surname>Coplan</surname>
<given-names>R. J.</given-names>
</name>
<name>
<surname>Weeks</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2010</year>). <article-title>Shyness, Teacher-Child Relationships, and Socio-Emotional Adjustment in Grade 1</article-title>. <source>Int. J.&#x20;Behav. Dev.</source> <volume>34</volume>, <fpage>259</fpage>&#x2013;<lpage>269</lpage>. <pub-id pub-id-type="doi">10.1177/0165025409350959</pub-id> </citation>
</ref>
<ref id="B8">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Asendorpf</surname>
<given-names>J.&#x20;B.</given-names>
</name>
<name>
<surname>Meier</surname>
<given-names>G. H.</given-names>
</name>
</person-group> (<year>1993</year>). <article-title>Personality Effects on Children&#x27;s Speech in Everyday Life: Sociability-Mediated Exposure and Shyness-Mediated Reactivity to Social Situations</article-title>. <source>J.&#x20;Personal. Soc. Psychol.</source> <volume>64</volume>, <fpage>1072</fpage>&#x2013;<lpage>1083</lpage>. <pub-id pub-id-type="doi">10.1037/0022-3514.64.6.1072</pub-id> </citation>
</ref>
<ref id="B9">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Barker</surname>
<given-names>T. V.</given-names>
</name>
<name>
<surname>Reeb-Sutherland</surname>
<given-names>B. C.</given-names>
</name>
<name>
<surname>Fox</surname>
<given-names>N. A.</given-names>
</name>
</person-group> (<year>2014</year>). <article-title>Individual Differences in Fear Potentiated Startle in Behaviorally Inhibited Children</article-title>. <source>Dev. Psychobiol</source> <volume>56</volume>, <fpage>133</fpage>&#x2013;<lpage>141</lpage>. <pub-id pub-id-type="doi">10.1002/dev.21096</pub-id> </citation>
</ref>
<ref id="B10">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Baxter</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Belpaeme</surname>
<given-names>T.</given-names>
</name>
</person-group> (<year>2016</year>). &#x201c;<article-title>A Cautionary Note on Personality (Extroversion) Assessments in Child-Robot Interaction Studies</article-title>,&#x201d; in <source>2nd Workshop on Evaluating Child-Robot Interaction at HRI&#x2019;16</source> (<publisher-loc>Christchurch, New&#x20;Zealand</publisher-loc>: <publisher-name>ACM</publisher-name>). </citation>
</ref>
<ref id="B11">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Baxter</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Ashurst</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Read</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Kennedy</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Belpaeme</surname>
<given-names>T.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Robot Education Peers in a Situated Primary School Study: Personalisation Promotes Child Learning</article-title>. <source>PLOS ONE</source> <volume>12</volume>, <fpage>e0178126</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0178126</pub-id> </citation>
</ref>
<ref id="B12">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Belpaeme</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Kennedy</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Ramachandran</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Scassellati</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Tanaka</surname>
<given-names>F.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Social Robots for Education: A Review</article-title>. <source>Sci. Robot.</source> <volume>3</volume>, <fpage>eaat5954</fpage>. <pub-id pub-id-type="doi">10.1126/scirobotics.aat5954</pub-id> </citation>
</ref>
<ref id="B13">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Boccanfuso</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Scarborough</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Abramson</surname>
<given-names>R. K.</given-names>
</name>
<name>
<surname>Hall</surname>
<given-names>A. V.</given-names>
</name>
<name>
<surname>Wright</surname>
<given-names>H. H.</given-names>
</name>
<name>
<surname>O&#x2019;Kane</surname>
<given-names>J.&#x20;M.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>A Low-Cost Socially Assistive Robot and Robot-Assisted Intervention for Children with Autism Spectrum Disorder: Field Trials and Lessons Learned</article-title>. <source>Auton. Robot</source> <volume>41</volume>, <fpage>637</fpage>&#x2013;<lpage>655</lpage>. <pub-id pub-id-type="doi">10.1007/s10514-016-9554-4</pub-id> </citation>
</ref>
<ref id="B14">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Breazeal</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Harris</surname>
<given-names>P. L.</given-names>
</name>
<name>
<surname>DeSteno</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Kory Westlund</surname>
<given-names>J.&#x20;M.</given-names>
</name>
<name>
<surname>Dickens</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Jeong</surname>
<given-names>S.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>Young Children Treat Robots as Informants</article-title>. <source>Top. Cogn. Sci.</source> <volume>8</volume>, <fpage>481</fpage>&#x2013;<lpage>491</lpage>. <pub-id pub-id-type="doi">10.1111/tops.12192</pub-id> </citation>
</ref>
<ref id="B15">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Bruner</surname>
<given-names>J.&#x20;S.</given-names>
</name>
</person-group> (<year>1983</year>). <source>Child&#x2019;s Talk: Learning to Use Language</source>. <edition>1st ed.</edition> <publisher-loc>New York</publisher-loc>: <publisher-name>W. W. Norton</publisher-name>.</citation>
</ref>
<ref id="B16">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Brunner</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Munzel</surname>
<given-names>U.</given-names>
</name>
</person-group> (<year>2002</year>). <source>
<italic>Nichtparametrische Datenanalyse: Unverbundene Stichproben (Statistik und ihre Anwendungen)</italic>
</source>. <publisher-loc>Berlin</publisher-loc>: <publisher-name>Springer</publisher-name>. <pub-id pub-id-type="doi">10.1007/978-3-642-56151-1</pub-id> </citation>
</ref>
<ref id="B17">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Calvo-Barajas</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Perugia</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Castellano</surname>
<given-names>G.</given-names>
</name>
</person-group> (<year>2020</year>). &#x201c;<article-title>The effects of robot&#x27;s facial expressions on children&#x27;s first impressions of trustworthiness</article-title>,&#x201d; in <italic>29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)</italic> (<publisher-loc>Naples, Italy</publisher-loc>: <publisher-name>IEEE</publisher-name>). <fpage>165</fpage>&#x2013;<lpage>171</lpage>. <pub-id pub-id-type="doi">10.1109/RO-MAN47096.2020.9223456</pub-id> </citation>
</ref>
<ref id="B18">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Cao</surname>
<given-names>H.-L.</given-names>
</name>
<name>
<surname>Esteban</surname>
<given-names>P. G.</given-names>
</name>
<name>
<surname>Bartlett</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Baxter</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Belpaeme</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Billing</surname>
<given-names>E.</given-names>
</name>
<etal/>
</person-group> (<year>2019</year>). <article-title>Robot-enhanced Therapy: Development and Validation of Supervised Autonomous Robotic System for Autism Spectrum Disorders Therapy</article-title>. <source>IEEE Robot. Automat. Mag.</source> <volume>26</volume>, <fpage>49</fpage>&#x2013;<lpage>58</lpage>. <pub-id pub-id-type="doi">10.1109/MRA.2019.2904121</pub-id> </citation>
</ref>
<ref id="B19">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Causo</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Vo</surname>
<given-names>G. T.</given-names>
</name>
<name>
<surname>Chen</surname>
<given-names>I.-M.</given-names>
</name>
<name>
<surname>Yeo</surname>
<given-names>S. H.</given-names>
</name>
</person-group> (<year>2016</year>). &#x201c;<article-title>Design of robots used as education companion and tutor</article-title>,&#x201d; in <source>
<italic>Robotics And Mechatronics</italic> Mechanisms and Machine Science</source>. Editors <person-group person-group-type="editor">
<name>
<surname>Zeghloul</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Laribi</surname>
<given-names>M. A.</given-names>
</name>
<name>
<surname>Gazeau</surname>
<given-names>J.-P.</given-names>
</name>
</person-group> (<publisher-loc>Cham</publisher-loc>: <publisher-name>Springer International Publishing</publisher-name>), <fpage>75</fpage>&#x2013;<lpage>84</lpage>. <pub-id pub-id-type="doi">10.1007/978-3-319-22368-1_8</pub-id> </citation>
</ref>
<ref id="B20">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Colonnesi</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>B&#xf6;gels</surname>
<given-names>S. M.</given-names>
</name>
<name>
<surname>de Vente</surname>
<given-names>W.</given-names>
</name>
<name>
<surname>Majdand&#x17e;i&#x107;</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2013</year>). <article-title>What Coy Smiles Say about Positive Shyness in Early Infancy</article-title>. <source>Infancy</source> <volume>18</volume>, <fpage>202</fpage>&#x2013;<lpage>220</lpage>. <pub-id pub-id-type="doi">10.1111/j.1532-7078.2012.00117.x</pub-id> </citation>
</ref>
<ref id="B21">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Colonnesi</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Napoleone</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>B&#xf6;gels</surname>
<given-names>S. M.</given-names>
</name>
</person-group> (<year>2014</year>). <article-title>Positive and Negative Expressions of Shyness in Toddlers: Are They Related to Anxiety in the Same Way?</article-title> <source>J.&#x20;Personal. Soc. Psychol.</source> <volume>106</volume>, <fpage>624</fpage>&#x2013;<lpage>637</lpage>. <pub-id pub-id-type="doi">10.1037/a0035561</pub-id> </citation>
</ref>
<ref id="B22">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Colonnesi</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Nikoli&#x107;</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>de Vente</surname>
<given-names>W.</given-names>
</name>
<name>
<surname>B&#xf6;gels</surname>
<given-names>S. M.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Social Anxiety Symptoms in Young Children: Investigating the Interplay of Theory of Mind and Expressions of Shyness</article-title>. <source>J.&#x20;Abnorm Child. Psychol.</source> <volume>45</volume>, <fpage>997</fpage>&#x2013;<lpage>1011</lpage>. <pub-id pub-id-type="doi">10.1007/s10802-016-0206-0</pub-id> </citation>
</ref>
<ref id="B23">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Colonnesi</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Nikoli&#x107;</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>B&#xf6;gels</surname>
<given-names>S. M.</given-names>
</name>
</person-group> (<year>2020</year>). &#x201c;<article-title>Development and Psychophysiological Correlates of Positive Shyness from Infancy to Childhood</article-title>,&#x201d; in <source>Adaptive Shyness: Multiple Perspectives On Behavior And Development</source>. Editors <person-group person-group-type="editor">
<name>
<surname>Schmidt</surname>
<given-names>L. A.</given-names>
</name>
<name>
<surname>Poole</surname>
<given-names>K. L.</given-names>
</name>
</person-group> (<publisher-loc>Cham</publisher-loc>: <publisher-name>Springer International Publishing</publisher-name>), <fpage>41</fpage>&#x2013;<lpage>61</lpage>. <pub-id pub-id-type="doi">10.1007/978-3-030-38877-5_3</pub-id> </citation>
</ref>
<ref id="B24">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Coplan</surname>
<given-names>R. J.</given-names>
</name>
<name>
<surname>Evans</surname>
<given-names>M. A.</given-names>
</name>
</person-group> (<year>2009</year>). <article-title>At a Loss for Words? Introduction to the Special Issue on Shyness and Language in Childhood</article-title>. <source>Inf. Child. Develop.</source> <volume>18</volume>, <fpage>211</fpage>&#x2013;<lpage>215</lpage>. <pub-id pub-id-type="doi">10.1002/icd.620</pub-id> </citation>
</ref>
<ref id="B25">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Coplan</surname>
<given-names>R. J.</given-names>
</name>
<name>
<surname>Weeks</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2009</year>). <article-title>Shy and Soft-Spoken: Shyness, Pragmatic Language, and Socio-Emotional Adjustment in Early Childhood</article-title>. <source>Inf. Child. Develop.</source> <volume>18</volume>, <fpage>238</fpage>&#x2013;<lpage>254</lpage>. <pub-id pub-id-type="doi">10.1002/icd.622</pub-id> </citation>
</ref>
<ref id="B26">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Crozier</surname>
<given-names>W. R.</given-names>
</name>
<name>
<surname>Badawood</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2009</year>). <article-title>Shyness, Vocabulary and Children&#x27;s Reticence in Saudi Arabian Preschools</article-title>. <source>Inf. Child. Develop.</source> <volume>18</volume>, <fpage>255</fpage>&#x2013;<lpage>270</lpage>. <pub-id pub-id-type="doi">10.1002/icd.623</pub-id> </citation>
</ref>
<ref id="B27">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Crozier</surname>
<given-names>W. R.</given-names>
</name>
<name>
<surname>Hostettler</surname>
<given-names>K.</given-names>
</name>
</person-group> (<year>2003</year>). <article-title>The Influence of Shyness on Children&#x2019;s Test Performance</article-title>. <source>Br. J.&#x20;Educ. Psychol.</source> <volume>73</volume>, <fpage>317</fpage>&#x2013;<lpage>328</lpage>. <pub-id pub-id-type="doi">10.1348/000709903322275858</pub-id> </citation>
</ref>
<ref id="B28">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>de Wit</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Brandse</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Krahmer</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Vogt</surname>
<given-names>P.</given-names>
</name>
</person-group> (<year>2020</year>). &#x201c;<article-title>Varied human-like gestures for social robots</article-title>: Investigating the effects on children&#x27;s engagement and language learning&#x201d; in <italic>Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction</italic> (<publisher-loc>Cambridge United&#x20;Kingdom</publisher-loc>: <publisher-name>ACM</publisher-name>), <fpage>359</fpage>&#x2013;<lpage>367</lpage>. <pub-id pub-id-type="doi">10.1145/3319502.3374815</pub-id> </citation>
</ref>
<ref id="B29">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Evans</surname>
<given-names>M. A.</given-names>
</name>
</person-group> (<year>1996</year>). <article-title>Reticent Primary Grade Children and Their More Talkative Peers: Verbal, Nonverbal, and Self-Concept Characteristics</article-title>. <source>J.&#x20;Educ. Psychol.</source> <volume>88</volume>, <fpage>739</fpage>&#x2013;<lpage>749</lpage>. <pub-id pub-id-type="doi">10.1037/0022-0663.88.4.739</pub-id> </citation>
</ref>
<ref id="B30">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Evans</surname>
<given-names>M. A.</given-names>
</name>
</person-group> (<year>2001</year>). &#x201c;<article-title>Shyness in the Classroom and Home</article-title>,&#x201d; in <source>International Handbook of Social Anxiety: Concepts, Research and Interventions Relating to the Self and Shyness</source>. <publisher-loc>New York, US</publisher-loc>: <publisher-name>John Wiley &#x26; Sons Ltd)</publisher-name>, <fpage>159</fpage>&#x2013;<lpage>183</lpage>. </citation>
</ref>
<ref id="B31">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Feinberg</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Willer</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Keltner</surname>
<given-names>D.</given-names>
</name>
</person-group> (<year>2012</year>). <article-title>Flustered and Faithful: Embarrassment as a Signal of Prosociality</article-title>. <source>J.&#x20;Personal. Soc. Psychol.</source> <volume>102</volume>, <fpage>81</fpage>&#x2013;<lpage>97</lpage>. <pub-id pub-id-type="doi">10.1037/a0025403</pub-id> </citation>
</ref>
<ref id="B32">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Fischer</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Jung</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Jensen</surname>
<given-names>L. C.</given-names>
</name>
<name>
<surname>aus der Wieschen</surname>
<given-names>M. V.</given-names>
</name>
</person-group> (<year>2019</year>). &#x201c;<article-title>Emotion Expression in HRI - when and Why</article-title>,&#x201d; in <italic>14th ACM/IEEE International Conference on Human-Robot Interaction (HRI)</italic> (<publisher-loc>Daegu, Korea (South)</publisher-loc>: <publisher-name>IEEE</publisher-name>), <fpage>29</fpage>&#x2013;<lpage>38</lpage>. <pub-id pub-id-type="doi">10.1109/HRI.2019.8673078</pub-id> </citation>
</ref>
<ref id="B33">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Grimm</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Aktas</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Frevert</surname>
<given-names>S.</given-names>
</name>
</person-group> (<year>2001</year>). <comment>SETK 3 -5: Sprachentwicklungstest f&#x00FC;r drei- bis f&#x00FC;nfj&#x00E4;hrige Kinder </comment>
<publisher-loc>G&#xf6;ttingen</publisher-loc>: <publisher-name>Hogrefe</publisher-name>.</citation>
</ref>
<ref id="B34">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Grimminger</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Rohlfing</surname>
<given-names>K. J.</given-names>
</name>
</person-group> (<year>2017</year>). &#x201c;<article-title>Can You Teach Me?: Children Teaching New Words to a Robot in a Book Reading Scenario</article-title>,&#x201d; in <source>Proc. WOCCI 2017: 6th International Workshop on Child Computer Interaction. (Glasgow: ISCA)</source>, <fpage>28</fpage>&#x2013;<lpage>33</lpage>. <pub-id pub-id-type="doi">10.21437/WOCCI.2017-5</pub-id> </citation>
</ref>
<ref id="B35">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Hilton</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Westermann</surname>
<given-names>G.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>The Effect of Shyness on Children&#x27;s Formation and Retention of Novel Word-Object Mappings</article-title>. <source>J.&#x20;Child. Lang.</source> <volume>44</volume>, <fpage>1394</fpage>&#x2013;<lpage>1412</lpage>. <pub-id pub-id-type="doi">10.1017/S030500091600057X</pub-id> </citation>
</ref>
<ref id="B36">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Hilton</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Twomey</surname>
<given-names>K. E.</given-names>
</name>
<name>
<surname>Westermann</surname>
<given-names>G.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Taking Their Eye off the Ball: How Shyness Affects Children&#x2019;s Attention during Word Learning</article-title>. <source>J.&#x20;Exp. Child Psychol.</source> <volume>183</volume>, <fpage>134</fpage>&#x2013;<lpage>145</lpage>. <pub-id pub-id-type="doi">10.1016/j.jecp.2019.01.023</pub-id> </citation>
</ref>
<ref id="B37">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Horst</surname>
<given-names>J.&#x20;S.</given-names>
</name>
</person-group> (<year>2013</year>). <article-title>Context and Repetition in Word Learning</article-title>. <source>Front. Psychol.</source> <volume>4</volume>, <fpage>1</fpage>&#x2013;<lpage>11</lpage>. <pub-id pub-id-type="doi">10.3389/fpsyg.2013.00149</pub-id> </citation>
</ref>
<ref id="B38">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Ioannou</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Makridou</surname>
<given-names>E.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Exploring the Potentials of Educational Robotics in the Development of Computational Thinking: A Summary of Current Research and Practical Proposal for Future Work</article-title>. <source>Educ. Inf. Technol.</source> <volume>23</volume>, <fpage>2531</fpage>&#x2013;<lpage>2544</lpage>. <pub-id pub-id-type="doi">10.1007/s10639-018-9729-z</pub-id> </citation>
</ref>
<ref id="B39">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Kagan</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>1994</year>). <source>Galen&#x2019;s Prophecy: Temperament in Human Nature</source>. <publisher-loc>New York</publisher-loc>: <publisher-name>Basic Books</publisher-name>.</citation>
</ref>
<ref id="B40">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kanero</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Ge&#xe7;kin</surname>
<given-names>V.</given-names>
</name>
<name>
<surname>Oran&#xe7;</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Mamus</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>K&#xfc;ntay</surname>
<given-names>A. C.</given-names>
</name>
<name>
<surname>G&#xf6;ksun</surname>
<given-names>T.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Social Robots for Early Language Learning: Current Evidence and Future Directions</article-title>. <source>Child. Dev. Perspect.</source> <volume>12</volume>, <fpage>146</fpage>&#x2013;<lpage>151</lpage>. <pub-id pub-id-type="doi">10.1111/cdep.12277</pub-id> </citation>
</ref>
<ref id="B41">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Kennedy</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Lemaignan</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Montassier</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Lavalade</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Irfan</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Papadopoulos</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Senft</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Belpaeme</surname>
<given-names>T.</given-names>
</name>
</person-group> (<year>2017</year>). &#x201c;<article-title>Child speech recognition in human-robot interaction</article-title>,&#x201d; in <italic>Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction</italic> (<publisher-loc>Vienna Austria</publisher-loc>: <publisher-name>ACM)</publisher-name>), <fpage>82</fpage>&#x2013;<lpage>90</lpage>. <pub-id pub-id-type="doi">10.1145/2909824.3020229</pub-id> </citation>
</ref>
<ref id="B42">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Kiese-Himmel</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2005</year>). <article-title>AWST-R-Aktiver Wortschatztest f&#x00FC;r 3- bis 5-j&#x00E4;hrige Kinder </article-title>. <publisher-loc>G&#xf6;ttingen</publisher-loc>: <publisher-name>Beltz Test</publisher-name>. </citation>
</ref>
<ref id="B43">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kory Westlund</surname>
<given-names>J.&#x20;M.</given-names>
</name>
<name>
<surname>Martinez</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Archie</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Das</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Breazeal</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2016</year>). &#x201c;<article-title>Effects of Framing a Robot as a Social Agent or as a Machine on Children&#x2019;s Social Behavior</article-title>,&#x201d; in <conf-name>25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN)</conf-name>, (<publisher-loc>New York, United States</publisher-loc>:<publisher-name>IEEE</publisher-name>), <fpage>688</fpage>&#x2013;<lpage>693</lpage>. <pub-id pub-id-type="doi">10.1109/ROMAN.2016.7745193</pub-id> </citation>
</ref>
<ref id="B44">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Levin</surname>
<given-names>I. P.</given-names>
</name>
<name>
<surname>Hart</surname>
<given-names>S. S.</given-names>
</name>
</person-group> (<year>2003</year>). <article-title>Risk Preferences in Young Children: Early Evidence of Individual Differences in Reaction to Potential Gains and Losses</article-title>. <source>J.&#x20;Behav. Decis. Making</source> <volume>16</volume>, <fpage>397</fpage>&#x2013;<lpage>413</lpage>. <pub-id pub-id-type="doi">10.1002/bdm.453</pub-id> </citation>
</ref>
<ref id="B45">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Manner</surname>
<given-names>M. D.</given-names>
</name>
<name>
<surname>Gini</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Elison</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>&#x201C;Graphically Representing Child-Robot Interaction Proxemics&#x201D;</article-title>, in <conf-name>Workshop on Health Intelligence at AAAI Conference on Artificial Intelligence</conf-name>
</citation>
</ref>
<ref id="B46">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Matsuda</surname>
<given-names>Y.-T.</given-names>
</name>
<name>
<surname>Okanoya</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Myowa-Yamakoshi</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2013</year>). <article-title>Shyness in Early Infancy: Approach-Avoidance Conflicts in Temperament and Hypersensitivity to Eyes during Initial Gazes to Faces</article-title>. <source>PLoS ONE</source> <volume>8</volume>, <fpage>e65476</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0065476</pub-id> </citation>
</ref>
<ref id="B47">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>McGregor</surname>
<given-names>K. K.</given-names>
</name>
<name>
<surname>Rohlfing</surname>
<given-names>K. J.</given-names>
</name>
<name>
<surname>Bean</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Marschner</surname>
<given-names>E.</given-names>
</name>
</person-group> (<year>2009</year>). <article-title>Gesture as a Support for Word Learning: The Case of under</article-title>. <source>J.&#x20;Child. Lang.</source> <volume>36</volume>, <fpage>807</fpage>&#x2013;<lpage>828</lpage>. <pub-id pub-id-type="doi">10.1017/S0305000908009173</pub-id> </citation>
</ref>
<ref id="B48">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>McMurray</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Horst</surname>
<given-names>J.&#x20;S.</given-names>
</name>
<name>
<surname>Samuelson</surname>
<given-names>L. K.</given-names>
</name>
</person-group> (<year>2012</year>). <article-title>Word Learning Emerges from the Interaction of Online Referent Selection and Slow Associative Learning</article-title>. <source>Psychol. Rev.</source> <volume>119</volume>, <fpage>831</fpage>&#x2013;<lpage>877</lpage>. <pub-id pub-id-type="doi">10.1037/a0029872</pub-id> </citation>
</ref>
<ref id="B49">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Nachtig&#xe4;ller</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Rohlfing</surname>
<given-names>K. J.</given-names>
</name>
<name>
<surname>Mcgregor</surname>
<given-names>K. K.</given-names>
</name>
</person-group> (<year>2013</year>). <article-title>A Story about a Word: Does Narrative Presentation Promote Learning of a Spatial Preposition in German Two-Year-Olds?</article-title> <source>J.&#x20;Child. Lang.</source> <volume>40</volume>, <fpage>900</fpage>&#x2013;<lpage>917</lpage>. <pub-id pub-id-type="doi">10.1017/S0305000912000311</pub-id> </citation>
</ref>
<ref id="B50">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Noguchi</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Gel</surname>
<given-names>Y. R.</given-names>
</name>
<name>
<surname>Brunner</surname>
<given-names>E.</given-names>
</name>
<name>
<surname>Konietschke</surname>
<given-names>F.</given-names>
</name>
</person-group> (<year>2012</year>). <article-title>nparLD: An R Software Package for the Nonparametric Analysis of Longitudinal Data in Factorial Experiments</article-title>. <source>J.&#x20;Stat. Softw.</source> <volume>50</volume>, <fpage>1</fpage>&#x2013;<lpage>23</lpage>. <pub-id pub-id-type="doi">10.18637/jss.v050.i12</pub-id> </citation>
</ref>
<ref id="B51">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Oran&#xe7;</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>K&#xfc;ntay</surname>
<given-names>A. C.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Children&#x2019;s Perception of Social Robots as a Source of Information across Different Domains of Knowledge</article-title>. <source>Cogn. Dev.</source> <volume>54</volume>, <fpage>100875</fpage>. <pub-id pub-id-type="doi">10.1016/j.cogdev.2020.100875</pub-id> </citation>
</ref>
<ref id="B52">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Park</surname>
<given-names>H. W.</given-names>
</name>
<name>
<surname>Rosenberg-Kima</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Rosenberg</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Gordon</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Breazeal</surname>
<given-names>C.</given-names>
</name>
</person-group> (<year>2017</year>). &#x201c;<article-title>Growing growth mindset with a social robot peer</article-title>,&#x201d; in <italic>Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction</italic>. (<publisher-loc>Vienna Austria</publisher-loc>: <publisher-name>ACM)</publisher-name>, <fpage>137</fpage>&#x2013;<lpage>145</lpage>. <pub-id pub-id-type="doi">10.1145/2909824.3020213</pub-id> </citation>
</ref>
<ref id="B53">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Poole</surname>
<given-names>K. L.</given-names>
</name>
<name>
<surname>Schmidt</surname>
<given-names>L. A.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Smiling through the Shyness: The Adaptive Function of Positive Affect in Shy Children</article-title>. <source>Emotion</source> <volume>19</volume>, <fpage>160</fpage>&#x2013;<lpage>170</lpage>. <pub-id pub-id-type="doi">10.1037/emo0000426</pub-id> </citation>
</ref>
<ref id="B54">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Putnam</surname>
<given-names>S. P.</given-names>
</name>
<name>
<surname>Gartstein</surname>
<given-names>M. A.</given-names>
</name>
<name>
<surname>Rothbart</surname>
<given-names>M. K.</given-names>
</name>
</person-group> (<year>2006</year>). <article-title>Measurement of Fine-Grained Aspects of Toddler Temperament: The Early Childhood Behavior Questionnaire</article-title>. <source>Infant Behav. Dev.</source> <volume>29</volume>, <fpage>386</fpage>&#x2013;<lpage>401</lpage>. <pub-id pub-id-type="doi">10.1016/j.infbeh.2006.01.004</pub-id> </citation>
</ref>
<ref id="B55">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Reddy</surname>
<given-names>V.</given-names>
</name>
</person-group> (<year>2000</year>). <article-title>Coyness in Early Infancy</article-title>. <source>Dev. Sci.</source> <volume>3</volume>, <fpage>186</fpage>&#x2013;<lpage>192</lpage>. <pub-id pub-id-type="doi">10.1111/1467-7687.00112</pub-id> </citation>
</ref>
<ref id="B56">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Reddy</surname>
<given-names>V.</given-names>
</name>
</person-group> (<year>2005</year>). &#x201c;<article-title>Feeling Shy and Showing-Off: Self-Conscious Emotions Must Regulate Self-Awareness</article-title>,&#x201d; in <source>Emotional Development: Recent Research Advances</source> (<publisher-loc>New York, NY, US</publisher-loc>: <publisher-name>Oxford University Press</publisher-name>), <fpage>183</fpage>&#x2013;<lpage>204</lpage>. </citation>
</ref>
<ref id="B57">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Rimm-Kaufman</surname>
<given-names>S. E.</given-names>
</name>
<name>
<surname>Kagan</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2005</year>). <article-title>Infant Predictors of Kindergarten Behavior: The Contribution of Inhibited and Uninhibited Temperament Types</article-title>. <source>Behav. Disord.</source> <volume>30</volume>, <fpage>331</fpage>&#x2013;<lpage>347</lpage>. <pub-id pub-id-type="doi">10.1177/019874290503000409</pub-id> </citation>
</ref>
<ref id="B58">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Rohlfing</surname>
<given-names>K. J.</given-names>
</name>
<name>
<surname>Grimminger</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>2019</year>). &#x201c;<article-title>Utilizing Pragmatic Frames as an analytical tool for children&#x2019;s performance during word learning</article-title>,&#x201d; in <italic>Joint IEEE 9th International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob)</italic> (<publisher-loc>Oslo, Norway</publisher-loc>: <publisher-name>IEEE</publisher-name>), <fpage>81</fpage>&#x2013;<lpage>86</lpage>. <pub-id pub-id-type="doi">10.1109/DEVLRN.2019.8850714</pub-id> </citation>
</ref>
<ref id="B59">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Rohlfing</surname>
<given-names>K. J.</given-names>
</name>
<name>
<surname>Wrede</surname>
<given-names>B.</given-names>
</name>
<name>
<surname>Vollmer</surname>
<given-names>A.-L.</given-names>
</name>
<name>
<surname>Oudeyer</surname>
<given-names>P.-Y.</given-names>
</name>
</person-group> (<year>2016</year>). <article-title>An Alternative to Mapping a Word onto a Concept in Language Acquisition: Pragmatic Frames</article-title>. <source>Front. Psychol.</source> <volume>7</volume>, <fpage>1</fpage>&#x2013;<lpage>18</lpage>. <pub-id pub-id-type="doi">10.3389/fpsyg.2016.00470</pub-id> </citation>
</ref>
<ref id="B60">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Rohlfing</surname>
<given-names>K. J.</given-names>
</name>
<name>
<surname>Leonardi</surname>
<given-names>G.</given-names>
</name>
<name>
<surname>Nomikou</surname>
<given-names>I.</given-names>
</name>
<name>
<surname>Raczaszek-Leonardi</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>H&#xfc;llermeier</surname>
<given-names>E.</given-names>
</name>
</person-group> (<year>2020</year>). <article-title>Multimodal Turn-Taking: Motivations, Methodological Challenges, and Novel Approaches</article-title>. <source>IEEE Trans. Cogn. Dev. Syst.</source> <volume>12</volume>, <fpage>260</fpage>&#x2013;<lpage>271</lpage>. <pub-id pub-id-type="doi">10.1109/TCDS.2019.2892991</pub-id> </citation>
</ref>
<ref id="B61">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Rohlfing</surname>
<given-names>K. J.</given-names>
</name>
<name>
<surname>Grimminger</surname>
<given-names>A.</given-names>
</name>
<name>
<surname>Wrede</surname>
<given-names>B.</given-names>
</name>
</person-group> (<year>2020</year>). &#x201c;<article-title>The caregiver&#x2019;s role in keeping a child-robot interaction going</article-title>,&#x201d; in <source>International perspectives on digital media and early literacy: the impact of digital devices on learning, language acquisition and social interaction</source>. Editors <person-group person-group-type="editor">
<name>
<surname>Rohlfing</surname>
<given-names>K. J.</given-names>
</name>
<name>
<surname>M&#xfc;ller-Brauers</surname>
<given-names>C.</given-names>
</name>
</person-group> (<publisher-loc>London</publisher-loc>: <publisher-name>Routledge)</publisher-name>, <fpage>73</fpage>&#x2013;<lpage>89</lpage>. <pub-id pub-id-type="doi">10.4324/9780429321399-6</pub-id> </citation>
</ref>
<ref id="B62">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Rothbart</surname>
<given-names>M. K.</given-names>
</name>
<name>
<surname>Ahadi</surname>
<given-names>S. A.</given-names>
</name>
<name>
<surname>Hershey</surname>
<given-names>K. L.</given-names>
</name>
<name>
<surname>Fisher</surname>
<given-names>P.</given-names>
</name>
</person-group> (<year>2001</year>). <article-title>Investigations of Temperament at Three to Seven Years: The Children&#x27;s Behavior Questionnaire</article-title>. <source>Child. Dev.</source> <volume>72</volume>, <fpage>1394</fpage>&#x2013;<lpage>1408</lpage>. <pub-id pub-id-type="doi">10.1111/1467-8624.00355</pub-id> </citation>
</ref>
<ref id="B63">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Rubin</surname>
<given-names>K. H.</given-names>
</name>
<name>
<surname>Coplan</surname>
<given-names>R. J.</given-names>
</name>
<name>
<surname>Bowker</surname>
<given-names>J.&#x20;C.</given-names>
</name>
</person-group> (<year>2009</year>). <article-title>Social Withdrawal in Childhood</article-title>. <source>Annu. Rev. Psychol.</source> <volume>60</volume>, <fpage>141</fpage>&#x2013;<lpage>171</lpage>. <pub-id pub-id-type="doi">10.1146/annurev.psych.60.110707.163642</pub-id> </citation>
</ref>
<ref id="B64">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Salam</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Celiktutan</surname>
<given-names>O.</given-names>
</name>
<name>
<surname>Hupont</surname>
<given-names>I.</given-names>
</name>
<name>
<surname>Gunes</surname>
<given-names>H.</given-names>
</name>
<name>
<surname>Chetouani</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Fully Automatic Analysis of Engagement and its Relationship to Personality in Human-Robot Interactions</article-title>. <source>IEEE Access</source> <volume>5</volume>, <fpage>705</fpage>&#x2013;<lpage>721</lpage>. <pub-id pub-id-type="doi">10.1109/ACCESS.2016.2614525</pub-id> </citation>
</ref>
<ref id="B65">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Salter</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Dautenhahn</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Boekhorst</surname>
<given-names>R. t.</given-names>
</name>
</person-group> (<year>2006</year>). <article-title>Learning about Natural Human-Robot Interaction Styles</article-title>. <source>Robotics Autonomous Syst.</source> <volume>54</volume>, <fpage>127</fpage>&#x2013;<lpage>134</lpage>. <pub-id pub-id-type="doi">10.1016/j.robot.2005.09.022</pub-id> </citation>
</ref>
<ref id="B66">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Sano</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Horii</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Abe</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Nagai</surname>
<given-names>T.</given-names>
</name>
</person-group> (<year>2020</year>). &#x201c;<article-title>Explainable temperament estimation of toddlers by a childcare robot</article-title>,&#x201d; in <italic>29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)</italic> (<publisher-loc>Naples, Italy</publisher-loc>: <publisher-name>IEEE</publisher-name>). <fpage>159</fpage>&#x2013;<lpage>164</lpage>. <pub-id pub-id-type="doi">10.1109/RO-MAN47096.2020.9223574</pub-id> </citation>
</ref>
<ref id="B67">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Schmidt</surname>
<given-names>L. A.</given-names>
</name>
<name>
<surname>Buss</surname>
<given-names>A. H.</given-names>
</name>
</person-group> (<year>2010</year>). &#x201c;<article-title>Understanding Shyness: Four Questions and Four Decades of Research</article-title>,&#x201d; in <source>The Development of Shyness and Social Withdrawal</source>. Editors <person-group person-group-type="editor">
<name>
<surname>Rubin</surname>
<given-names>K. H.</given-names>
</name>
<name>
<surname>Coplan</surname>
<given-names>R. J.</given-names>
</name>
</person-group> (<publisher-loc>New York</publisher-loc>: <publisher-name>The Guilford Press</publisher-name>), <fpage>23</fpage>&#x2013;<lpage>41</lpage>. </citation>
</ref>
<ref id="B68">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Schmidt</surname>
<given-names>L. A.</given-names>
</name>
<name>
<surname>Poole</surname>
<given-names>K. L.</given-names>
</name>
<name>
<surname>Fox</surname>
<given-names>N. A.</given-names>
</name>
<name>
<surname>Kagan</surname>
<given-names>J.</given-names>
</name>
</person-group> (<year>2020</year>). &#x201c;<article-title>The Study of Behavioral Inhibition and Temperamental Shyness across Four Academic Generations</article-title>,&#x201d; in <source>&#x201c;The Study of Behavioral Inhibition and Temperamental Shyness across Four Academic Generations,&#x201d; in <italic>Adaptive Shyness</italic>
</source>. Editors <person-group person-group-type="editor">
<name>
<surname>Schmidt</surname>
<given-names>L. A.</given-names>
</name>
<name>
<surname>Poole</surname>
<given-names>K. L.</given-names>
</name>
</person-group> (<publisher-loc>Cham</publisher-loc>: <publisher-name>Springer International Publishing</publisher-name>), <fpage>3</fpage>&#x2013;<lpage>21</lpage>. <pub-id pub-id-type="doi">10.1007/978-3-030-38877-5_1</pub-id> </citation>
</ref>
<ref id="B69">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Schodde</surname>
<given-names>T.</given-names>
</name>
<name>
<surname>Hoffmann</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Kopp</surname>
<given-names>S.</given-names>
</name>
</person-group> (<year>2017</year>). &#x201c;<article-title>How to manage affective state in child-robot tutoring interactions?</article-title>,&#x201d; in <italic>International Conference on Companion Technology (ICCT)</italic> (<publisher-loc>Ulm, Germany</publisher-loc>: <publisher-name>IEEE</publisher-name>), <fpage>1</fpage>&#x2013;<lpage>6</lpage>. <pub-id pub-id-type="doi">10.1109/COMPANION.2017.8287073</pub-id> </citation>
</ref>
<ref id="B70">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Shiomi</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Abe</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Pei</surname>
<given-names>Y.</given-names>
</name>
<name>
<surname>Ikeda</surname>
<given-names>N.</given-names>
</name>
<name>
<surname>Nagai</surname>
<given-names>T.</given-names>
</name>
</person-group> (<year>2016</year>). &#x201c;<article-title>I&#x2019;m Scared : little children reject robots</article-title>,&#x201d; in <italic>Proceedings of the Fourth International Conference on Human Agent Interaction</italic> (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>ACM</publisher-name>), <fpage>245</fpage>&#x2013;<lpage>247</lpage>. <pub-id pub-id-type="doi">10.1145/2974804.2980493</pub-id> </citation>
</ref>
<ref id="B71">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Smith</surname>
<given-names>P. L.</given-names>
</name>
<name>
<surname>Little</surname>
<given-names>D. R.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Small Is Beautiful: In Defense of the Small-N Design</article-title>. <source>Psychon. Bull. Rev.</source> <volume>25</volume>, <fpage>2083</fpage>&#x2013;<lpage>2101</lpage>. <pub-id pub-id-type="doi">10.3758/s13423-018-1451-8</pub-id> </citation>
</ref>
<ref id="B72">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Smith Watts</surname>
<given-names>A. K.</given-names>
</name>
<name>
<surname>Patel</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Corley</surname>
<given-names>R. P.</given-names>
</name>
<name>
<surname>Friedman</surname>
<given-names>N. P.</given-names>
</name>
<name>
<surname>Hewitt</surname>
<given-names>J.&#x20;K.</given-names>
</name>
<name>
<surname>Robinson</surname>
<given-names>J.&#x20;L.</given-names>
</name>
<etal/>
</person-group> (<year>2014</year>). <article-title>Testing Alternative Hypotheses Regarding the Association between Behavioral Inhibition and Language Development in Toddlerhood</article-title>. <source>Child. Dev.</source> <volume>85</volume>, <fpage>1569</fpage>&#x2013;<lpage>1585</lpage>. <pub-id pub-id-type="doi">10.1111/cdev.12219</pub-id> </citation>
</ref>
<ref id="B73">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Spere</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>Evans</surname>
<given-names>M. A.</given-names>
</name>
</person-group> (<year>2009</year>). <article-title>Shyness as a Continuous Dimension and Emergent Literacy in Young Children: Is There a Relation?</article-title> <source>Inf. Child. Develop.</source> <volume>18</volume>, <fpage>216</fpage>&#x2013;<lpage>237</lpage>. <pub-id pub-id-type="doi">10.1002/icd.621</pub-id> </citation>
</ref>
<ref id="B74">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Spere</surname>
<given-names>K. A.</given-names>
</name>
<name>
<surname>Schmidt</surname>
<given-names>L. A.</given-names>
</name>
<name>
<surname>Theall-Honey</surname>
<given-names>L. A.</given-names>
</name>
<name>
<surname>Martin-Chang</surname>
<given-names>S.</given-names>
</name>
</person-group> (<year>2004</year>). <article-title>Expressive and Receptive Language Skills of Temperamentally Shy Preschoolers</article-title>. <source>Inf. Child. Develop.</source> <volume>13</volume>, <fpage>123</fpage>&#x2013;<lpage>133</lpage>. <pub-id pub-id-type="doi">10.1002/icd.345</pub-id> </citation>
</ref>
<ref id="B75">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Stelmachowicz</surname>
<given-names>P. G.</given-names>
</name>
<name>
<surname>Pittman</surname>
<given-names>A. L.</given-names>
</name>
<name>
<surname>Hoover</surname>
<given-names>B. M.</given-names>
</name>
<name>
<surname>Lewis</surname>
<given-names>D. E.</given-names>
</name>
</person-group> (<year>2004</year>). <article-title>Novel-word learning in children with normal hearing and hearing Loss</article-title>. <source>Ear &#x26; Hearing</source>, <volume>25</volume>, <fpage>47</fpage>&#x2013;<lpage>56</lpage>. <pub-id pub-id-type="doi">10.1097/01.AUD.0000111258.98509.DE</pub-id> </citation>
</ref>
<ref id="B76">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Tolksdorf</surname>
<given-names>N. F.</given-names>
</name>
<name>
<surname>Mertens</surname>
<given-names>U.</given-names>
</name>
</person-group> (<year>2020</year>). &#x201c;<article-title>&#x201c;Beyond words: children&#x2019;s multimodal responses during word learning with a robot</article-title>,&#x201d; in <source>International perspectives on digital media and early literacy: the impact of digital devices on learning, language acquisition and social interaction</source>. Editors <person-group person-group-type="editor">
<name>
<surname>Rohlfing</surname>
<given-names>K. J.</given-names>
</name>
<name>
<surname>M&#xfc;ller-Brauers</surname>
<given-names>C.</given-names>
</name>
</person-group> (<publisher-loc>London</publisher-loc>: <publisher-name>Routledge</publisher-name>). <fpage>90</fpage>&#x2013;<lpage>102</lpage>. <comment>Available at: <ext-link ext-link-type="uri" xlink:href="https://www.taylorfrancis.com/chapters/beyond-words-nils-tolksdorf-ulrich-mertens/e/10.4324/9780429321399-7">https://www.taylorfrancis.com/chapters/beyond-words-nils-tolksdorf-ulrich-mertens/e/10.4324/9780429321399-7</ext-link>
</comment>. </citation>
</ref>
<ref id="B77">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Tolksdorf</surname>
<given-names>N. F.</given-names>
</name>
<name>
<surname>Rohlfing</surname>
<given-names>K. J.</given-names>
</name>
</person-group> (<year>2020</year>). &#x201c;<article-title>Parents&#x2019; Views on Using Social Robots for Language Learning</article-title>,&#x201d; in <italic>29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)</italic>. (<publisher-loc>Naples, Italy</publisher-loc>: <publisher-name>IEEE</publisher-name>). <fpage>634</fpage>&#x2013;<lpage>640</lpage>. <pub-id pub-id-type="doi">10.1109/RO-MAN47096.2020.9223540</pub-id> </citation>
</ref>
<ref id="B78">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Tolksdorf</surname>
<given-names>N. F.</given-names>
</name>
<name>
<surname>Siebert</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Zorn</surname>
<given-names>I.</given-names>
</name>
<name>
<surname>Horwath</surname>
<given-names>I.</given-names>
</name>
<name>
<surname>Rohlfing</surname>
<given-names>K. J.</given-names>
</name>
</person-group> (<year>2020a</year>). <article-title>Ethical Considerations of Applying Robots in Kindergarten Settings: Towards an Approach from a Macroperspective</article-title>. <source>Int. J.&#x20;Soc. Robotics</source> <volume>13</volume>, <fpage>129</fpage>&#x2013;<lpage>140</lpage>. <pub-id pub-id-type="doi">10.1007/s12369-020-00622-3</pub-id> </citation>
</ref>
<ref id="B79">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Tolksdorf</surname>
<given-names>N. F.</given-names>
</name>
<name>
<surname>Viertel</surname>
<given-names>F.</given-names>
</name>
<name>
<surname>Rohlfing</surname>
<given-names>K. J.</given-names>
</name>
</person-group> (<year>2020b</year>). &#x201c;<article-title>Do shy children behave differently than non-shy children in a long-term child-robot interaction?</article-title>,&#x201d; in <italic>Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction (Cambridge United&#x20;Kingdom: ACM)</italic>, <fpage>488</fpage>&#x2013;<lpage>490</lpage>. <pub-id pub-id-type="doi">10.1145/3371382.3378367</pub-id> </citation>
</ref>
<ref id="B80">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Tolksdorf</surname>
<given-names>N. F.</given-names>
</name>
<name>
<surname>Crawshaw</surname>
<given-names>C. E.</given-names>
</name>
<name>
<surname>Rohlfing</surname>
<given-names>K. J.</given-names>
</name>
</person-group> (<year>2021</year>). <article-title>Comparing the Effects of a Different Social Partner (Social Robot vs. Human) on Children&#x27;s Social Referencing in Interaction</article-title>. <source>Front. Educ.</source> <volume>5</volume>, <fpage>569615</fpage>. <pub-id pub-id-type="doi">10.3389/feduc.2020.569615</pub-id> </citation>
</ref>
<ref id="B81">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>van den Berghe</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Verhagen</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Oudgenoeg-Paz</surname>
<given-names>O.</given-names>
</name>
<name>
<surname>van der Ven</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>Leseman</surname>
<given-names>P.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Social Robots for Language Learning: A Review</article-title>. <source>Rev. Educ. Res.</source> <volume>89</volume>, <fpage>259</fpage>&#x2013;<lpage>295</lpage>. <pub-id pub-id-type="doi">10.3102/0034654318821286</pub-id> </citation>
</ref>
<ref id="B82">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Vaughn</surname>
<given-names>S.</given-names>
</name>
<name>
<surname>La Greca</surname>
<given-names>A.</given-names>
</name>
</person-group> (<year>1992</year>). &#x201c;<article-title>Beyond Greetings and Making Friends: Social Skills from a Broader Perspective</article-title>,&#x201d; in <source>Contemporary Intervention Research In Learning Disabilities: An International Perspective</source>. Editor <person-group person-group-type="editor">
<name>
<surname>Wong</surname>
<given-names>B. Y. L.</given-names>
</name>
</person-group> (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>Springer New York</publisher-name>), <fpage>96</fpage>&#x2013;<lpage>114</lpage>. <pub-id pub-id-type="doi">10.1007/978-1-4612-2786-1_6</pub-id> </citation>
</ref>
<ref id="B83">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Viertel</surname>
<given-names>F. E.</given-names>
</name>
</person-group> (<year>2019</year>). <article-title>Training of visual perspective-taking (level 1) by means of role reversal imitation in 18-20-montholds with particular regard to the temperamental trait shyness</article-title>. <publisher-loc>Paderborn, Germany</publisher-loc>: <publisher-name>Paderborn University Library</publisher-name>. <pub-id pub-id-type="doi">10.17619/UNIPB/1-889</pub-id> </citation>
</ref>
<ref id="B84">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Vogt</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>de Haas</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>de Jong</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Baxter</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>Krahmer</surname>
<given-names>E.</given-names>
</name>
</person-group> (<year>2017</year>). <article-title>Child-robot Interactions for Second Language Tutoring to Preschool Children</article-title>. <source>Front. Hum. Neurosci.</source> <volume>11</volume>, <fpage>1</fpage>&#x2013;<lpage>6</lpage>. <pub-id pub-id-type="doi">10.3389/fnhum.2017.00073</pub-id> </citation>
</ref>
<ref id="B85">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Vogt</surname>
<given-names>P.</given-names>
</name>
<name>
<surname>van den Berghe</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>de Haas</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Hoffman</surname>
<given-names>L.</given-names>
</name>
<name>
<surname>Kanero</surname>
<given-names>J.</given-names>
</name>
<name>
<surname>Mamus</surname>
<given-names>E.</given-names>
</name>
<etal/>
</person-group> (<year>2019</year>). &#x201c;<article-title>Second language tutoring using social robots: a large-scale study</article-title>,&#x201d; in <italic>2019 14th ACM/IEEE International Conference On Human-Robot Interaction (HRI)</italic> (<publisher-loc>Daegu, Korea (South)</publisher-loc>: <publisher-name>IEEE</publisher-name>), <fpage>497</fpage>&#x2013;505. <pub-id pub-id-type="doi">10.1109/HRI.2019.8673077</pub-id> </citation>
</ref>
<ref id="B86">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Vollmer</surname>
<given-names>A.-L.</given-names>
</name>
<name>
<surname>Read</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Trippas</surname>
<given-names>D.</given-names>
</name>
<name>
<surname>Belpaeme</surname>
<given-names>T.</given-names>
</name>
</person-group> (<year>2018</year>). <article-title>Children Conform, Adults Resist: A Robot Group Induced Peer Pressure on Normative Social Conformity</article-title>. <source>Sci. Robot.</source> <volume>3</volume>, <fpage>eaat7111</fpage>. <pub-id pub-id-type="doi">10.1126/scirobotics.aat7111</pub-id> </citation>
</ref>
<ref id="B87">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Walters</surname>
<given-names>M. L.</given-names>
</name>
<name>
<surname>Dautenhahn</surname>
<given-names>K.</given-names>
</name>
<name>
<surname>te Boekhorst</surname>
<given-names>R.</given-names>
</name>
<name>
<surname>Kheng Lee Koay</surname>
<given-names>Kheng.</given-names>
</name>
<name>
<surname>Kaouri</surname>
<given-names>C.</given-names>
</name>
<name>
<surname>Woods</surname>
<given-names>S.</given-names>
</name>
<etal/>
</person-group> (<year>2005</year>). &#x201c;<article-title>The influence of subjects&#x27; personality traits on personal spatial zones in a human-robot interaction experiment</article-title>,&#x201d; in <italic>IEEE International Workshop on Robot and Human Interactive Communication (RO-MAN)</italic>, 2005. <publisher-loc>Nashville (TN, USA</publisher-loc>: <publisher-name>IEEE</publisher-name>), <fpage>347</fpage>&#x2013;<lpage>352</lpage>. <pub-id pub-id-type="doi">10.1109/ROMAN.2005.1513803</pub-id> </citation>
</ref>
<ref id="B88">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Zentner</surname>
<given-names>M.</given-names>
</name>
<name>
<surname>Bates</surname>
<given-names>J.&#x20;E.</given-names>
</name>
</person-group> (<year>2008</year>). <article-title>Child Temperament: An Integrative Review of Concepts, Research Programs, and Measures</article-title>. <source>Int. J.&#x20;Dev. Sci.</source> <volume>2</volume>, <fpage>7</fpage>&#x2013;<lpage>37</lpage>. <pub-id pub-id-type="doi">10.3233/DEV-2008-21203</pub-id> </citation>
</ref>
<ref id="B89">
<citation citation-type="book">
<person-group person-group-type="author">
<name>
<surname>Zentner</surname>
<given-names>M.</given-names>
</name>
</person-group> (<year>2011</year>). <source>Inventar zur integrativen Erfassung des Kind-Temperaments</source>. <publisher-loc>Bern</publisher-loc>: <publisher-name>Huber Verlag</publisher-name>.</citation>
</ref>
<ref id="B90">
<citation citation-type="journal">
<person-group person-group-type="author">
<name>
<surname>Zimbardo</surname>
<given-names>P. G.</given-names>
</name>
<name>
<surname>Pilkonis</surname>
<given-names>P. A.</given-names>
</name>
<name>
<surname>Norwood</surname>
<given-names>R.</given-names>
</name>
</person-group> (<year>1975</year>). <article-title>Social Disease Called Shyness</article-title>. <source>Psychol. Today</source> <volume>8</volume>, <fpage>69</fpage> </citation>
</ref>
</ref-list>
</back>
</article>