<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Archiving and Interchange DTD v2.3 20070202//EN" "archivearticle.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" article-type="systematic-review" dtd-version="2.3" xml:lang="EN">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Educ.</journal-id>
<journal-title>Frontiers in Education</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Educ.</abbrev-journal-title>
<issn pub-type="epub">2504-284X</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/feduc.2023.1220688</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Education</subject>
<subj-group>
<subject>Systematic Review</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Use of wearable devices in the teaching-learning process: a systematic review of the literature</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name>
<surname>Glasserman-Morales</surname>
<given-names>Leonardo David</given-names>
</name>
<xref rid="aff1" ref-type="aff"><sup>1</sup></xref>
<xref rid="aff2" ref-type="aff"><sup>2</sup></xref>
<uri xlink:href="https://loop.frontiersin.org/people/530125/overview"/>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name>
<surname>Carlos-Arroyo</surname>
<given-names>Martina</given-names>
</name>
<xref rid="aff2" ref-type="aff"><sup>2</sup></xref>
<xref rid="c001" ref-type="corresp"><sup>&#x002A;</sup></xref>
<uri xlink:href="https://loop.frontiersin.org/people/2063841/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Ruiz-Ramirez</surname>
<given-names>Jessica Alejandra</given-names>
</name>
<xref rid="aff1" ref-type="aff"><sup>1</sup></xref>
<uri xlink:href="https://loop.frontiersin.org/people/2325685/overview"/>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Alcantar-Nieblas</surname>
<given-names>Carolina</given-names>
</name>
<xref rid="aff2" ref-type="aff"><sup>2</sup></xref>
<uri xlink:href="https://loop.frontiersin.org/people/2312679/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>School of Humanities and Education, Tecnologico de Monterrey</institution>, <addr-line>Monterrey, NL</addr-line>, <country>Mexico</country></aff>
<aff id="aff2"><sup>2</sup><institution>Institute for the Future of Education, Tecnologico de Monterrey</institution>, <addr-line>Monterrey, NL</addr-line>, <country>Mexico</country></aff>
<author-notes>
<fn fn-type="edited-by" id="fn0001"><p>Edited by: Simon K. S. Cheung, Hong Kong Metropolitan University, Hong Kong SAR, China</p></fn>
<fn fn-type="edited-by" id="fn0002"><p>Reviewed by: Ingrid Isenhardt, RWTH Aachen University, Germany; Xindong Ye, Wenzhou University, China</p></fn>
<corresp id="c001">&#x002A;Correspondence: Martina Carlos-Arroyo, <email>martina.carlos@tec.mx</email></corresp>
</author-notes>
<pub-date pub-type="epub">
<day>13</day>
<month>09</month>
<year>2023</year>
</pub-date>
<pub-date pub-type="collection">
<year>2023</year>
</pub-date>
<volume>8</volume>
<elocation-id>1220688</elocation-id>
<history>
<date date-type="received">
<day>14</day>
<month>05</month>
<year>2023</year>
</date>
<date date-type="accepted">
<day>16</day>
<month>08</month>
<year>2023</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x00A9; 2023 Glasserman-Morales, Carlos-Arroyo, Ruiz-Ramirez and Alcantar-Nieblas.</copyright-statement>
<copyright-year>2023</copyright-year>
<copyright-holder>Glasserman-Morales, Carlos-Arroyo, Ruiz-Ramirez and Alcantar-Nieblas</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p>
</license>
</permissions>
<abstract>
<p>Multimodal learning analytics (MMLA) has emerged as an encompassing approach to data collection, facilitating the analysis of student interactions across a variety of resources. MMLA capitalizes on data gleaned from diverse interactions, utilizing wearable devices to track physiological responses. This yields deeper insights into factors such as cognitive load, stress levels, interest, and other stimuli pivotal to the learning process. Nonetheless, it is crucial to acknowledge the theoretical and practical challenges underpinning the integration of wearable devices into learning experiences, both in academic settings and in everyday life activities. A systematic review of the literature (SLR) was conducted to identify the characteristics of studies that incorporate wearable devices into teaching-learning process analyses. The outcomes enabled us to discern key attributes such as participant descriptions, the activities implemented for data collection, and a broad spectrum of biometric indicators, with electrodermal activity (EDA) and heart rate (HR) among the most commonly employed methodologies in data analysis. Future endeavors should be centered on the formation of interdisciplinary teams. The objective is to devise novel methodologies for multimodal data collection and analysis that can discern performance variables, thereby enhancing learning in a manner conducive to more fluid, reflective educational experiences for all participants in the teaching-learning process.</p>
</abstract>
<kwd-group>
<kwd>wearable devices</kwd>
<kwd>multi-modal learning analytics</kwd>
<kwd>teaching-learning processes</kwd>
<kwd>biometric indicators</kwd>
<kwd>educational innovation</kwd>
</kwd-group>
<counts>
<fig-count count="4"/>
<table-count count="2"/>
<equation-count count="0"/>
<ref-count count="63"/>
<page-count count="10"/>
<word-count count="7078"/>
</counts>
<custom-meta-wrap>
<custom-meta>
<meta-name>section-at-acceptance</meta-name>
<meta-value>Digital Education</meta-value>
</custom-meta>
</custom-meta-wrap>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="sec1">
<label>1.</label>
<title>Introduction</title>
<p>The potential of learning analytics (LA) in education has been harnessed as a tool for the collection, measurement, and analysis of student data with the intent of understanding and constructing models that enhance learning experiences (<xref ref-type="bibr" rid="ref1001">Siemens and Long, 2011</xref>; <xref ref-type="bibr" rid="ref16">Ferguson, 2012</xref>; <xref ref-type="bibr" rid="ref1002">Siemens and Gasevic, 2012</xref>). The data from LA have been utilized by various authors to explore and investigate factors that shape learning behavior in technology-mediated spaces (<xref ref-type="bibr" rid="ref32">Lin and Hwang, 2018</xref>; <xref ref-type="bibr" rid="ref57">Ullmann et al., 2019</xref>). Procedures carried out by institutions using learning analytics, which are based on clickstream data or the so-called time-stamped digital traces left by students during their interactions with the learning management system (LMS), have been recognized (<xref ref-type="bibr" rid="ref53">Sedraz Silva et al., 2018</xref>). Given the ability to discern varied and intricate patterns regarding student behavior, the significance of other educational applications is also acknowledged (<xref ref-type="bibr" rid="ref13">Cukurova et al., 2020</xref>). The potential of LMSs for early detection of students facing challenges in courses, predicting success, and promoting improved outcomes has been highlighted (<xref ref-type="bibr" rid="ref56">Tempelaar et al., 2020</xref>).</p>
<p>Though LA has advanced the comprehension of students&#x2019; learning processes (<xref ref-type="bibr" rid="ref3">Avella et al., 2016</xref>), its limitations stem from the one-dimensional nature of its data collection (<xref ref-type="bibr" rid="ref51">Rodr&#x00ED;guez-Triana et al., 2017</xref>). Crucial contextual student data, vital for understanding behaviors and influential factors in their learning process, are often omitted (<xref ref-type="bibr" rid="ref15">Eradze and Laanpere, 2017</xref>). To address these limitations, multimodal learning analytics (MMLA) has been introduced as a comprehensive approach to data collection (<xref ref-type="bibr" rid="ref20">Giannakos et al., 2022</xref>; <xref ref-type="bibr" rid="ref35">Monsalves et al., 2023</xref>). MMLA is characterized by the study of data from diverse sources stemming from student interactions in a range of environments beyond just the digital; this includes physical, physiological, psychometric, and environmental spaces (<xref ref-type="bibr" rid="ref61">Worsley et al., 2016</xref>; <xref ref-type="bibr" rid="ref36">Mu et al., 2020</xref>; <xref ref-type="bibr" rid="ref20">Giannakos et al., 2022</xref>). Such data are captured, amalgamated, and analyzed to provide a holistic understanding of factors associated with the learning process (<xref ref-type="bibr" rid="ref43">Quadri and Shukor, 2021</xref>).</p>
<p>Specifically, technological advancements have paved the way for wearable devices in the realm of capturing multimodal data pertaining to the physiological environment. These advancements have also simplified the storage of vast amounts of data in the cloud, easing their collection and subsequent analysis (<xref ref-type="bibr" rid="ref14">DiMitri et al., 2018</xref>). Wearable devices, especially multimodal computerized biofeedback wristbands, have become pivotal for real-time data collection (<xref ref-type="bibr" rid="ref18">Garbarino et al., 2014</xref>; <xref ref-type="bibr" rid="ref49">Regalia et al., 2019</xref>). Their widespread adoption is attributed to their increasing popularity in health tracking and monitoring (<xref ref-type="bibr" rid="ref58">Vos et al., 2023</xref>). Notably, the Empatica E4 wristband, known for its noninvasive nature, cost-effectiveness, and cloud storage capabilities, is prominently utilized (<xref ref-type="bibr" rid="ref38">Ollander et al., 2016</xref>; <xref ref-type="bibr" rid="ref28">Koskim&#x00E4;ki et al., 2017</xref>). This device has been employed in diverse studies encompassing music, stress, and emotion management (<xref ref-type="bibr" rid="ref4">Borrego et al., 2019</xref>; <xref ref-type="bibr" rid="ref6">Bulagang et al., 2021</xref>; <xref ref-type="bibr" rid="ref8">Chandra et al., 2021</xref>; <xref ref-type="bibr" rid="ref45">Rahman et al., 2021</xref>).</p>
<p>Recently, there has been considerable interest in creating multimodal systems that automatically analyze students&#x2019; states that are hard to observe directly, like cognitive load and stress levels, but can significantly affect their performance (<xref ref-type="bibr" rid="ref7">Bustos-L&#x00F3;pez et al., 2022</xref>). Some studies have focused on examining aspects such as self-regulation (<xref ref-type="bibr" rid="ref54">Spann et al., 2017</xref>), motivation (<xref ref-type="bibr" rid="ref25">J&#x00E4;rvenoja et al., 2018</xref>), interest, and attention during activities (<xref ref-type="bibr" rid="ref55">Tan et al., 2021</xref>). At this point, biometric data aids in managing learning-related information, such as assessment load (<xref ref-type="bibr" rid="ref23">Hernandez-de-Menendez et al., 2021</xref>). Classroom biometric monitoring can usher in new learning approaches, as timely feedback to students with suitable teaching methods bolsters learning and retention (<xref ref-type="bibr" rid="ref48">Ram&#x00ED;rez-Moreno et al., 2021a</xref>,<xref ref-type="bibr" rid="ref47">b</xref>).</p>
<p>Consequently, wearable devices provide a range of measurements to acquire biometric data, including physiological responses such as electrodermal activity (EDA), also referred to as galvanic skin response (GSR). This measurement is intimately linked to the sympathetic nervous system (SNS), as skin conductance primarily arises from sweat glands under the exclusive control of the SNS. EDA is widely recognized as a direct method to gauge stress associated with responses of the autonomic nervous system (ANS; <xref ref-type="bibr" rid="ref5">Boucsein, 2012</xref>). In addition to this, these devices include other peripheral physiological measurements such as respiratory amplitude, skin temperature (ST), electrocardiogram (ECG), blood pressure volume (BVP), muscle electromyography (EMG), and electrooculogram (EOG; <xref ref-type="bibr" rid="ref27">Koelstra et al., 2010</xref>).</p>
<p>Given the growing interest in wearable devices, it becomes imperative to undertake research in the field of education that addresses both the theoretical and practical issues and the current limitations of these tools. Consequently, this study attempts to pinpoint the characteristics of teaching-learning processes that integrate wearable devices for the collection of biometric data from students. The first section of the article provides an overview of the methodological strategy underpinning this research, based on a systematic literature review (SLR). The following section presents the results of the study, including analysis, interpretation, and findings. The final section addresses the central research question: What are the characteristics of studies that incorporate wearable devices into the analysis of teaching-learning processes?</p>
</sec>
<sec sec-type="methods" id="sec2">
<label>2.</label>
<title>Methodology</title>
<p>The systematic review was conducted using the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines (<xref ref-type="bibr" rid="ref39">Page et al., 2021</xref>), facilitating the identification of potentially relevant articles. Extensive searches were performed in the Scopus and Web of Science (WoS) bibliographic databases to incorporate a wide range of scientific literature while excluding gray literature. Inclusion criteria were established to include peer-reviewed journal articles published in English between 2019 and 2022, spanning quantitative, qualitative, and mixed-methods studies. This approach ensured a comprehensive view of current research integrating wearable devices. Following the delineation of the study objectives, sub-research questions were subsequently defined to answer the main question (<xref rid="tab1" ref-type="table">Table 1</xref>).</p>
<table-wrap position="float" id="tab1">
<label>Table 1</label>
<caption>
<p>Sub-research questions.</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left" valign="top">ID</th>
<th align="left" valign="top">Question</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="middle">RQ1</td>
<td align="left" valign="middle">What is the research context that incorporates the use of wearable devices?</td>
</tr>
<tr>
<td align="left" valign="middle">RQ2</td>
<td align="left" valign="middle">Are wearable devices utilized to assess the development of any competency component, whether disciplinary or general?</td>
</tr>
<tr>
<td align="left" valign="middle">RQ3</td>
<td align="left" valign="middle">Which biometric indicators are associated with the use of wearable devices?</td>
</tr>
<tr>
<td align="left" valign="middle">RQ4</td>
<td align="left" valign="middle">What is the methodology for analyzing data gathered via wearable devices?</td>
</tr>
</tbody>
</table>
</table-wrap>
<sec id="sec3">
<label>2.1.</label>
<title>Selection criteria</title>
<p>Consequently, the titles and abstracts of potential studies were scrutinized to ensure they met the predetermined eligibility criteria. Thorough reviews were then performed to confirm the relevance of the included information to the study, namely, whether it contributed sufficiently toward addressing the objectives of the present research. Full versions of the articles were subsequently assessed independently using the following criteria: (1) intervention studies examining the impact of wearable devices on learning processes; (2) studies incorporating at least one control group; and (3) peer-reviewed studies.</p>
</sec>
<sec id="sec4">
<label>2.2.</label>
<title>Data extraction</title>
<p>Data extraction from each database was independently executed by the authors. The principal metadata drawn from each study encompassed the following details: the first author, date and location of publication, authors&#x2019; affiliations, journal details, keywords, and the country where the study was conducted. Additionally, specific labels analyzed by the researchers for each study were included, such as the academic level of the study (elementary school, middle school, high school, college, or undergraduate) and the pedagogical strategy or activity utilized. This data was assembled in standard MS Excel files. Any discrepancies encountered were resolved through author discussion.</p>
</sec>
<sec id="sec5">
<label>2.3.</label>
<title>Identification and selection of the studies</title>
<p>During the identification phase, a total of 85 records were initially recognized and subsequently imported for the construction of the database, sourced from Scopus (42) and Web of Science (43). With the use of Parsifal automation tools, these records were consolidated, resulting in the identification and removal of nine duplicates and six unsuitable records. This process yielded 70 articles for the subsequent screening phase. Nine articles written in Russian and Chinese were eliminated, leaving 61 reports for recovery. Of these, only 49 were evaluated for eligibility based on the application of selection criteria. Ultimately, the final review incorporated 30 articles that included the use of wearable devices. A depiction of this methodological process is provided in <xref rid="fig1" ref-type="fig">Figure 1</xref>.</p>
<fig position="float" id="fig1">
<label>Figure 1</label>
<caption>
<p>PRISMA methodological development.</p>
</caption>
<graphic xlink:href="feduc-08-1220688-g001.tif"/>
</fig>
</sec>
</sec>
<sec sec-type="results" id="sec6">
<label>3.</label>
<title>Results</title>
<p>The subsequent key findings were derived from the sub-research questions (RQ1). What is the research context that incorporates the use of wearable devices? (RQ2) Are wearable devices utilized to assess the development of any competency component, whether disciplinary or general? (RQ3) Which biometric indicators are associated with the use of wearable devices? (RQ4) What is the methodology for analyzing data gathered via wearable devices?</p>
<sec id="sec7">
<label>3.1.</label>
<title>Context of the development of studies that integrate the use of wearable devices</title>
<p>The context for the development of the selected studies was analyzed from two viewpoints. The first viewpoint encompasses the use of text mining to construct and visualize networks of co-occurring terms extracted from the chosen scientific literature. The second viewpoint pertains to descriptive variables, such as the academic level of the study and the employed pedagogical strategy or activity. Using VOSViewer software, terms drawn from the title and abstract fields of all articles were scrutinized employing a full-count method, where every occurrence of a term in a document is accounted for (<xref rid="fig2" ref-type="fig">Figure 2</xref>). Access to the interactive version is provided here: interactive bibliometric network.</p>
<fig position="float" id="fig2">
<label>Figure 2</label>
<caption>
<p>Bibliometric network map (link &#x003E;100).</p>
</caption>
<graphic xlink:href="feduc-08-1220688-g002.tif"/>
</fig>
<p>The results of the terms linked to each database demonstrate the relationship between the variables that are part of the analyzed articles, where the key and relevant concepts of these studies are verified. The primary bibliometric network map generated a total strength of 1,347 links, which we classified into three clusters. The main findings identify the first cluster (colored in green) with 11 items and the highest number of occurrences (O), which indicates the number of documents in which a keyword occurs (55), links (L) (27), understood like a connection or a relation between two items, and total link strength (LS), which indicates the total strength of the co-authorship links of a given researcher with other researchers (176). It comprises terms that relate to the implementation and use of devices, such as activity, data, sensors, and research. The second cluster, highlighted in red, contains the concepts of anxiety, children, development, electrodermal activity, experience, learning, and user. The third cluster (blue) highlights the terms cognitive, case, test, person, and student.</p>
<p>The data amassed from the results of the biometric map enable the discernment of the interaction of the most pertinent constructs of the investigations. This is based on the data procured from the frequency of occurrence, links, and total strength of the data extracted from the titles and abstracts of each study. Notably, there is a conspicuous absence of terms that are connected with the constructs of pedagogical processes. However, the body of information provided by each cluster is underscored. In the green cluster, activities utilizing sensors to compute beats per minute (BPM) in various research activities are emphasized. Meanwhile, in the red and blue clusters, the student is recognized as the central figure and user in experiences that allude to physiological indicators such as the heart rate (HR).</p>
<p>Regarding the descriptive variables, <xref rid="tab2" ref-type="table">Table 2</xref> assembles information concerning the authors, the research objective, the methodology for data collection, the participant profiles, and the descriptions of activities involving wearable devices. It also includes biometric indicators, whose abbreviations are further detailed in Section 3.3.</p>
<table-wrap position="float" id="tab2">
<label>Table 2</label>
<caption>
<p>Description of linked items.</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left" valign="middle">Author</th>
<th align="left" valign="middle">Research objective</th>
<th align="left" valign="middle">Data collection method</th>
<th align="left" valign="middle">Participants description</th>
<th align="left" valign="middle">Activity description</th>
<th align="left" valign="middle">Biometric indicators</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left" valign="middle">
<xref ref-type="bibr" rid="ref34">Martinez (2019)</xref></td>
<td align="left" valign="middle">To develop a mobile artificial pancreas based on an Android smartphone and evaluate its safety and efficacy in patients with type 1 diabetes</td>
<td align="left" valign="middle">Quantitative</td>
<td align="left" valign="middle">Patients with type 1 diabetes</td>
<td align="left" valign="middle" rowspan="4">Activity in real context</td>
<td align="left" valign="middle">GSR</td>
</tr>
<tr>
<td align="left" valign="middle">
<xref ref-type="bibr" rid="ref26">Jenks et al. (2020)</xref></td>
<td align="left" valign="middle">Examine trends in the frequency and severity of stress during the work shift</td>
<td align="left" valign="middle">Quantitative</td>
<td align="left" valign="middle" rowspan="2">Physicians</td>
<td align="left" valign="middle">HR</td>
</tr>
<tr>
<td align="left" valign="middle">
<xref ref-type="bibr" rid="ref41">Peters et al. (2020)</xref></td>
<td align="left" valign="middle">To characterize the physical activity of emergency physicians during their shifts</td>
<td align="left" valign="middle">Quantitative</td>
<td align="left" valign="middle">ACC</td>
</tr>
<tr>
<td align="left" valign="middle">
<xref ref-type="bibr" rid="ref37">Novak (2019)</xref></td>
<td align="left" valign="middle">Describe how Czech courts evaluate and consider the influence of acute stress in cases of necessary defense</td>
<td align="left" valign="middle">Quantitative</td>
<td align="left" valign="middle">N/A</td>
<td align="left" valign="middle">EDA</td>
</tr>
<tr>
<td align="left" valign="middle">
<xref ref-type="bibr" rid="ref17">Fucci et al. (2019)</xref></td>
<td align="left" valign="middle">Replicate a previous study using fMRI to classify the types of comprehension tasks performed by developers and relate their results to their experience</td>
<td align="left" valign="middle">Quantitative</td>
<td align="left" valign="middle" rowspan="5">University students</td>
<td align="left" valign="middle" rowspan="2">Educational activity</td>
<td align="left" valign="middle">EEG, EDA, BVP, HR, and HRV</td>
</tr>
<tr>
<td align="left" valign="middle">
<xref ref-type="bibr" rid="ref60">Wang et al. (2020)</xref></td>
<td align="left" valign="middle">To identify the unique design considerations for affect sensors that consider student capacities and challenges and explore the potential of the sensors to support students&#x2019; self-learning</td>
<td align="left" valign="middle">Mixed methods</td>
<td align="left" valign="middle">ACC, ST, BVP, and GSR</td>
</tr>
<tr>
<td align="left" valign="middle">
<xref ref-type="bibr" rid="ref50">Rivers (2022)</xref></td>
<td align="left" valign="middle">Assessing anxiety through subjective experience versus observable behavior and the efficacy of anxiety recording tools</td>
<td align="left" valign="middle">Quantitative</td>
<td align="left" valign="middle" rowspan="3">Simulated activity</td>
<td align="left" valign="middle">HRV and EDA</td>
</tr>
<tr>
<td align="left" valign="middle">
<xref ref-type="bibr" rid="ref2">Alfredo et al. (2023)</xref></td>
<td align="left" valign="middle">Designing a stress analysis dashboard to visualize physiological data during an authentic team simulation in the context of nursing education</td>
<td align="left" valign="middle">Mixed methods</td>
<td align="left" valign="middle">ACC, ST, BVP, and EDA</td>
</tr>
<tr>
<td align="left" valign="middle">
<xref ref-type="bibr" rid="ref52">Ronda-Carracao et al. (2021)</xref></td>
<td align="left" valign="middle">Identify whether arousal levels match faculty expectations at each stage of the simulated scenario</td>
<td align="left" valign="middle">Mixed methods</td>
<td align="left" valign="middle">EDA, ACC, ST, and BVP</td>
</tr>
<tr>
<td align="left" valign="middle">
<xref ref-type="bibr" rid="ref10">Climent-P&#x00E9;rez et al. (2022)</xref></td>
<td align="left" valign="middle">Provide an annotated data set for automatic evaluation of daily activities and applications of behavioral analysis and evaluation of measurement devices</td>
<td align="left" valign="middle">Quantitative</td>
<td align="left" valign="middle" rowspan="3">Volunteers</td>
<td align="left" valign="middle" rowspan="3">Activities of daily living</td>
<td align="left" valign="middle">ACC</td>
</tr>
<tr>
<td align="left" valign="middle">
<xref ref-type="bibr" rid="ref9">Choksatchawathi et al. (2020)</xref></td>
<td align="left" valign="middle">Evaluate and correct the heart rate estimation provided by four popular wearable devices</td>
<td align="left" valign="middle">Quantitative</td>
<td align="left" valign="middle">HR</td>
</tr>
<tr>
<td align="left" valign="middle">
<xref ref-type="bibr" rid="ref42">Poli et al. (2020)</xref></td>
<td align="left" valign="middle">Investigate the influence of device characteristics and measurement uncertainty on classification accuracy</td>
<td align="left" valign="middle">Quantitative</td>
<td align="left" valign="middle">EDA and ACC</td>
</tr>
<tr>
<td align="left" valign="middle">
<xref ref-type="bibr" rid="ref19">Ghandi (2019)</xref></td>
<td align="left" valign="middle">Linking human emotions and cognition with the built environment to improve users&#x2019; mental health and wellness</td>
<td align="left" valign="middle">Quantitative</td>
<td align="left" valign="middle">Patients</td>
<td align="left" valign="middle">Adaptive cyber-environments</td>
<td align="left" valign="middle">GSR and HR</td>
</tr>
<tr>
<td align="left" valign="middle">
<xref ref-type="bibr" rid="ref33">Magaki and Vallance (2019)</xref></td>
<td align="left" valign="middle">Develop a reliable and straightforward measurement of cybersickness for VR application developers and educators</td>
<td align="left" valign="middle">Quantitative</td>
<td align="left" valign="middle" rowspan="2">Users</td>
<td align="left" valign="middle" rowspan="4">Virtual reality environment</td>
<td align="left" valign="middle">HR</td>
</tr>
<tr>
<td align="left" valign="middle">
<xref ref-type="bibr" rid="ref40">Perales et al. (2019)</xref></td>
<td align="left" valign="middle">Assess user-perceived pain in a controlled virtual reality environment</td>
<td align="left" valign="middle">Quantitative</td>
<td align="left" valign="middle">EDA and HR</td>
</tr>
<tr>
<td align="left" valign="middle">
<xref ref-type="bibr" rid="ref6">Bulagang et al. (2021)</xref></td>
<td align="left" valign="middle">To investigate whether emotions can be classified using HR as a predictor in a virtual reality (VR) environment with machine learning</td>
<td align="left" valign="middle">Quantitative</td>
<td align="left" valign="middle">Not mentioned</td>
<td align="left" valign="middle">HR</td>
</tr>
<tr>
<td align="left" valign="middle">
<xref ref-type="bibr" rid="ref11">Collins et al. (2019)</xref></td>
<td align="left" valign="middle">Exploring the merits of physiological measures in assessing emotional responses in virtual environments</td>
<td align="left" valign="middle">Quantitative</td>
<td align="left" valign="middle">Not mentioned</td>
<td align="left" valign="middle">EDA and HR</td>
</tr>
<tr>
<td align="left" valign="middle">
<xref ref-type="bibr" rid="ref1">Aguilar-Herrera et al. (2021)</xref></td>
<td align="left" valign="middle">To develop a web platform using the IoT and ML architecture to predict students&#x2019; performance, analyze mental fatigue, and provide real-time quantitative biofeedback to identify the best learning modality</td>
<td align="left" valign="middle">Mixed methods</td>
<td align="left" valign="middle">Volunteers</td>
<td align="left" valign="middle" rowspan="7">Controlled study</td>
<td align="left" valign="middle">EEG, BVP, EDA, and ST</td>
</tr>
<tr>
<td align="left" valign="middle">
<xref ref-type="bibr" rid="ref59">Wampfler et al. (2019)</xref></td>
<td align="left" valign="middle">To accurately predict the affective states of participants solving tablet-based math tasks using low-cost mobile biosensors</td>
<td align="left" valign="middle">Quantitative</td>
<td align="left" valign="middle">Users</td>
<td align="left" valign="middle">EDA, IBI, HR, and ST</td>
</tr>
<tr>
<td align="left" valign="middle">
<xref ref-type="bibr" rid="ref46">Raju et al. (2022)</xref></td>
<td align="left" valign="middle">To explore differences in self-reported and recorded stress levels using an Empatica E4 device</td>
<td align="left" valign="middle">Mixed methods</td>
<td align="left" valign="middle">University students</td>
<td align="left" valign="middle">EDA</td>
</tr>
<tr>
<td align="left" valign="middle">
<xref ref-type="bibr" rid="ref44">Ragot et al. (2018)</xref></td>
<td align="left" valign="middle">Evaluating the accuracy of emotion recognition between laboratory sensors and wearable devices</td>
<td align="left" valign="middle" rowspan="2">Quantitative</td>
<td align="left" valign="middle">Not mentioned</td>
<td align="left" valign="middle">EDA and HR</td>
</tr>
<tr>
<td align="left" valign="middle">
<xref ref-type="bibr" rid="ref24">Iadarola et al. (2021)</xref></td>
<td align="left" valign="middle">Highlight features related to acoustic stimulation</td>
<td align="left" valign="middle">Volunteers</td>
<td align="left" valign="middle">GSR</td>
</tr>
<tr>
<td align="left" valign="middle">
<xref ref-type="bibr" rid="ref12">Cored Bandr&#x00E9;s et al. (2021)</xref></td>
<td align="left" valign="middle">To evaluate the impact of using portable devices in interventions to improve social skills</td>
<td align="left" valign="middle" rowspan="3">Mixed methods</td>
<td align="left" valign="middle">Children under 12&#x2009;years old</td>
<td align="left" valign="middle">ED and HR</td>
</tr>
<tr>
<td align="left" valign="middle">
<xref ref-type="bibr" rid="ref55">Tan et al. (2021)</xref></td>
<td align="left" valign="middle">Deepen the understanding of the value of interest in learning</td>
<td align="left" valign="middle">University students</td>
<td align="left" valign="middle">EDA</td>
</tr>
<tr>
<td align="left" valign="middle"><xref ref-type="bibr" rid="ref48">Ram&#x00ED;rez-Moreno et al. (2021a</xref>,<xref ref-type="bibr" rid="ref47">b)</xref></td>
<td align="left" valign="middle">To evaluate the efficacy of a mental fatigue assessment tool based on biometric signals and inter-subject models</td>
<td align="left" valign="middle">University students and office and industrial workers</td>
<td align="left" valign="middle" rowspan="5">Data analysis tools</td>
<td align="left" valign="middle">EEG, HR, HRV, and EDA</td>
</tr>
<tr>
<td align="left" valign="middle">
<xref ref-type="bibr" rid="ref21">Gouverneur et al. (2017)</xref></td>
<td align="left" valign="middle">Develop an algorithm for the classification of physiological data for emotion recognition</td>
<td align="left" valign="middle" rowspan="4">Quantitative</td>
<td align="left" valign="middle">Not mentioned</td>
<td align="left" valign="middle">EDA</td>
</tr>
<tr>
<td align="left" valign="middle"><xref ref-type="bibr" rid="ref30">Lee-Cultura et al. (2020a</xref>,<xref ref-type="bibr" rid="ref31">b)</xref></td>
<td align="left" valign="middle">Investigating how player motion data collected during interactions with motion-based educational games can predict performance and enhance the educational experience</td>
<td align="left" valign="middle">Users</td>
<td align="left" valign="middle">GAZE, EDA, BVP, HRV, and ST</td>
</tr>
<tr>
<td align="left" valign="middle">
<xref ref-type="bibr" rid="ref29">Lee-Cultura et al. (2021)</xref></td>
<td align="left" valign="middle">To combine traditional video annotations and MMD to understand children&#x2019;s behavior as they interact with educational technology</td>
<td align="left" valign="middle" rowspan="2">Children under 12&#x2009;years old</td>
<td align="left" valign="middle">HRV, EDA, movement, and gaze</td>
</tr>
<tr>
<td align="left" valign="middle"><xref ref-type="bibr" rid="ref30">Lee-Cultura et al. (2020a</xref>,<xref ref-type="bibr" rid="ref31">b)</xref></td>
<td align="left" valign="middle">To evaluate the effect of different ASR on children&#x2019;s stress, attention, and cognitive load during MBTG games</td>
<td align="left" valign="middle">HRV, EDA, ST, and BVP</td>
</tr>
<tr>
<td align="left" valign="middle">
<xref ref-type="bibr" rid="ref22">Hardacre et al. (2021)</xref></td>
<td align="left" valign="middle">To identify background variables, language characteristics, and psychological or physiological factors related to anxiety in ethnic minority teacher candidates</td>
<td align="left" valign="middle">Mixed methods</td>
<td align="left" valign="middle">Postgraduate Students</td>
<td align="left" valign="middle">Standardized tests</td>
<td align="left" valign="middle">HR</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>From the preliminary investigation of the profiles of the participants, it was found that university students constituted the highest percentage (23.3%). In some of the studies, the characteristics of the participants were not mentioned (16.6%), while an equal percentage involved working with volunteers. Studies mentioned users involving children under 12&#x2009;years of age (10%). The least represented participants were physicians (6%), office and industrial workers (6%), graduate students (3%), children with special educational needs (3%), and patients (3%).</p>
<p>Subsequent examination of portable device activities revealed that controlled studies and simulated activities were performed (33.3%). Virtual reality environments were involved (6.6%), as were activities in authentic contexts (13.3%), such as emergency rooms and courts. Other activities included activities of daily living (10%), games that integrate motion-based touchless games (MBTG), games with different ASRs (avatar representation), movement-based educational games (MBEG; 10%), pedagogical activities aimed at developing data analysis tools (6.6%), and standardized tests (3.3%).</p>
</sec>
<sec id="sec8">
<label>3.2.</label>
<title>Development of competencies through the use of wearable devices</title>
<p>In response to the second research sub-question (RQ2), competencies (C) are distinguished and classified into two categories: general (G) and specific (E). General competencies (G) are referenced as the extensive skill sets required across various professions, encompassing aspects like teamwork, working toward objectives, initiative, leadership, time management, and independence. The analyzed studies found that the development phase of these general competencies was in progress (60%). Specific or disciplinary competencies refer to skills unique to particular disciplines, such as using data analysis programs and programming abilities. In the collected studies, these competencies were exhibited through practices prevalent across different fields, such as the creation of technological tools and the analysis of physiological attributes and states like stress, mental processes, concentration, and memory (27%). Furthermore, it was noted that a segment of the studies could not be categorized (13.3%) owing to the lack of processes that were directly connected with the teaching-learning paradigm. In addition, information pertaining to the competency analysis was cross-verified with the country in which each study was conducted (<xref rid="fig3" ref-type="fig">Figure 3</xref>).</p>
<fig position="float" id="fig3">
<label>Figure 3</label>
<caption>
<p>Countries versus competencies.</p>
</caption>
<graphic xlink:href="feduc-08-1220688-g003.tif"/>
</fig>
<p>This analysis facilitated the understanding that the emphasis was predominantly on the development of general competencies. In terms of disciplinary competencies, they accounted for all studies conducted in Germany, followed by Australia (65%), Japan (50%), the United States (42%), and Spain (24%).</p>
<p>Specifically, in the studies that refer to formal educational contexts, the different educational levels are linked to specific pedagogical activities. Undergraduate-level studies (11) are primarily related to simulated activities such as controlled studies (45%), virtual reality environments (9%), and activities in a real context (9%), among others. The elementary level (three studies) all linked games with different ASR (avatar representation); motion-based educational games (MBEG) and high school technologies defined a study with controlled variables. On the other hand, studies linked to non-educational contexts involved daily life activities (25%), real-world contextual activities (18%), the development of data analysis tools (8%), and the use of controlled environments with virtual reality (7%).</p>
</sec>
<sec id="sec9">
<label>3.3.</label>
<title>Biometric indicators linked to the use of portable devices</title>
<p>The biometric indicators gleaned from the studies relevant to this analysis are depicted (<xref rid="fig4" ref-type="fig">Figure 4</xref>). These biomarkers are highlighted on the left side of the diagram, set against a gray backdrop. The four central circles represent various combinations of biometric indicators, indicating the number of different biomarkers examined in tandem within each study (1, 2, 4, 5). The smaller numbers represent the total number of studies according to their respective combinations, while the labels on the right depict the meta-skills, understood as the foundational knowledge, abilities, and experiences upon which all life-acquired skills (both soft and hard) are built for each study.</p>
<fig position="float" id="fig4">
<label>Figure 4</label>
<caption>
<p>Biometric indicators versus units of analysis.</p>
</caption>
<graphic xlink:href="feduc-08-1220688-g004.tif"/>
</fig>
<p>Biometric indicators recognized within these studies include heart rate (HR), its variation (HRV), and electrodermal activity (EDA), also known as galvanic skin response (GSR). Each of these indicators was used in five different studies, with their combination proving to be the most common (seven studies). Only a single study combined EDA and accelerometer (ACC) data. A significant discovery was that seven studies incorporated four distinct physiological indicators, with the most frequently used (three studies) being electrodermal activity (EDA), skin temperature (ST), blood pressure volume (BVP), electroencephalography (EEG), and accelerometer (ACC). The other seven studies combined four indicators, linking others such as gaze, movement, and interbeat interval (IBI). It is worth noting that a single study combined five indicators.</p>
<p>These findings imply that various studies integrate biometric indicators and propose constructs, viewed in this research as units of analysis, to imbue the collected data with meaningful interpretation. Three primary categories integrating meta-skills stand out: data estimation (three studies) and behavior (three studies), incorporating performance analysis (four studies), alongside social skills (two studies), attention/interest (two studies), and physical activity (one study). The third category is cognitive load as a unit of analysis (two studies), comprised of emotion classification (six studies), mental fatigue (two studies), pain management (one study), cyber sickness (one study), stress (five studies), and anxiety (two studies).</p>
</sec>
<sec id="sec10">
<label>3.4.</label>
<title>Methods of analysis of data collected by wearable devices</title>
<p>Regarding the methods of data analysis, the use of quantitative approaches that include automated and continuous monitoring of physiological response data through the use of biometric sensors has been indicated (66.6%). Among the most prominent analysis methods, classification models such as support vector machines (SVM), k nearest neighbors (kNN), random forests (RF), extra trees (ET), and gradient boosting (GB) are declared. Furthermore, machine learning includes models (<xref ref-type="bibr" rid="ref17">Fucci et al., 2019</xref>; <xref ref-type="bibr" rid="ref59">Wampfler et al., 2019</xref>), algorithms (<xref ref-type="bibr" rid="ref11">Collins et al., 2019</xref>), and techniques (<xref ref-type="bibr" rid="ref30">Lee-Cultura et al., 2020a</xref>,<xref ref-type="bibr" rid="ref31">b</xref>; <xref ref-type="bibr" rid="ref1">Aguilar-Herrera et al., 2021</xref>). In addition, the need to incorporate technological innovations to capture, measure, and analyze physiological data was recognized. Wearable devices mentioned in the research include Wristband Empatica E4 (<xref ref-type="bibr" rid="ref21">Gouverneur et al., 2017</xref>; <xref ref-type="bibr" rid="ref44">Ragot et al., 2018</xref>; <xref ref-type="bibr" rid="ref26">Jenks et al., 2020</xref>; <xref ref-type="bibr" rid="ref42">Poli et al., 2020</xref>; <xref ref-type="bibr" rid="ref12">Cored Bandr&#x00E9;s et al., 2021</xref>; <xref ref-type="bibr" rid="ref24">Iadarola et al., 2021</xref>; <xref ref-type="bibr" rid="ref10">Climent-P&#x00E9;rez et al., 2022</xref>; <xref ref-type="bibr" rid="ref46">Raju et al., 2022</xref>), Biopac MP150 (<xref ref-type="bibr" rid="ref44">Ragot et al., 2018</xref>), Fitbit Charge HR, Apple Watch Series 4, and TicWatch Pro (<xref ref-type="bibr" rid="ref9">Choksatchawathi et al., 2020</xref>).</p>
<p>On the other hand, 33.3% of the studies accounted for were classified as mixed-type. In these cases, physiological parameters were measured, and these studies included data from self-report questionnaires and the results of standardized tests (<xref ref-type="bibr" rid="ref22">Hardacre et al., 2021</xref>). Likewise, it is acknowledged that the studies analyzed the recording of biometric signals and conducted correlational analysis with self-report information (<xref ref-type="bibr" rid="ref48">Ram&#x00ED;rez-Moreno et al., 2021a</xref>,<xref ref-type="bibr" rid="ref47">b</xref>). Additionally, the use of techniques such as questionnaires (<xref ref-type="bibr" rid="ref2">Alfredo et al., 2023</xref>), for example, the Fatigue Assessment Scale questionnaire and Enophones (<xref ref-type="bibr" rid="ref60">Wang et al., 2020</xref>), systematic observation (<xref ref-type="bibr" rid="ref12">Cored Bandr&#x00E9;s et al., 2021</xref>; <xref ref-type="bibr" rid="ref55">Tan et al., 2021</xref>), and semi-structured interviews and surveys is recognized.</p>
</sec>
</sec>
<sec sec-type="discussions" id="sec11">
<label>4.</label>
<title>Discussion</title>
<p>Wearable devices have been an alternative to identifying performance characteristics in activities contributing to teaching-learning. The study results allowed recognition of the main characteristics of research, such as describing the participants in the activities developed for data collection, the wide range of physiological indicators, and the methodologies to analyze multimodal data. These findings are consistent with those of the study by <xref ref-type="bibr" rid="ref20">Giannakos et al. (2022)</xref> since they highlight the use of multiple sources of data obtained from the interactions of students using different resources such as videos, e-books, games, and attending face-to-face classes, among others. The wide range of activities associated with collecting multimodal data highlights the relevance of linking and generating multidisciplinary spaces for a better understanding of developing the teaching-learning process in both pedagogical and real-world contexts.</p>
<p>Similarly, a variety of biometric indicators are recognized, including the HR, its variation (HRV), and electrodermal activity (EDA), also known as galvanic skin response (GSR), skin temperature (ST), blood pressure volume (BVP), and accelerometer (ACC), with some being related to the development of disciplinary competencies, such as data estimation, while others focus on generic variables, such as attention, stress, and anxiety. This understanding is in line with the findings described by <xref ref-type="bibr" rid="ref23">Hernandez-de-Menendez et al. (2021)</xref>, who highlighted the potential of biometric data in managing information related to learning. There has been a demonstrated interest in creating multimodal systems that automatically analyze student states that are difficult to observe with the naked eye, such as cognitive load and stress levels (<xref ref-type="bibr" rid="ref7">Bustos-L&#x00F3;pez et al., 2022</xref>). At this point, the significance of comprehending how data collected through portable devices in pedagogical contexts can serve as a support tool for learning management is emphasized, considering that its collection, fusion, and analysis pose challenges for integration.</p>
</sec>
<sec sec-type="conclusions" id="sec12">
<label>5.</label>
<title>Conclusion</title>
<p>This review was initiated with the question, &#x201C;What are the characteristics of studies that incorporate portable devices in the analysis of teaching-learning processes?&#x201D; This question led to the development of a methodology that identified the most relevant characteristics responsive to the objectives framed in each investigation. At a general level, the types of participants have been recognized, with university students, graduate students, volunteers, physicians, office and industrial workers, children under 12&#x2009;years old, children with special educational needs, and patients being among the most prominent ones. It is also acknowledged that these participants were involved in simulated activities, controlled studies, and pedagogical activities aimed at developing data analysis tools and standardized tests. The technological linkage between activities in virtual reality environments and authentic contexts, such as emergencies and courts, is highlighted.</p>
<p>Additionally, other activities encompassed activities of daily living, games that integrate motion-based touchless games (MBTG) with different avatar representations (ASRs), and educational games based on movement (MBEG). Moreover, the trend of utilizing biometric data such as the HR, its variation (HRV), and electrodermal activity (EDA) is highlighted. This is done to measure and detect stress, enable intervention, and improve attention and working memory. Additionally, it emphasizes the easy and portable use of sensors for measuring emotions and physical characteristics. Thus, the usefulness of technology (in this case, wearables) as tools for assessing the impact of an educational intervention is confirmed by our review.</p>
<p>Regarding the limitations of this research, an area of opportunity is identified in research sub-question number four. While the methods of multimodal data analysis are acknowledged, the characteristics considered for applying machine learning techniques to data gathered  via wearable devices could be more comprehensively elucidated. Likewise, it is recognized that in this research, it is impossible to demonstrate the direct impact of interventionist improvements in the various integrated contexts. It is proposed that future work should focus on the generation of multidisciplinary teams that can understand performance variables, aiming to create new methods for multimodal data collection and analysis that promote personalized learning. Furthermore, research should be encouraged to identify factors that affect learning to promote more fluid and reflective educational experiences for all those involved in the teaching-learning process.</p>
</sec>
<sec sec-type="data-availability" id="sec13">
<title>Data availability statement</title>
<p>The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.</p>
</sec>
<sec id="sec14">
<title>Author contributions</title>
<p>LG-M and MC-A contributed to the conception and design of the  study. JR-R organized the database. CA-N wrote the first draft of the manuscript. All authors contributed to the article and approved the submitted version.</p>
</sec>
<sec sec-type="funding-information" id="sec15">
<title>Funding</title>
<p>The authors acknowledge the financial and technical support of Writing Lab, the Institute for the Future of Education, Tecnologico de Monterrey, Mexico, in producing this study. The authors acknowledge the financial support of Tecnologico de Monterrey through the Challenge-Based Research Funding Program 2022. Project ID # I005-IFE001-C2-T3-T.</p>
</sec>
<sec sec-type="COI-statement" id="sec16">
<title>Conflict of interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec id="sec100" sec-type="disclaimer">
<title>Publisher&#x2019;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
</body>
<back>
<ref-list>
<title>References</title>
<ref id="ref1"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Aguilar-Herrera</surname> <given-names>A. J.</given-names></name> <name><surname>Delgado-Jim&#x00E9;nez</surname> <given-names>E. A.</given-names></name> <name><surname>Candela-Leal</surname> <given-names>M. O.</given-names></name> <name><surname>Olivas-Martinez</surname> <given-names>G.</given-names></name> <name><surname>&#x00C1;lvarez-Espinosa</surname> <given-names>G. J.</given-names></name> <name><surname>Ram&#x00ED;rez-Moreno</surname> <given-names>M. A.</given-names></name> <etal/></person-group>. (<year>2021</year>). Advanced learner Assistance System's (ALAS) Recent Results. 2021 Machine Learning-Driven Digital Technologies for Educational Innovation Workshop, Monterrey, Mexico 1&#x2013;7.</citation></ref>
<ref id="ref2"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Alfredo</surname> <given-names>R. D.</given-names></name> <name><surname>Nie</surname> <given-names>L.</given-names></name> <name><surname>Kennedy</surname> <given-names>P.</given-names></name> <name><surname>Power</surname> <given-names>T.</given-names></name> <name><surname>Hayes</surname> <given-names>C.</given-names></name> <name><surname>Chen</surname> <given-names>H.</given-names></name> <etal/></person-group>. (<year>2023</year>). "That Student Should be a Lion Tamer!" StressViz: Designing a Stress Analytics Dashboard for Teachers. LAK23: 13th International Learning Analytics and Knowledge Conference, 57&#x2013;67.</citation></ref>
<ref id="ref3"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Avella</surname> <given-names>J. T.</given-names></name> <name><surname>Kebritchi</surname> <given-names>M.</given-names></name> <name><surname>Nunn</surname> <given-names>S. G.</given-names></name> <name><surname>Kanai</surname> <given-names>T.</given-names></name></person-group> (<year>2016</year>). <article-title>Learning analytics methods, benefits, and challenges in higher education: a systematic literature review</article-title>. <source>Online Learn</source> <volume>20</volume>, <fpage>13</fpage>&#x2013;<lpage>29</lpage>. doi: <pub-id pub-id-type="doi">10.24059/olj.v20i2.790</pub-id></citation></ref>
<ref id="ref4"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Borrego</surname> <given-names>A.</given-names></name> <name><surname>Latorre</surname> <given-names>J.</given-names></name> <name><surname>Alca&#x00F1;iz</surname> <given-names>M.</given-names></name> <name><surname>Llorens</surname> <given-names>R.</given-names></name></person-group> (<year>2019</year>). &#x201C;<article-title>Reliability of the empatica E4 wristband to measure electrodermal activity to emotional stimuli</article-title>&#x201D; in <source>2019 International Conference on Virtual Rehabilitation (ICVR)</source> (<publisher-name>IEEE</publisher-name>), Tel Aviv, Israel, <fpage>1</fpage>&#x2013;<lpage>2</lpage>.</citation></ref>
<ref id="ref5"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Boucsein</surname> <given-names>W.</given-names></name></person-group> (<year>2012</year>). <source>Electrodermal Activity</source> (2nd Ed.). <publisher-name>Springer Science &#x0026; Business Media</publisher-name>. doi: <pub-id pub-id-type="doi">10.1007/978-1-4614-1126-0</pub-id></citation></ref>
<ref id="ref6"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bulagang</surname> <given-names>A. F.</given-names></name> <name><surname>Mountstephens</surname> <given-names>J.</given-names></name> <name><surname>Teo</surname> <given-names>J.</given-names></name></person-group> (<year>2021</year>). <article-title>Multiclass emotion prediction using heart rate and virtual reality stimuli</article-title>. <source>J Big Data</source> <volume>8</volume>, <fpage>1</fpage>&#x2013;<lpage>12</lpage>. doi: <pub-id pub-id-type="doi">10.1186/s40537-020-00401-x</pub-id></citation></ref>
<ref id="ref7"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bustos-L&#x00F3;pez</surname> <given-names>M.</given-names></name> <name><surname>Cruz-Ram&#x00ED;rez</surname> <given-names>N.</given-names></name> <name><surname>Guerra-Hern&#x00E1;ndez</surname> <given-names>A.</given-names></name> <name><surname>S&#x00E1;nchez-Morales</surname> <given-names>L. N.</given-names></name> <name><surname>Cruz-Ramos</surname> <given-names>N. A.</given-names></name> <name><surname>Alor-Hern&#x00E1;ndez</surname> <given-names>G.</given-names></name></person-group> (<year>2022</year>). <article-title>Wearables for engagement detection in learning environments: a review</article-title>. <source>Biosensors</source> <volume>12</volume>:<fpage>509</fpage>. doi: <pub-id pub-id-type="doi">10.3390/bios12070509</pub-id>, PMID: <pub-id pub-id-type="pmid">35884312</pub-id></citation></ref>
<ref id="ref8"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Chandra</surname> <given-names>V.</given-names></name> <name><surname>Priyarup</surname> <given-names>A.</given-names></name> <name><surname>Sethia</surname> <given-names>D.</given-names></name></person-group> (<year>2021</year>). &#x201C;<article-title>Comparative study of physiological signals from empatica E4 wristband for stress classification</article-title>&#x201D; in <source>Advances in Computing and Data Sciences: 5th International Conference, ICACDS 2021, Nashik, India, April 23&#x2013;24, 2021, Revised Selected Papers, Part II 5</source>, Eds. <person-group person-group-type="editor"><name><surname>Singh</surname> <given-names>M.</given-names></name> <name><surname>Tyagi</surname> <given-names>V.</given-names></name> <name><surname>Gupta</surname> <given-names>P. K.</given-names></name> <name><surname>Flusser</surname> <given-names>J.</given-names></name> <name><surname>&#x00D6;ren</surname> <given-names>T.</given-names></name> <name><surname>Sonawane</surname> <given-names>V. R.</given-names></name></person-group> (Nashik, India: <publisher-name>Springer International Publishing</publisher-name>), <fpage>218</fpage>&#x2013;<lpage>229</lpage>.</citation></ref>
<ref id="ref9"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Choksatchawathi</surname> <given-names>T.</given-names></name> <name><surname>Ponglertnapakorn</surname> <given-names>P.</given-names></name> <name><surname>Ditthapron</surname> <given-names>A.</given-names></name> <name><surname>Leelaarporn</surname> <given-names>P.</given-names></name> <name><surname>Wisutthisen</surname> <given-names>T.</given-names></name> <name><surname>Piriyajitakonkij</surname> <given-names>M.</given-names></name> <etal/></person-group>. (<year>2020</year>). <article-title>Improving heart rate estimation on consumer-grade wrist-worn device using a post-calibration approach</article-title>. <source>IEEE Sensors J.</source> <volume>20</volume>, <fpage>7433</fpage>&#x2013;<lpage>7446</lpage>. doi: <pub-id pub-id-type="doi">10.1109/JSEN.2020.2979191</pub-id></citation></ref>
<ref id="ref10"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Climent-P&#x00E9;rez</surname> <given-names>P.</given-names></name> <name><surname>Mu&#x00F1;oz-Ant&#x00F3;n</surname> <given-names>&#x00C1;. M.</given-names></name> <name><surname>Poli</surname> <given-names>A.</given-names></name> <name><surname>Spinsante</surname> <given-names>S.</given-names></name> <name><surname>Florez-Revuelta</surname> <given-names>F.</given-names></name></person-group> (<year>2022</year>). <article-title>Dataset of acceleration signals recorded while performing activities of daily living</article-title>. <source>Data Brief</source> <volume>41</volume>:<fpage>107896</fpage>. doi: <pub-id pub-id-type="doi">10.1016/j.dib.2022.107896</pub-id>, PMID: <pub-id pub-id-type="pmid">35198677</pub-id></citation></ref>
<ref id="ref11"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Collins</surname> <given-names>J.</given-names></name> <name><surname>Regenbrecht</surname> <given-names>H.</given-names></name> <name><surname>Langlotz</surname> <given-names>T.</given-names></name> <name><surname>Can</surname> <given-names>Y. S.</given-names></name> <name><surname>Ersoy</surname> <given-names>C.</given-names></name> <name><surname>Butson</surname> <given-names>R.</given-names></name></person-group> (<year>2019</year>). Measuring Cognitive Load and Insight: A Methodology Exemplified in a Virtual Reality Learning Context. 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), 351&#x2013;362.</citation></ref>
<ref id="ref12"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cored Bandr&#x00E9;s</surname> <given-names>S.</given-names></name> <name><surname>V&#x00E1;zquez Toledo</surname> <given-names>S.</given-names></name> <name><surname>Liesa Or&#x00FA;s</surname> <given-names>M.</given-names></name> <name><surname>Baldassarri</surname> <given-names>S.</given-names></name></person-group> (<year>2021</year>). <article-title>La potencialidad de la tecnolog&#x00ED;a en la medici&#x00F3;n del desarrollo de habilidades sociales en ni&#x00F1;os con TEA: un an&#x00E1;lisis desde par&#x00E1;metros fisiol&#x00F3;gicos</article-title>. <source>Rev Invest Educ</source> <volume>39</volume>, <fpage>445</fpage>&#x2013;<lpage>462</lpage>. doi: <pub-id pub-id-type="doi">10.6018/rie.430891</pub-id></citation></ref>
<ref id="ref13"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cukurova</surname> <given-names>M.</given-names></name> <name><surname>Giannakos</surname> <given-names>M.</given-names></name> <name><surname>Martinez-Maldonado</surname> <given-names>R.</given-names></name></person-group> (<year>2020</year>). <article-title>The promise and challenges of multimodal learning analytics</article-title>. <source>Br. J. Educ. Technol.</source> <volume>51</volume>, <fpage>1441</fpage>&#x2013;<lpage>1449</lpage>. doi: <pub-id pub-id-type="doi">10.1111/bjet.13015</pub-id></citation></ref>
<ref id="ref14"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>DiMitri</surname> <given-names>D.</given-names></name> <name><surname>Schneider</surname> <given-names>J.</given-names></name> <name><surname>Specht</surname> <given-names>M.</given-names></name> <name><surname>Drachsler</surname> <given-names>H.</given-names></name></person-group> (<year>2018</year>). <article-title>From signals to knowledge: a conceptual model for multimodal learning analytics</article-title>. <source>J. Comput. Assist. Learn.</source> <volume>34</volume>, <fpage>338</fpage>&#x2013;<lpage>349</lpage>. doi: <pub-id pub-id-type="doi">10.1111/jcal.12288</pub-id></citation></ref>
<ref id="ref15"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Eradze</surname> <given-names>M.</given-names></name> <name><surname>Laanpere</surname> <given-names>M.</given-names></name></person-group> (<year>2017</year>). &#x201C;<article-title>Lesson observation data in learning analytics datasets: observata</article-title>&#x201D; in <source>Data Driven Approaches in Digital Education: 12th European Conference on Technology Enhanced Learning, EC-TEL 2017, Tallinn, Estonia, September 12&#x2013;15, 2017, Proceedings 12</source>. Eds. <person-group person-group-type="editor"><name><surname>Lavou&#x00E9;</surname> <given-names>&#x00C9;.</given-names></name> <name><surname>Drachsler</surname> <given-names>H.</given-names></name> <name><surname>Verbert</surname> <given-names>K.</given-names></name> <name><surname>Broisin</surname> <given-names>J.</given-names></name> <name><surname>P&#x00E9;rez-Sanagust&#x00ED;n</surname> <given-names>M.</given-names></name></person-group> (Tallinn, Estonia: <publisher-name>Springer International Publishing</publisher-name>), <fpage>504</fpage>&#x2013;<lpage>508</lpage>.</citation></ref>
<ref id="ref16"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ferguson</surname> <given-names>R.</given-names></name></person-group> (<year>2012</year>). <article-title>Learning analytics: drivers, developments, and challenges</article-title>. <source>Int J Technol Enhanc Learn.</source> <volume>4</volume>, <fpage>304</fpage>&#x2013;<lpage>317</lpage>. doi: <pub-id pub-id-type="doi">10.1504/IJTEL.2012.051816</pub-id></citation></ref>
<ref id="ref17"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Fucci</surname> <given-names>D.</given-names></name> <name><surname>Girardi</surname> <given-names>D.</given-names></name> <name><surname>Novielli</surname> <given-names>N.</given-names></name> <name><surname>Quaranta</surname> <given-names>L.</given-names></name> <name><surname>Lanubile</surname> <given-names>F.</given-names></name></person-group> (<year>2019</year>). A Replication Study on Code Comprehension and Expertise Using Lightweight Biometric Sensors. 2019 IEEE/ACM 27th International Conference on Program Comprehension (ICPC), 311&#x2013;322.</citation></ref>
<ref id="ref18"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Garbarino</surname> <given-names>M.</given-names></name> <name><surname>Lai</surname> <given-names>M.</given-names></name> <name><surname>Bender</surname> <given-names>D.</given-names></name> <name><surname>Picard</surname> <given-names>R. W.</given-names></name> <name><surname>Tognetti</surname> <given-names>S.</given-names></name></person-group> (<year>2014</year>). &#x201C;<article-title>Empatica E3&#x2014;a wearable wireless multi-sensor device for real-time computerized biofeedback and data acquisition</article-title>&#x201D; in <source>2014 4th International Conference on Wireless Mobile Communication and Healthcare-Transforming Healthcare through Innovations in Mobile and Wireless Technologies (MOBIHEALTH)</source> (Athens, Greece: <publisher-name>IEEE</publisher-name>), <fpage>39</fpage>&#x2013;<lpage>42</lpage>.</citation></ref>
<ref id="ref19"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ghandi</surname> <given-names>M.</given-names></name></person-group> (<year>2019</year>). <article-title>Cyber-Physical Emotive Spaces: Human Cyborg, Data, and Biofeedback Emotive Interaction with Compassionate Spaces</article-title>. <source>Blucher Design Proceedings</source> <volume>2</volume>, <fpage>655</fpage>&#x2013;<lpage>664</lpage>.</citation></ref>
<ref id="ref20"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Giannakos</surname> <given-names>M.</given-names></name> <name><surname>Spikol</surname> <given-names>D.</given-names></name> <name><surname>Di Mitri</surname> <given-names>D.</given-names></name> <name><surname>Sharma</surname> <given-names>K.</given-names></name> <name><surname>Ochoa</surname> <given-names>X.</given-names></name> <name><surname>Hammad</surname> <given-names>R.</given-names></name></person-group> (<year>2022</year>). <article-title>Introduction to multimodal learning analytics</article-title>. In <person-group person-group-type="editor"><name><surname>Giannakos</surname> <given-names>M.</given-names></name> <name><surname>Spikol</surname> <given-names>D.</given-names></name> <name><surname>Mitri</surname> <given-names>D.</given-names><prefix>Di</prefix></name> <name><surname>Sharma</surname> <given-names>K.</given-names></name> <name><surname>Ochoa</surname> <given-names>X.</given-names></name> <name><surname>Hammad</surname> <given-names>R.</given-names></name></person-group>, (Eds.), <source>The Multimodal Learning Analytics Handbook</source>. <publisher-name>Springer Nature Switzerland AG</publisher-name>.</citation></ref>
<ref id="ref21"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Gouverneur</surname> <given-names>P.</given-names></name> <name><surname>Jaworek-Korjakowska</surname> <given-names>J.</given-names></name> <name><surname>K&#x00F6;ping</surname> <given-names>L.</given-names></name> <name><surname>Shirahama</surname> <given-names>K.</given-names></name> <name><surname>Kleczek</surname> <given-names>P.</given-names></name> <name><surname>Grzegorzek</surname> <given-names>M.</given-names></name></person-group> (<year>2017</year>). Classification of Physiological Data for Emotion Recognition. Artificial Intelligence and Soft Computing: 16th International conference, ICAISC 2017, Zakopane, Poland, June 11-15, 2017, Proceedings, Part I 10245, 619&#x2013;627.</citation></ref>
<ref id="ref22"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hardacre</surname> <given-names>B.</given-names></name> <name><surname>Hafner</surname> <given-names>A.</given-names></name> <name><surname>Nakama</surname> <given-names>P.</given-names></name></person-group> (<year>2021</year>). <article-title>The impact of test anxiety on teacher credential candidates</article-title>. <source>Teach. Educ. Q.</source> <volume>48</volume>, <fpage>7</fpage>&#x2013;<lpage>28</lpage>.</citation></ref>
<ref id="ref23"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hernandez-de-Menendez</surname> <given-names>M.</given-names></name> <name><surname>Morales-Menendez</surname> <given-names>R.</given-names></name> <name><surname>Escobar</surname> <given-names>C. A.</given-names></name> <name><surname>Arinez</surname> <given-names>J.</given-names></name></person-group> (<year>2021</year>). <article-title>Biometric applications in education</article-title>. <source>Int. J. Interact. Design Manuf.</source> <volume>15</volume>, <fpage>365</fpage>&#x2013;<lpage>380</lpage>. doi: <pub-id pub-id-type="doi">10.1007/s12008-021-00760-6</pub-id></citation></ref>
<ref id="ref24"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Iadarola</surname> <given-names>G.</given-names></name> <name><surname>Poli</surname> <given-names>A.</given-names></name> <name><surname>Spinsante</surname> <given-names>S.</given-names></name></person-group> (<year>2021</year>). Analysis of Galvanic Skin Response to Acoustic Stimuli by Wearable Devices. 2021 IEEE International Symposium on Medical Measurements and Applications (MeMeA), 1&#x2013;6.</citation></ref>
<ref id="ref25"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>J&#x00E4;rvenoja</surname> <given-names>H.</given-names></name> <name><surname>J&#x00E4;rvel&#x00E4;</surname> <given-names>S.</given-names></name> <name><surname>T&#x00F6;rm&#x00E4;nen</surname> <given-names>T.</given-names></name> <name><surname>N&#x00E4;ykki</surname> <given-names>P.</given-names></name> <name><surname>Malmberg</surname> <given-names>J.</given-names></name> <name><surname>Kurki</surname> <given-names>K.</given-names></name> <etal/></person-group>. (<year>2018</year>). <article-title>Capturing motivation and emotion regulation during a learning process</article-title>. <source>Frontline Learn. Res.</source> <volume>6</volume>, <fpage>85</fpage>&#x2013;<lpage>104</lpage>. doi: <pub-id pub-id-type="doi">10.14786/flr.v6i3.369</pub-id></citation></ref>
<ref id="ref26"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jenks</surname> <given-names>S.</given-names></name> <name><surname>Peacock</surname> <given-names>W. F.</given-names></name> <name><surname>Cornelius</surname> <given-names>A. P.</given-names></name> <name><surname>Shafer</surname> <given-names>S.</given-names></name> <name><surname>Pillow</surname> <given-names>M. T.</given-names></name> <name><surname>Rayasam</surname> <given-names>S. S.</given-names></name></person-group> (<year>2020</year>). <article-title>Heart rate and heart rate variability in emergency medicine</article-title>. <source>Am. J. Emerg. Med.</source> <volume>38</volume>, <fpage>1335</fpage>&#x2013;<lpage>1339</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.ajem.2019.10.035</pub-id>, PMID: <pub-id pub-id-type="pmid">31836346</pub-id></citation></ref>
<ref id="ref27"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Koelstra</surname> <given-names>S.</given-names></name> <name><surname>Yazdani</surname> <given-names>A.</given-names></name> <name><surname>Soleymani</surname> <given-names>M.</given-names></name> <name><surname>M&#x00FC;hl</surname> <given-names>C.</given-names></name> <name><surname>Lee</surname> <given-names>J.-S.</given-names></name> <name><surname>Nijholt</surname> <given-names>A.</given-names></name> <etal/></person-group>. (<year>2010</year>). Single-Trial Classification of EEG and Peripheral Physiological Signals for Recognition of Emotions Induced by Music Videos. Brain Informatics: International Conference, BI 2010, Toronto, ON, Canada, August 28&#x2013;30, 2010. Proceedings, 89&#x2013;100.</citation></ref>
<ref id="ref28"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Koskim&#x00E4;ki</surname> <given-names>H.</given-names></name> <name><surname>M&#x00F6;nttinen</surname> <given-names>H.</given-names></name> <name><surname>Siirtola</surname> <given-names>P.</given-names></name> <name><surname>Huttunen</surname> <given-names>H. L.</given-names></name> <name><surname>Halonen</surname> <given-names>R.</given-names></name> <name><surname>R&#x00F6;ning</surname> <given-names>J.</given-names></name></person-group> (<year>2017</year>). Early Detection of Migraine Attacks Based on Wearable Sensors: Experiences of Data Collection Using Empatica E4. In Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers (pp. 506&#x2013;511).</citation></ref>
<ref id="ref29"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lee-Cultura</surname> <given-names>S.</given-names></name> <name><surname>Sharma</surname> <given-names>K.</given-names></name> <name><surname>Cosentino</surname> <given-names>G.</given-names></name> <name><surname>Papavlasopoulou</surname> <given-names>S.</given-names></name> <name><surname>Giannakos</surname> <given-names>M.</given-names></name></person-group> (<year>2021</year>). Children&#x2019;s play and problem-solving in motion-based educational games: Synergies between human annotations and multi-modal data. Interaction Design and Children, <italic>In IDC &#x2018;21: Proceedings of the 20th Annual ACM Interaction Design and Children Conference, Association for Computing Machinery</italic>, New York, NY, United States. doi: <pub-id pub-id-type="doi">10.1145/3459990.3460702</pub-id></citation></ref>
<ref id="ref30"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Lee-Cultura</surname> <given-names>S.</given-names></name> <name><surname>Sharma</surname> <given-names>K.</given-names></name> <name><surname>Papavlasopoulou</surname> <given-names>S.</given-names></name> <name><surname>Giannakos</surname> <given-names>M.</given-names></name></person-group> (<year>2020a</year>). Motion-Based Educational Games: Using Multimodal Data to Predict Player's Performance. 2020 IEEE Conference on Games (Cog), 17&#x2013;24.</citation></ref>
<ref id="ref31"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Lee-Cultura</surname> <given-names>S.</given-names></name> <name><surname>Sharma</surname> <given-names>K.</given-names></name> <name><surname>Papavlasopoulou</surname> <given-names>S.</given-names></name> <name><surname>Retalis</surname> <given-names>S.</given-names></name> <name><surname>Giannakos</surname> <given-names>M.</given-names></name></person-group> (<year>2020b</year>). Motion-based  educational games: Using multi-modal data to predict player&#x2019;s performance. In 2020 IEEE Conference on Games (CoG), Osaka, Japan: IEEE. doi: <pub-id pub-id-type="doi">10.1109/CoG47356.2020.9231892</pub-id></citation></ref>
<ref id="ref32"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Lin</surname> <given-names>C.-J.</given-names></name></person-group>, y <person-group person-group-type="author"><name><surname>Hwang</surname> <given-names>G.-J.</given-names></name></person-group> (<year>2018</year>). <article-title>A learning analytics approach to investigating factors affecting EFL students&#x2019; oral performance in a flipped classroom</article-title>. <source>J. Educ. Technol. Soc.</source>, <volume>21</volume>, <fpage>205</fpage>&#x2013;<lpage>219</lpage>.</citation></ref>
<ref id="ref33"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Magaki</surname> <given-names>T.</given-names></name> <name><surname>Vallance</surname> <given-names>M.</given-names></name></person-group> (<year>2019</year>). Developing an Accessible Evaluation Method of VR Cybersickness. 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 1072&#x2013;1073.</citation></ref>
<ref id="ref34"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Martinez</surname> <given-names>C. C. L.</given-names></name></person-group> (<year>2019</year>). <source>Implementation of a Multisensor Wearable Artificial Pancreas Platform: Ensuring Safety with Communication Robustness and Cyber Security</source>. Illinois Institute of Technology&#x2009;ProQuest Dissertations Publishing.</citation></ref>
<ref id="ref35"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Monsalves</surname> <given-names>D.</given-names></name> <name><surname>Reyes</surname> <given-names>H. C.</given-names></name> <name><surname>Riquelme</surname> <given-names>F.</given-names></name></person-group> (<year>2023</year>). <article-title>Anal&#x00ED;tica multimodal del aprendizaje en Chile: una revisi&#x00F3;n sistem&#x00E1;tica</article-title>. <source>Apuntes Cienc. Soc.</source> <volume>11</volume>, <fpage>70</fpage>&#x2013;<lpage>80</lpage>. doi: <pub-id pub-id-type="doi">10.18259/acs.2023008</pub-id></citation></ref>
<ref id="ref36"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mu</surname> <given-names>S.</given-names></name> <name><surname>Cui</surname> <given-names>M.</given-names></name> <name><surname>Huang</surname> <given-names>X.</given-names></name></person-group> (<year>2020</year>). <article-title>Multimodal data fusion in learning analytics: a systematic review</article-title>. <source>Sensors</source> <volume>20</volume>:<fpage>6856</fpage>. doi: <pub-id pub-id-type="doi">10.3390/s20236856</pub-id>, PMID: <pub-id pub-id-type="pmid">33266131</pub-id></citation></ref>
<ref id="ref37"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Novak</surname> <given-names>J.</given-names></name></person-group> (<year>2019</year>). <article-title>Assessment of the impact of acute stress in cases of necessary defense by Czech courts. Ido movement for culture</article-title>. <source>J. Martial Arts Anthropol.</source> <volume>19</volume>, <fpage>89</fpage>&#x2013;<lpage>91</lpage>. doi: <pub-id pub-id-type="doi">10.14589/ido.19.1S.13</pub-id></citation></ref>
<ref id="ref38"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Ollander</surname> <given-names>S.</given-names></name> <name><surname>Godin</surname> <given-names>C.</given-names></name> <name><surname>Campagne</surname> <given-names>A.</given-names></name> <name><surname>Charbonnier</surname> <given-names>S.</given-names></name></person-group> (<year>2016</year>). &#x201C;<article-title>A comparison of wearable and stationary sensors for stress detection</article-title>&#x201D; in <source>2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC)</source> (Budapest, Hungary: <publisher-name>IEEE</publisher-name>), <fpage>004362</fpage>&#x2013;<lpage>004366</lpage>.</citation></ref>
<ref id="ref39"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Page</surname> <given-names>M. J.</given-names></name> <name><surname>McKenzie</surname> <given-names>J. E.</given-names></name> <name><surname>Bossuyt</surname> <given-names>P. M.</given-names></name> <name><surname>Boutron</surname> <given-names>I.</given-names></name> <name><surname>Hoffmann</surname> <given-names>T. C.</given-names></name> <name><surname>Mulrow</surname> <given-names>C. D.</given-names></name> <etal/></person-group>. (<year>2021</year>). <article-title>Updating guidance for reporting systematic reviews: development of the PRISMA 2020 statement</article-title>. <source>J. Clin. Epidemiol.</source> <volume>134</volume>, <fpage>103</fpage>&#x2013;<lpage>112</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.jclinepi.2021.02.003</pub-id>, PMID: <pub-id pub-id-type="pmid">33577987</pub-id></citation></ref>
<ref id="ref40"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Perales</surname> <given-names>F. J.</given-names></name> <name><surname>Riera</surname> <given-names>L.</given-names></name> <name><surname>Ramis</surname> <given-names>S.</given-names></name> <name><surname>Guerrero</surname> <given-names>A.</given-names></name></person-group> (<year>2019</year>). <article-title>Evaluation of a VR system for pain management using binaural acoustic stimulation</article-title>. <source>Multimed. Tools Appl.</source> <volume>78</volume>, <fpage>32869</fpage>&#x2013;<lpage>32890</lpage>. doi: <pub-id pub-id-type="doi">10.1007/s11042-019-07953-y</pub-id></citation></ref>
<ref id="ref41"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Peters</surname> <given-names>G. A.</given-names></name> <name><surname>Wong</surname> <given-names>M. L.</given-names></name> <name><surname>Sanchez</surname> <given-names>L. D.</given-names></name></person-group> (<year>2020</year>). <article-title>Pedometer-measured physical activity among emergency physicians during shifts</article-title>. <source>Am. J. Emerg. Med.</source> <volume>38</volume>, <fpage>118</fpage>&#x2013;<lpage>121</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.ajem.2019.07.019</pub-id></citation></ref>
<ref id="ref42"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Poli</surname> <given-names>A.</given-names></name> <name><surname>Cosoli</surname> <given-names>G.</given-names></name> <name><surname>Scalise</surname> <given-names>L.</given-names></name> <name><surname>Spinsante</surname> <given-names>S.</given-names></name></person-group> (<year>2020</year>). <article-title>Impact of wearable measurement properties and data quality on ADLs classification accuracy</article-title>. <source>IEEE Sensors J.</source> <volume>21</volume>, <fpage>14221</fpage>&#x2013;<lpage>14231</lpage>. doi: <pub-id pub-id-type="doi">10.1109/JSEN.2020.3009368</pub-id></citation></ref>
<ref id="ref43"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Quadri</surname> <given-names>A.</given-names></name> <name><surname>Shukor</surname> <given-names>N.</given-names></name></person-group> (<year>2021</year>). <article-title>The benefits of learning analytics to higher education institutions: a scoping review</article-title>. <source>Int. J. Emerg. Technol. Learn.</source> <volume>16</volume>, <fpage>4</fpage>&#x2013;<lpage>15</lpage>. doi: <pub-id pub-id-type="doi">10.3991/ijet.v16i23.27471</pub-id></citation></ref>
<ref id="ref44"><citation citation-type="book"><person-group person-group-type="author"><name><surname>Ragot</surname> <given-names>M.</given-names></name> <name><surname>Martin</surname> <given-names>N.</given-names></name> <name><surname>Em</surname> <given-names>S.</given-names></name> <name><surname>Pallamin</surname> <given-names>N.</given-names></name> <name><surname>Diverrez</surname> <given-names>J.-M.</given-names></name></person-group> (<year>2018</year>). &#x201C;<article-title>Emotion recognition using physiological signals: laboratory vs. wearable sensors</article-title>&#x201D; in <source>Advances in Human Factors in Wearable Technologies and Game Design</source>. eds. <person-group person-group-type="editor"><name><surname>Ahram</surname> <given-names>T.</given-names></name> <name><surname>Falc&#x00E3;o</surname> <given-names>C.</given-names></name></person-group> (Budapest, Hungary: <publisher-name>Springer International Publishing</publisher-name>), <fpage>15</fpage>&#x2013;<lpage>22</lpage>.</citation></ref>
<ref id="ref45"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rahman</surname> <given-names>J. S.</given-names></name> <name><surname>Gedeon</surname> <given-names>T.</given-names></name> <name><surname>Caldwell</surname> <given-names>S.</given-names></name> <name><surname>Jones</surname> <given-names>R.</given-names></name> <name><surname>Jin</surname> <given-names>Z.</given-names></name></person-group> (<year>2021</year>). <article-title>Towards effective music therapy for mental health care using machine learning tools: human affective reasoning and music genres</article-title>. <source>J. Artif. Intell. Soft Comput. Res.</source> <volume>11</volume>, <fpage>5</fpage>&#x2013;<lpage>20</lpage>. doi: <pub-id pub-id-type="doi">10.2478/jaiscr-2021-0001</pub-id></citation></ref>
<ref id="ref46"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Raju</surname> <given-names>G.</given-names></name> <name><surname>Sorby</surname> <given-names>S. A.</given-names></name> <name><surname>Panther</surname> <given-names>G.</given-names></name> <name><surname>Reid</surname> <given-names>C.</given-names></name> <name><surname>Mogadam</surname> <given-names>J. H.</given-names></name></person-group> (<year>2022</year>). Differences in Perceived Stress Levels and Measured Stress While Solving Spatial Tests. 2022 ASEE Annual Conference &#x0026; Exposition.</citation></ref>
<ref id="ref47"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ram&#x00ED;rez-Moreno</surname> <given-names>M. A.</given-names></name> <name><surname>Carrillo-Tijerina</surname> <given-names>P.</given-names></name> <name><surname>Candela-Leal</surname> <given-names>M. O.</given-names></name> <name><surname>Alanis-Espinosa</surname> <given-names>M.</given-names></name> <name><surname>Tud&#x00F3;n-Mart&#x00ED;nez</surname> <given-names>J. C.</given-names></name> <name><surname>Roman-Flores</surname> <given-names>A.</given-names></name> <etal/></person-group>. (<year>2021b</year>). <article-title>Evaluation of a fast test based on biometric signals to assess mental fatigue at the workplace&#x2014;a pilot study</article-title>. <source>Int. J. Environ. Res. Public Health</source> <volume>18</volume>:<fpage>11891</fpage>. doi: <pub-id pub-id-type="doi">10.3390/ijerph182211891</pub-id>, PMID: <pub-id pub-id-type="pmid">34831645</pub-id></citation></ref>
<ref id="ref48"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ram&#x00ED;rez-Moreno</surname> <given-names>M. A.</given-names></name> <name><surname>D&#x00ED;az-Padilla</surname> <given-names>M.</given-names></name> <name><surname>Valenzuela-G&#x00F3;mez</surname> <given-names>K. D.</given-names></name> <name><surname>Vargas-Mart&#x00ED;nez</surname> <given-names>A.</given-names></name> <name><surname>Tud&#x00F3;n-Mart&#x00ED;nez</surname> <given-names>J. C.</given-names></name> <name><surname>Morales-Menendez</surname> <given-names>R.</given-names></name> <etal/></person-group>. (<year>2021a</year>). <article-title>Eeg-based tool for prediction of university students' cognitive performance in the classroom</article-title>. <source>Brain Sci.</source> <volume>11</volume>:<fpage>698</fpage>. doi: <pub-id pub-id-type="doi">10.3390/brainsci11060698</pub-id>, PMID: <pub-id pub-id-type="pmid">34073242</pub-id></citation></ref>
<ref id="ref49"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Regalia</surname> <given-names>G.</given-names></name> <name><surname>Onorati</surname> <given-names>F.</given-names></name> <name><surname>Lai</surname> <given-names>M.</given-names></name> <name><surname>Caborni</surname> <given-names>C.</given-names></name> <name><surname>Picard</surname> <given-names>R. W.</given-names></name></person-group> (<year>2019</year>). <article-title>Multimodal wrist-worn devices for seizure detection and advancing research: focus on the Empatica wristbands</article-title>. <source>Epilepsy Res.</source> <volume>153</volume>, <fpage>79</fpage>&#x2013;<lpage>82</lpage>. doi: <pub-id pub-id-type="doi">10.1016/j.eplepsyres.2019.02.007</pub-id>, PMID: <pub-id pub-id-type="pmid">30846346</pub-id></citation></ref>
<ref id="ref50"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rivers</surname> <given-names>D. J.</given-names></name></person-group> (<year>2022</year>). <article-title>The situation specific arousal analyzer: innovation in the physiological assessment of foreign language education anxiety</article-title>. <source>Front. Educ.</source> <volume>7</volume>:<fpage>10</fpage>. doi: <pub-id pub-id-type="doi">10.3389/feduc.2022.802639</pub-id></citation></ref>
<ref id="ref51"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rodr&#x00ED;guez-Triana</surname> <given-names>M. J.</given-names></name> <name><surname>Prieto</surname> <given-names>L. P.</given-names></name> <name><surname>Vozniuk</surname> <given-names>A.</given-names></name> <name><surname>Boroujeni</surname> <given-names>M. S.</given-names></name> <name><surname>Schwendimann</surname> <given-names>B. A.</given-names></name> <name><surname>Holzer</surname> <given-names>A.</given-names></name> <etal/></person-group>. (<year>2017</year>). <article-title>Monitoring, awareness, and reflection in blended technology enhanced learning: a systematic review</article-title>. <source>Int. J. Technol. Enhanc. Learn.</source> <volume>9</volume>, <fpage>126</fpage>&#x2013;<lpage>150</lpage>. doi: <pub-id pub-id-type="doi">10.1504/IJTEL.2017.084489</pub-id></citation></ref>
<ref id="ref52"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Ronda-Carracao</surname> <given-names>M. A.</given-names></name> <name><surname>Santos</surname> <given-names>O. C.</given-names></name> <name><surname>Fernandez-Nieto</surname> <given-names>G.</given-names></name> <name><surname>Martinez-Maldonado</surname> <given-names>R.</given-names></name></person-group> (<year>2021</year>). Towards Exploring Stress Reactions in Teamwork Using Multimodal Physiological Data. CEUR Workshop Proceedings.</citation></ref>
<ref id="ref53"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sedraz Silva</surname> <given-names>J. C.</given-names></name> <name><surname>Souza</surname> <given-names>D.</given-names></name> <name><surname>Daf</surname> <given-names>F.</given-names></name> <name><surname>Cavalcanti Ramos</surname> <given-names>J. L.</given-names></name> <name><surname>Rodrigues</surname> <given-names>R. L.</given-names></name> <name><surname>Zambom</surname> <given-names>E.</given-names></name> <etal/></person-group>. (<year>2018</year>). <article-title>Assessment of the usability of a learning analytics resource dedicated to promoting self-regulated learning in flipped classroom</article-title>. <source>Rev. Latinoam. Tecnol. Educ. Relatec</source> <volume>17</volume>, <fpage>9</fpage>&#x2013;<lpage>23</lpage>. doi: <pub-id pub-id-type="doi">10.17398/1695-288X.17.2.9</pub-id></citation></ref>
<ref id="ref1001"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Siemens</surname> <given-names>G.</given-names></name> <name><surname>Long</surname> <given-names>P.</given-names></name></person-group> (<year>2011</year>). Penetrating the fog: Analytics in learning and education. EDUCAUSE review, 46, 30.</citation></ref>
<ref id="ref1002"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Siemens</surname> <given-names>G.</given-names></name> <name><surname>Gasevic</surname> <given-names>D.</given-names></name></person-group> (<year>2012</year>). Guest editorial-learning and knowledge analytics. Journal of Educational Technology &#x0026; Society, 15, 1&#x2013;2.</citation></ref>
<ref id="ref54"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Spann</surname> <given-names>C. A.</given-names></name> <name><surname>Schaeffer</surname> <given-names>J.</given-names></name> <name><surname>Siemens</surname> <given-names>G.</given-names></name></person-group> (<year>2017</year>). Expanding the Scope of Learning Analytics Data: Preliminary Findings on Attention and Self-Regulation Using Wearable Technology. In Proceedings of the Seventh International Learning Analytics &#x0026; Knowledge Conference (pp. 203&#x2013;207).</citation></ref>
<ref id="ref55"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tan</surname> <given-names>A. L.</given-names></name> <name><surname>Gillies</surname> <given-names>R.</given-names></name> <name><surname>Jamaludin</surname> <given-names>A.</given-names></name></person-group> (<year>2021</year>). <article-title>A case study: using a neuro-physiological measure to monitor students' interest and learning during a micro: bit activity</article-title>. <source>Educ. Sci.</source> <volume>11</volume>:<fpage>379</fpage>. doi: <pub-id pub-id-type="doi">10.3390/educsci11080379</pub-id></citation></ref>
<ref id="ref56"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tempelaar</surname> <given-names>D.</given-names></name> <name><surname>Rienties</surname> <given-names>B.</given-names></name> <name><surname>Nguyen</surname> <given-names>Q.</given-names></name></person-group> (<year>2020</year>). <article-title>Subjective data, objective data and the role of bias in predictive modelling: lessons from a dispositional learning analytics application</article-title>. <source>PLoS One</source> <volume>15</volume>:<fpage>e0233977</fpage>. doi: <pub-id pub-id-type="doi">10.1371/journal.pone.0233977</pub-id>, PMID: <pub-id pub-id-type="pmid">32530954</pub-id></citation></ref>
<ref id="ref57"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ullmann</surname> <given-names>T. D.</given-names></name> <name><surname>De Liddo</surname> <given-names>A.</given-names></name> <name><surname>Bachler</surname> <given-names>M.</given-names></name></person-group> (<year>2019</year>). <article-title>A visualisation dashboard for contested collective intelligence. Learning analytics to improve Sensemaking of group discussion</article-title>. <source>Ibero Am. J. Digital Educ.</source> <volume>22</volume>, <fpage>41</fpage>&#x2013;<lpage>80</lpage>. doi: <pub-id pub-id-type="doi">10.5944/ried.22.1.22294</pub-id></citation></ref>
<ref id="ref58"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Vos</surname> <given-names>G.</given-names></name> <name><surname>Trinh</surname> <given-names>K.</given-names></name> <name><surname>Sarnyai</surname> <given-names>Z.</given-names></name> <name><surname>Azghadi</surname> <given-names>M. R.</given-names></name></person-group> (<year>2023</year>). <article-title>Generalizable machine learning for stress monitoring from wearable devices: a systematic literature review</article-title>. <source>Int. J. Med. Inform.</source> <volume>173</volume>:<fpage>105026</fpage>. doi: <pub-id pub-id-type="doi">10.1016/j.ijmedinf.2023.105026</pub-id></citation></ref>
<ref id="ref59"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Wampfler</surname> <given-names>R.</given-names></name> <name><surname>Klingler</surname> <given-names>S.</given-names></name> <name><surname>Solenthaler</surname> <given-names>B.</given-names></name> <name><surname>Schinazi</surname> <given-names>V.</given-names></name> <name><surname>Gross</surname> <given-names>M.</given-names></name></person-group> (<year>2019</year>). Affective State Prediction in a Mobile Setting Using Wearable Biometric Sensors and Stylus. Proceedings of the 12th International Conference on Educational Data Mining, EDM 2019, Montr&#x00E9;al, Canada, July 2&#x2013;5, 2019. International Educational Data Mining Society (IEDMS) 2019, 198&#x2013;207.</citation></ref>
<ref id="ref60"><citation citation-type="other"><person-group person-group-type="author"><name><surname>Wang</surname> <given-names>Q.</given-names></name> <name><surname>Jing</surname> <given-names>S.</given-names></name> <name><surname>Joyner</surname> <given-names>D.</given-names></name> <name><surname>Wilcox</surname> <given-names>L.</given-names></name> <name><surname>Li</surname> <given-names>H.</given-names></name> <name><surname>Pl&#x00F6;tz</surname> <given-names>T.</given-names></name> <etal/></person-group>. (<year>2020</year>). Sensing Affect to Empower Students: Learner Perspectives on Affect-Sensitive Technology in Large Educational Contexts. Proceedings of the Seventh ACM Conference on Learning@ Scale, 63&#x2013;76.</citation></ref>
<ref id="ref61"><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Worsley</surname> <given-names>M.</given-names></name> <name><surname>Abrahamson</surname> <given-names>D.</given-names></name> <name><surname>Blikstein</surname> <given-names>P.</given-names></name> <name><surname>Grover</surname> <given-names>S.</given-names></name> <name><surname>Schneider</surname> <given-names>B.</given-names></name> <name><surname>Tissenbaum</surname> <given-names>M.</given-names></name></person-group> (<year>2016</year>). <article-title>Situating multimodal learning analytics</article-title>. <source>Int. Soc. Learn. Sci.</source> <volume>8</volume>, <fpage>10</fpage>&#x2013;<lpage>27</lpage>. doi: <pub-id pub-id-type="doi">10.18608/jla.2021.7361</pub-id></citation></ref>
</ref-list>
</back>
</article>