<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Neuroergon.</journal-id>
<journal-title>Frontiers in Neuroergonomics</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Neuroergon.</abbrev-journal-title>
<issn pub-type="epub">2673-6195</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fnrgo.2024.1292627</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Neuroergonomics</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Granular estimation of user cognitive workload using multi-modal physiological sensors</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name><surname>Wang</surname> <given-names>Jingkun</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/2439150/overview"/>
<role content-type="https://credit.niso.org/contributor-roles/conceptualization/"/>
<role content-type="https://credit.niso.org/contributor-roles/data-curation/"/>
<role content-type="https://credit.niso.org/contributor-roles/formal-analysis/"/>
<role content-type="https://credit.niso.org/contributor-roles/investigation/"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-original-draft/"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Stevens</surname> <given-names>Christopher</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<role content-type="https://credit.niso.org/contributor-roles/conceptualization/"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-review-editing/"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Bennett</surname> <given-names>Winston</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<role content-type="https://credit.niso.org/contributor-roles/writing-review-editing/"/>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>Yu</surname> <given-names>Denny</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/1153459/overview"/>
<role content-type="https://credit.niso.org/contributor-roles/conceptualization/"/>
<role content-type="https://credit.niso.org/contributor-roles/supervision/"/>
<role content-type="https://credit.niso.org/contributor-roles/writing-review-editing/"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>School of Industrial Engineering, Purdue University</institution>, <addr-line>West Lafayette, IN</addr-line>, <country>United States</country></aff>
<aff id="aff2"><sup>2</sup><institution>Air Force Research Laboratory, Wright-Patterson AFB</institution>, <addr-line>Dayton, OH</addr-line>, <country>United States</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Luca Longo, Technological University Dublin, Ireland</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Jos&#x000E9; Juan Ca&#x000F1;as, University of Granada, Spain</p>
<p>Sophie Lemonnier, EA7312 Laboratoire de Psychologie Ergonomique et Sociale pour l&#x00027;Exp&#x000E9;rience Utilisateurs (PERSEUS), France</p></fn>
<corresp id="c001">&#x0002A;Correspondence: Denny Yu <email>dennyyu&#x00040;purdue.edu</email></corresp>
</author-notes>
<pub-date pub-type="epub">
<day>27</day>
<month>02</month>
<year>2024</year>
</pub-date>
<pub-date pub-type="collection">
<year>2024</year>
</pub-date>
<volume>5</volume>
<elocation-id>1292627</elocation-id>
<history>
<date date-type="received">
<day>11</day>
<month>09</month>
<year>2023</year>
</date>
<date date-type="accepted">
<day>02</day>
<month>02</month>
<year>2024</year>
</date>
</history>
<permissions>
<copyright-statement>At least a portion of this work is authored by Christopher Stevens and Winston Bennett on behalf of the U.S. Government and as regards Dr. Stevens, Dr. Bennett, and the U.S. Government, is not subject to copyright protection in the United States. Foreign and other copyrights may apply.</copyright-statement>
<copyright-year>2024</copyright-year>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the <ext-link ext-link-type="uri" xlink:href="https://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution License (CC BY)</ext-link>. The use, distribution or reproduction in other forums is permitted, provided the original author(s) or copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract>
<p>Mental workload (MWL) is a crucial area of study due to its significant influence on task performance and potential for significant operator error. However, measuring MWL presents challenges, as it is a multi-dimensional construct. Previous research on MWL models has focused on differentiating between two to three levels. Nonetheless, tasks can vary widely in their complexity, and little is known about how subtle variations in task difficulty influence workload indicators. To address this, we conducted an experiment inducing MWL in up to 5 levels, hypothesizing that our multi-modal metrics would be able to distinguish between each MWL stage. We measured the induced workload using task performance, subjective assessment, and physiological metrics. Our simulated task was designed to induce diverse MWL degrees, including five different math and three different verbal tiers. Our findings indicate that all investigated metrics successfully differentiated between various MWL levels induced by different tiers of math problems. Notably, performance metrics emerged as the most effective assessment, being the only metric capable of distinguishing all the levels. Some limitations were observed in the granularity of subjective and physiological metrics. Specifically, the subjective overall mental workload couldn&#x00027;t distinguish lower levels of workload, while all physiological metrics could detect a shift from lower to higher levels, but did not distinguish between workload tiers at the higher or lower ends of the scale (e.g., between the easy and the easy-medium tiers). Despite these limitations, each pair of levels was effectively differentiated by one or more metrics. This suggests a promising avenue for future research, exploring the integration or combination of multiple metrics. The findings suggest that subtle differences in workload levels may be distinguishable using combinations of subjective and physiological metrics.</p></abstract>
<kwd-group>
<kwd>mental workload</kwd>
<kwd>mental workload modeling</kwd>
<kwd>physiological sensors</kwd>
<kwd>teleoperation task</kwd>
<kwd>multiple mental workload level</kwd>
</kwd-group>
<counts>
<fig-count count="7"/>
<table-count count="2"/>
<equation-count count="0"/>
<ref-count count="67"/>
<page-count count="13"/>
<word-count count="7966"/>
</counts>
<custom-meta-wrap>
<custom-meta>
<meta-name>section-at-acceptance</meta-name>
<meta-value>Cognitive Neuroergonomics</meta-value>
</custom-meta>
</custom-meta-wrap>
</article-meta>
</front>
<body>
<sec id="s1">
<title>1 Introduction</title>
<p>Teleoperation tasks are often high-stakes, requiring operators to process multi-dimensional, and multi-channel information (Wickens, <xref ref-type="bibr" rid="B58">2008</xref>; Hockey et al., <xref ref-type="bibr" rid="B33">2009</xref>). Studies have shown that teleoperation interfaces and technology may increase complexity and workload for operators compared to non-teleoperated tasks (Dadashi et al., <xref ref-type="bibr" rid="B14">2013</xref>; Yu et al., <xref ref-type="bibr" rid="B62">2021</xref>; Monfared et al., <xref ref-type="bibr" rid="B44">2022</xref>), such as robotic surgery vs. traditional open surgery. When these job demands exceed human mental capabilities, it can degrade the capabilities of teleoperation personnel and the success of the operation. Thus, continuous and reliable assessment of operators&#x00027; MWL across high and low ranges is essential, not only to protect operators but also to maximize teleoperation task performance.</p>
<p>While there is no universally accepted definition for MWL (Schlegel, <xref ref-type="bibr" rid="B56">1993</xref>; Cain, <xref ref-type="bibr" rid="B8">2007</xref>; Young et al., <xref ref-type="bibr" rid="B59">2015</xref>), Longo et al. (<xref ref-type="bibr" rid="B37">2022</xref>) identified that main concepts (such as operator, primary task, secondary task, environment, situation, time, performance, system, and decision-making), along with sub-concepts (including attributes, demands, resources, effort, attention, working memory, and characteristics), and their interactions, all contribute to the definitions of Mental Workload (MWL). Furthermore, multiple theories propose a resource framework to describe MWL, which characterizes MWL as the extent to which a finite set of cognitive resources is taxed by a given set of task demands (Young and Stanton, <xref ref-type="bibr" rid="B60">2004</xref>; Wickens, <xref ref-type="bibr" rid="B58">2008</xref>; Salvucci and Taatgen, <xref ref-type="bibr" rid="B54">2010</xref>). If task demands are too high with respect to an operator&#x00027;s available capacity, the operator&#x00027;s performance may decline or the operator could become easily distracted, tense, and frustrated (Norman and Draper, <xref ref-type="bibr" rid="B49">1986</xref>; Monk et al., <xref ref-type="bibr" rid="B45">2002</xref>; Galy et al., <xref ref-type="bibr" rid="B24">2012</xref>; Pourteimour et al., <xref ref-type="bibr" rid="B51">2021</xref>). Conversely, excessively low MWL may lead to operator inattentiveness and decreased performance because of the effort associated with sustained attention (Kantowitz and Casper, <xref ref-type="bibr" rid="B35">1988</xref>; Hart and Wickens, <xref ref-type="bibr" rid="B29">1990</xref>). Therefore, whether high or low, MWL can impact task success and the operator&#x00027;s state. For this reason, rapid detection of variations in workload state can be important for preventing errors.</p>
<p>As MWL is a high-level cognitive function that changes dynamically, reliable measurement of MWL is challenging. Three categories of techniques have been widely accepted to assess MWL: subjective measurement, physiological measurement, and performance (Meshkati et al., <xref ref-type="bibr" rid="B41">1995</xref>). Rubio et al. (<xref ref-type="bibr" rid="B52">2004</xref>) detailed a list of common subjective questionnaires that assesses MWL, and Hicks and Wierwille (<xref ref-type="bibr" rid="B30">1979</xref>) found there were significant differences between workload conditions on subjective and performance measures. A systematic review conducted by Charles and Nixon (<xref ref-type="bibr" rid="B10">2019</xref>) detailed 58 journal articles and demonstrated the empirical basis for using physiological sensors in quantifying MWL across a variety of domains. Studies in teleoperation tasks, such as robotics and drone operations, have also shown that physiological sensors can assess workload in those domains (Dias et al., <xref ref-type="bibr" rid="B18">2018</xref>; Yu et al., <xref ref-type="bibr" rid="B61">2019</xref>; Zhou et al., <xref ref-type="bibr" rid="B66">2020</xref>). However, previous studies have primarily focused on the sensors&#x00027; effectiveness in detecting large changes or classifying high vs. low MWL, limiting the granularity of existing models (their ability to detect fine, multi-level changes in workload).</p>
<p>Each measurement method has its advantages and drawbacks. While subjective measurements can be easier and inexpensive, the result of subjective ratings can be impacted by respondent characteristics like bias, response sets, mistakes, and attitudes (Dyer et al., <xref ref-type="bibr" rid="B21">1976</xref>). Primary task performance-based information has the ability to distinguish between individual differences when competing for resources (Longo, <xref ref-type="bibr" rid="B38">2015</xref>), but different demand levels may be associated with the same level of performance. Online performance metrics may also not be available. Physiological measures provide relatively unobtrusive measurement and lack of subjectivity. However, it requires specific measurement equipment, and data quality can be compromised by motion and other artifacts (Dirican and G&#x000F6;kt&#x000FC;rk, <xref ref-type="bibr" rid="B20">2011</xref>). Integrating all three methods is crucial for a comprehensive understanding of MWL.</p>
<p>In past studies, researchers investigated whether MWL measurement(s) can differentiate between low, medium, and high MWL levels (May et al., <xref ref-type="bibr" rid="B40">1990</xref>; Miller et al., <xref ref-type="bibr" rid="B42">2011</xref>) and developed models to distinguish between two or three levels (Ding et al., <xref ref-type="bibr" rid="B19">2020</xref>; Zhou et al., <xref ref-type="bibr" rid="B67">2022</xref>). For jobs that are susceptible to a wide range of more granular changes, such as high-stakes tasks and the environments in search and rescue (SAR), these 2-levels (low vs. high) or 3-levels models may be insufficient for personalized and more targeted design of mechanisms for enhancing operator performance across a range of workloads. More granular models can potentially track gradual changes in operator MWL before they reach excessively high or low levels. These sensitive models can also provide more targeted interventions and potentially improve the usability of operators&#x00027; collaboration with SAR robotic systems.</p>
<p>The objective of the proposed study is to determine the effectiveness of subjective questionnaire, task performance, and physiological sensors in modeling gradual changes in MWL. To achieve our goal, a teleoperated snow arctic SAR gaming simulation was adapted to systematically modulate user workloads at multiple levels. SAR tasks were selected for our testbed as human operators often experience stress, cognitive and physical fatigue, and disorientation during critical SAR operations. These factors can lower alertness, impair memory and focus, and result in a loss of situation awareness (Casper et al., <xref ref-type="bibr" rid="B9">2000</xref>; Murphy, <xref ref-type="bibr" rid="B47">2001</xref>, <xref ref-type="bibr" rid="B48">2007</xref>; DeJong et al., <xref ref-type="bibr" rid="B16">2004</xref>; Zhao et al., <xref ref-type="bibr" rid="B65">2017</xref>).</p>
</sec>
<sec id="s2">
<title>2 Material and methods</title>
<p>This research adhered to the American Psychological Association Code of Ethics and received approval from the Institutional Review Board at Purdue University (IRB No.: IRB-2021-1152). Informed consent was obtained from all participants.</p>
<sec>
<title>2.1 Participants</title>
<p>Twenty-three participants (12 males and 11 females) were recruited from the university population. The exclusion criteria for this study were as follows: (1) age younger than 18 years old and (2) an inability to play video games without discomfort. Before conducting the experiment, all participants provided informed consent.</p>
</sec>
<sec>
<title>2.2 Experimental design</title>
<p>In this study, workload is induced experimentally by varying task demands. In addressing operator capacity, attempts were undertaken to minimize individual differences by (1) considering the participant as a random factor in our model and (2) augmenting the sample size within our capacity. Participant backgrounds, skills, and learning experiences were surveyed prior to the study.</p>
<p>To distinguish different MWL levels in arithmetic problems, mathematical operations were decomposed into steps. Steps were defined as basic (single-digit) arithmetic calculations. Each step involved retrieving the solution from long-term memory (Ashcraft, <xref ref-type="bibr" rid="B2">1992</xref>). However, multi-digits operations and multi-step problems are more complex as they require working memory (WM) to store addends and interim results (Hitch, <xref ref-type="bibr" rid="B32">1978</xref>). Increasing the number of addends and interim values that need to be stored demands more WM resources, leading to a higher MWL. Additionally, larger numbers with more digits tend to require more retrievals of number facts from memory to compute intermediate sums, resulting in increased MWL (Ryu and Myung, <xref ref-type="bibr" rid="B53">2005</xref>). Following this rule, we defined five different math demand levels, referred to as &#x0201C;question demand levels&#x0201D; throughout this manuscript. These levels include easy (e.g., 8<sup>&#x0002A;</sup>2 &#x0002B; 5 or 4<sup>&#x0002A;</sup>6 &#x02013; 7); easy-medium (e.g., 75 &#x0002B; 48); medium (e.g., 5<sup>&#x0002A;</sup>5 &#x0002B; 3<sup>&#x0002A;</sup>6 or 8<sup>&#x0002A;</sup>8 &#x0002B; 9<sup>&#x0002A;</sup>2); medium-hard (e.g., 14<sup>&#x0002A;</sup>3 &#x02013; 16); and hard [e.g., 2<sup>&#x0002A;</sup>(26 &#x0002B; 48 &#x02013; 14 &#x02013; 32)].</p>
<p>The cognitive basis for varying MWL levels with analogy questions differed from the working memory demand of arithmetic problems. In this case, the difficulty comes from the complexity of inference rules associated with the question and the availability of verbal knowledge associated with the terms (Bejar et al., <xref ref-type="bibr" rid="B5">1987</xref>). Problem difficulty was defined normatively, drawing from data obtained from a sample of SAT I practice tests. Analogy questions were selected from a chart of example SAT questions with corresponding categories based on a reference group of high school seniors planning to attend college.<xref ref-type="fn" rid="fn0001"><sup>1</sup></xref> The verbal questions in these practice tests were categorized into 5 demand levels. However, we retained only 3 levels of demand (MWL levels) in the study, as our pilot testing revealed that the demands of analogy tasks were challenging and not consistently clear among individuals. All verbal analogy questions were presented in a multiple-choice format.</p>
<p>This study employed an incomplete block design. Initially, a complete block design was planned, with each participant expected to answer 8 (5 math and 3 verbal) different levels of the questions for each round, two rounds in total. However, due to a game programming error, each participant only answered 7 questions per round, resulting in an incomplete block design. Nevertheless, since our study was comprised of two rounds per subject, all but one subject experienced all 8 treatment levels at least once. Additionally, we conducted separate analyses for math and verbal questions. Specifically, 5 different math demand levels (3 different analogy demand levels) were employed as the treatment factors in math (verbal) models.</p>
</sec>
<sec>
<title>2.3 Simulation description</title>
<p>A series of gaming simulations developed by Air Force Research Laboratory (AFRL) Gaming Research Integration for Learning Laboratory (GRILL) was employed in this study. The game simulated Antarctic Search and Rescue operations with a teleoperated snowcat (Coovert et al., <xref ref-type="bibr" rid="B13">2017a</xref>,<xref ref-type="bibr" rid="B12">b</xref>). In this simulation scenario, two scientists embarked on a helicopter mission to gather research data. However, the helicopter suddenly malfunctioned and crashed during an emergency landing on snowy terrain.</p>
<p>Participants were tasked with operating a snowcat to perform a search and rescue operation, aiming to locate parts at various milestones to repair the helicopter. As participants advanced in the simulation and answered questions correctly, they could obtain these parts at each milestone. To achieve this, participants teleoperated a snowcat across a vast arctic terrain, with a total of 16 milestones to be reached within a 15-min timeframe.</p>
<p>At each milestone, participants encountered an arithmetic or analogy question with a randomized MWL demand, as depicted in <xref ref-type="fig" rid="F1">Figure 1</xref>. Correct answers caused the total score to go up, while the wrong answer caused the total score to go down. Only when a correct answer was provided did a new question appear, maintaining the same demand level and question type at that milestone. A wrong answer required participants to answer the question again until they answered it correctly. Participants were given 30 seconds to answer as many questions as possible at each milestone, with Countdown Timer 2 (<xref ref-type="fig" rid="F1">Figure 1</xref>) displaying the time remaining.</p>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p>Interface of the snowcat simulation. The area map in the upper-left corner indicated the milestone locations and the current snowcat vehicle location. The countdown timer 1 indicated how much time is left out of 15 min. Milestone status in the lower-left corner indicated how many milestones were found.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fnrgo-05-1292627-g0001.tif"/>
</fig>
<p>To ensure that participants engaged with at least one set of seven demand levels of problems (randomly selected from five levels of arithmetic and three levels of analogy), the demand levels and/or problem types for the first seven milestones differed. Subsequently, problems were fully randomized and excluded from further analysis.</p>
</sec>
<sec>
<title>2.4 Experimental procedure</title>
<p>The experimental procedure is shown in <xref ref-type="fig" rid="F2">Figure 2</xref>. Prior to commencing the experiment, participants were required to complete a background questionnaire, which collected general information, including sex, age, and whether they were native English speakers (see <xref ref-type="supplementary-material" rid="SM1">Appendix A</xref>). We included the native English speaker question based on insights from pilot studies, as performance on analogy problems might differ between native and non-native English speakers.</p>
<fig id="F2" position="float">
<label>Figure 2</label>
<caption><p>Sensors (EEG and Eye Tracker) and experimental procedure.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fnrgo-05-1292627-g0002.tif"/>
</fig>
<p>Following the background questionnaire, participants were introduced to a single 20-step bipolar scaled Overall Workload (OW) questionnaire (Hill et al., <xref ref-type="bibr" rid="B31">1992</xref>; Miller, <xref ref-type="bibr" rid="B43">2001</xref>). Then, we asked participants to self-report their MWL levels on a scale ranging from 1 to 21. The OW score was then calculated as <italic>OW</italic> &#x0003D; (<italic>reported scale</italic> &#x02212; 1)<sup>&#x0002A;</sup>5, resulting in a score between 0 and 100 (Hill et al., <xref ref-type="bibr" rid="B31">1992</xref>).</p>
<p>A training session was conducted for all participants. During this session, research personnel explained the objectives and interfaces of the simulation and allowed participants to practice the snowcat simulation. Following the training session, participants were equipped with the Emotiv EPOC X and Tobii Pro Glasses 2. Eye tracker calibration was performed to optimize the eye tracking algorithm.<xref ref-type="fn" rid="fn0002"><sup>2</sup></xref> Each participant engaged in two rounds of the snowcat simulation, each round lasted 15 min. While the snowcat simulation itself remained consistent across both rounds, the milestone questions differed due to randomization. After completing questions at each milestone within the snowcat simulation, participants reported their OW for that specific milestone.</p>
</sec>
<sec>
<title>2.5 Subjective data and performance metrics</title>
<p>Participants self-reported OW questionnaire was recorded after they completed questions at a milestone. The OW score ranged from 0 (indicating a very light workload) to 100 (representing a very high workload) (Hill et al., <xref ref-type="bibr" rid="B31">1992</xref>).</p>
<p>Task performance metrics for the snowcat simulation were defined as the total number of questions answered and the percentage of correct questions answered.</p>
</sec>
<sec>
<title>2.6 Physiological data analysis</title>
<sec>
<title>2.6.1 Eye tracking data analysis</title>
<p>Tobii Pro Glasses 2 served as the eye-tracking device in this study. Eye-tracking data was recorded using the Tobii Pro Controller, and ocular measurements were extracted using the Tobii Pro Lab. The I-VT attention filter was set as the default value of 100,<xref ref-type="fn" rid="fn0003"><sup>3</sup></xref> following the manufacturer&#x00027;s recommendations (Bahill, <xref ref-type="bibr" rid="B3">1975</xref>; Bahill et al., <xref ref-type="bibr" rid="B4">1975</xref>; Collewijn et al., <xref ref-type="bibr" rid="B11">1988</xref>).</p>
<p>Previous research has demonstrated correlations between multiple metrics and MWL, including fixation duration, the number of fixations, saccadic velocity, saccade amplitude, maximum saccade duration, number of saccades, and pupil size (Ahmadi et al., <xref ref-type="bibr" rid="B1">2022</xref>). Consequently, metrics associated with these parameters were extracted for each 30-s milestone.</p>
</sec>
<sec>
<title>2.6.2 Electroencephalography data analysis</title>
<p>We used Emotiv EPOC X as our EEG device. We determined the EEG metrics to be the extracted alpha, beta, and theta bandpowers from the 14 EEG channels (AF3, F7, F3, FC5, T7, P7, O1, O2, P8, T8, FC6, F4, F8, and AF4). Following the export of raw data from Emotiv Pro, we pre-processed the EEG data using EEGLab. Event markers were imported to identify the time periods corresponding to each demand level. For each time period, the following steps were completed. (1) a high pass filter at 0.5 Hz was applied; (2) the clean_rawdata algorithm was applied to automatically reject bad segments and channels (Delorme and Makeig, <xref ref-type="bibr" rid="B17">2004</xref>); (3) researchers manually reviewed the data to identify and reject any remaining bad segments and channels; (4) the runica algorithm was utilized to decompose data using independent components analysis (ICA) (Brunner et al., <xref ref-type="bibr" rid="B7">2013</xref>); (5) the ICLabel algorithm was employed to classify each ICA component into categories such as brain, eye, muscle, heart rate, line noise, or others, quantifying their probability on a percentage scale (Pion-Tonachini et al., <xref ref-type="bibr" rid="B50">2019</xref>); (6) ICA components with a probability of belonging to the brain of &#x0003C;0.4 were rejected; and (7) MATLAB scripts were used to calculate alpha, beta, and theta value for each channel based on the method provided by previous study (Wang et al., <xref ref-type="bibr" rid="B57">2015</xref>).</p>
</sec>
</sec>
<sec>
<title>2.7 Statistical analysis</title>
<p>Nested models were used as round was nested within participant. Specifically, the fixed effect consisted of 5 different demand levels for math and 3 different demand levels for verbal models. The random effects include the participant and the round completed by each participant, with MWL measurement metrics serving as the responses. Separate models were built for each subjective, task performance, eye tracking, and EEG metrics. Each model expression was: <italic>Y</italic><sub><italic>ijkt</italic></sub> &#x0003D; &#x003BC; &#x0002B; &#x003B1;<sub><italic>i</italic></sub> &#x0002B; &#x003B2;<sub><italic>j</italic>(<italic>k</italic>)</sub> &#x0002B; &#x003F5;<sub><italic>ijkt</italic></sub>, where <italic>Y</italic><sub><italic>ijkt</italic></sub> represents the metric measurement on the t<sup>th</sup> observation on demand Level i, observed in participant k and round j; &#x003BC; denotes the constant (or the intercept of the model); &#x003B1;<sub><italic>i</italic></sub> signifies the effect of the demand Level i; &#x003B2;<sub><italic>j</italic>(<italic>k</italic>)</sub> represents the nested effect of the j<sup>th</sup> round of the k<sup>th</sup> participant; and &#x003F5;<sub><italic>ijkt</italic></sub> represents the associated random error.</p>
<p>We initiated the analysis by checking statistical model assumptions, including the examination of outliers, independence, constant variance, and normality. Outliers were identified as values exceeding <inline-formula><mml:math id="M1"><mml:msub><mml:mrow><mml:mi>Q</mml:mi></mml:mrow><mml:mrow><mml:mn>3</mml:mn></mml:mrow></mml:msub><mml:mo>&#x0002B;</mml:mo><mml:mn>1</mml:mn><mml:mo>.</mml:mo><mml:msup><mml:mrow><mml:mn>5</mml:mn></mml:mrow><mml:mrow><mml:mo>*</mml:mo></mml:mrow></mml:msup></mml:math></inline-formula>IQR or falling below <inline-formula><mml:math id="M2"><mml:msub><mml:mrow><mml:mi>Q</mml:mi></mml:mrow><mml:mrow><mml:mn>1</mml:mn></mml:mrow></mml:msub><mml:mo>-</mml:mo><mml:mn>1</mml:mn><mml:mo>.</mml:mo><mml:msup><mml:mrow><mml:mn>5</mml:mn></mml:mrow><mml:mrow><mml:mo>*</mml:mo></mml:mrow></mml:msup></mml:math></inline-formula>IQR, where <italic>Q</italic><sub>3</sub> and <italic>Q</italic><sub>1</sub> represent the third and first quartiles; and the interquartile range (IQR) is defined as <italic>Q</italic><sub>3</sub> &#x02212; <italic>Q</italic><sub>1</sub>. After quantitatively identifying outliers, each data point was visually inspected. It was determined that outliers occurred due to some participants employing different strategies when solving math problems. For example, one participant typed partial sums as typed answers in the answer option box when responding to math questions (if the question is 8<sup>&#x0002A;</sup>8&#x0002B;9<sup>&#x0002A;</sup>2, he would type 64 and 18). We opted to remove the milestone data points when they were identified as outliers, typically totaling 2 to 3 data points for each metric across the entire dataset. Next, studentized residual plots were generated to assess the independence and constant variance. Lastly, we produced normal residual plots (standardized residuals plotted against their normal scores). If non-normality or non-constant variables were detected, we applied Box-Cox transformations. As the relationship between performance metrics and the demand levels is unknown, we also attempted to apply square root, exponential, and logarithmic transformations.</p>
<p>After confirming the model assumptions were met, we utilized PROC MIXED<xref ref-type="fn" rid="fn0004"><sup>4</sup></xref> to conduct nested model analysis, considering both random and fixed factors. For variables with significant fixed effects, pairwise comparisons were conducted with the Tukey correction using the LSMEANS command under PROC MIXED. <italic>P</italic>-values of the differences of the least squares indicated the various levels of significance for each metric.</p>
</sec>
</sec>
<sec id="s3">
<title>3 Results</title>
<sec>
<title>3.1 Background questionnaire result</title>
<p>Twenty-three participants were recruited. Only twenty participants (11 males and 9 females) data were collected and analyzed in this study. EEG failed to work for three of the participants. The means (standard deviations) of the age of male and female participants were 28.18 (12.42) and 24.89 (5.98), respectively. The means (standard deviations) for familiarity with, frequency of, and confidence in playing video games were 3.00 (1.45), 2.32 (1.36), and 3.09 (1.23), respectively.</p>
</sec>
<sec>
<title>3.2 Task performance result</title>
<p>Both the number of questions answered (<italic>p</italic> &#x0003C; 0.0001) and the percentage of correct answers (<italic>p</italic> &#x0003C; 0.0001) decreased when math demands increased (<xref ref-type="table" rid="T1">Table 1</xref>). For the verbal problems, the number of questions answered was similar between demand levels, but the percentage of correct answers decreased (<italic>p</italic> = 0.0010) when verbal question demands increased.</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p>Average and standard deviation values of two performance metrics for each demand level.</p></caption>
<table frame="box" rules="all">
<thead>
<tr style="background-color:#919498;color:#ffffff">
<th valign="top" align="left"><bold>Demand level</bold></th>
<th valign="top" align="center"><bold>&#x00023; of questions answered (average)</bold></th>
<th valign="top" align="center"><bold>&#x00023; of questions answered (Std.)</bold></th>
<th valign="top" align="center"><bold>Average % of correct answer (average)</bold></th>
<th valign="top" align="center"><bold>Average % of correct answer (Std.)</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Math 1</td>
<td valign="top" align="center">7.56</td>
<td valign="top" align="center">3.65</td>
<td valign="top" align="center">88.86</td>
<td valign="top" align="center">19.51</td>
</tr> <tr>
<td valign="top" align="left">Math 2</td>
<td valign="top" align="center">5.88</td>
<td valign="top" align="center">2.34</td>
<td valign="top" align="center">89.31</td>
<td valign="top" align="center">12.84</td>
</tr> <tr>
<td valign="top" align="left">Math 3</td>
<td valign="top" align="center">3.40</td>
<td valign="top" align="center">2.14</td>
<td valign="top" align="center">74.65</td>
<td valign="top" align="center">36.65</td>
</tr> <tr>
<td valign="top" align="left">Math 4</td>
<td valign="top" align="center">2.42</td>
<td valign="top" align="center">1.30</td>
<td valign="top" align="center">63.89</td>
<td valign="top" align="center">41.13</td>
</tr> <tr>
<td valign="top" align="left">Math 5</td>
<td valign="top" align="center">1.15</td>
<td valign="top" align="center">1.21</td>
<td valign="top" align="center">37.84</td>
<td valign="top" align="center">46.43</td>
</tr> <tr>
<td valign="top" align="left">Verbal 1</td>
<td valign="top" align="center">2.85</td>
<td valign="top" align="center">1.37</td>
<td valign="top" align="center">54.35</td>
<td valign="top" align="center">33.48</td>
</tr> <tr>
<td valign="top" align="left">Verbal 2</td>
<td valign="top" align="center">2.91</td>
<td valign="top" align="center">1.20</td>
<td valign="top" align="center">46.77</td>
<td valign="top" align="center">33.79</td>
</tr> <tr>
<td valign="top" align="left">Verbal 3</td>
<td valign="top" align="center">2.63</td>
<td valign="top" align="center">1.50</td>
<td valign="top" align="center">24.12</td>
<td valign="top" align="center">34.72</td>
</tr></tbody>
</table>
</table-wrap>
<p><xref ref-type="fig" rid="F3">Figures 3A</xref>&#x02013;<xref ref-type="fig" rid="F3">D</xref> shows the box plots and pairwise comparisons between demand levels and task performance. The number of math questions answered differed between all pairs of math demand levels (<xref ref-type="fig" rid="F3">Figure 3A</xref>). The percentage of correct answers was less sensitive to math demand levels, with only select pairs significantly different (1&#x00026;4, 1&#x00026;5, 2&#x00026;4, 2&#x00026;5, 3&#x00026;5, and 4&#x00026;5). The percentage of correct answers for verbal problems distinguished verbal Levels 1&#x00026;3 and 2&#x00026;3, but not 1&#x00026;2 (<xref ref-type="fig" rid="F3">Figure 3D</xref>). <xref ref-type="supplementary-material" rid="SM1">Appendixes B.I</xref>, <xref ref-type="supplementary-material" rid="SM1">B.II</xref> show more details of the significant task performance pairwise comparison results of math-based and verbal-based models.</p>
<fig id="F3" position="float">
<label>Figure 3</label>
<caption><p>Box plots of task performance <bold>(A&#x02013;D)</bold> and subjective questionnaire <bold>(E, F)</bold> by demand levels where significant differences between pairs indicated by &#x0002A; when <italic>p</italic> &#x0003C; 0.05.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fnrgo-05-1292627-g0003.tif"/>
</fig>
<p>The transformed performance metrics did not contribute significantly to improving the model fit, except for the square root transformation of the percentage of correct answers for the math levels. This transformation indeed facilitated the significance of one additional pair (2&#x00026;3). <xref ref-type="supplementary-material" rid="SM1">Appendixes B.I.2-4</xref>, <xref ref-type="supplementary-material" rid="SM1">B.II.2-3</xref> provide more details of the significant pairwise comparisons of task performance for math-based and verbal-based models after transformations.</p>
</sec>
<sec>
<title>3.3 Subjective questionnaire result</title>
<p>Self-reported OW score (<xref ref-type="fig" rid="F3">Figure 3E</xref>, <xref ref-type="fig" rid="F3">F</xref>) increased when the demand levels increased for math problems (<italic>p</italic> &#x0003C; 0.0001) but not verbal problems (<italic>p</italic> = 0.2752). From pairwise comparisons (<xref ref-type="fig" rid="F3">Figure 3E</xref>), all pairs of math demands were significantly different except for 1&#x00026;2. <xref ref-type="supplementary-material" rid="SM1">Appendix B.III</xref> shows additional details of the pairwise comparison results.</p>
</sec>
<sec>
<title>3.4 Eye tracking</title>
<p>The results of the eye-tracking models are shown in <xref ref-type="table" rid="T2">Table 2</xref>. If Box-Cox transformation was applied due to non-normality and/or a non-constant variable, the corresponding type of the transformation is also shown in <xref ref-type="table" rid="T2">Table 2</xref>. For math-based models, no metric needed to be transformed. For verbal-based models, all metrics except total fixation duration, number of saccades, and total amplitude of saccades were transformed.</p>
<table-wrap position="float" id="T2">
<label>Table 2</label>
<caption><p>Transformation and ANOVA result for each eye tracking metric.</p></caption>
<table frame="box" rules="all">
<thead>
<tr style="background-color:#919498;color:#ffffff">
<th valign="top" align="left"><bold>Extracted eye tracking metrics</bold></th>
<th valign="top" align="center"><bold>Math-based models transformation</bold></th>
<th valign="top" align="center"><bold><italic>P</italic>-value of the math fixed factor</bold></th>
<th valign="top" align="center"><bold>Verbal-based models transformation</bold></th>
<th valign="top" align="center"><bold><italic>P</italic>-value of the verbal fixed factor</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Total fixation duration</td>
<td valign="top" align="center">-</td>
<td valign="top" align="center">0.0029<sup>&#x0002A;</sup></td>
<td valign="top" align="center">-</td>
<td valign="top" align="center">0.6381</td>
</tr> <tr>
<td valign="top" align="left">Average fixation duration</td>
<td valign="top" align="center">-</td>
<td valign="top" align="center">&#x0003C;0.0001<sup>&#x0002A;</sup></td>
<td valign="top" align="center"><inline-formula><mml:math id="M3"><mml:mfrac><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:msqrt><mml:mrow><mml:mi>Y</mml:mi></mml:mrow></mml:msqrt></mml:mrow></mml:mfrac></mml:math></inline-formula></td>
<td valign="top" align="center">0.2381</td>
</tr> <tr>
<td valign="top" align="left">Number of fixations</td>
<td valign="top" align="center">-</td>
<td valign="top" align="center">&#x0003C;0.0001<sup>&#x0002A;</sup></td>
<td valign="top" align="center">log(Y)</td>
<td valign="top" align="center">0.1992</td>
</tr> <tr>
<td valign="top" align="left">Average fixation pupil diameter</td>
<td valign="top" align="center">-</td>
<td valign="top" align="center">0.3315</td>
<td valign="top" align="center"><italic>Y</italic><sup>&#x02212;2</sup></td>
<td valign="top" align="center">0.3579</td>
</tr> <tr>
<td valign="top" align="left">Number of saccades</td>
<td valign="top" align="center">-</td>
<td valign="top" align="center">&#x0003C;0.0001<sup>&#x0002A;</sup></td>
<td valign="top" align="center">-</td>
<td valign="top" align="center">0.1219</td>
</tr> <tr>
<td valign="top" align="left">Average peak velocity of saccade</td>
<td valign="top" align="center">-</td>
<td valign="top" align="center">0.1503</td>
<td valign="top" align="center"><italic>Y</italic><sup>&#x02212;2</sup></td>
<td valign="top" align="center">0.0399</td>
</tr> <tr>
<td valign="top" align="left">Average amplitude of saccades</td>
<td valign="top" align="center">-</td>
<td valign="top" align="center">0.0053<sup>&#x0002A;</sup></td>
<td valign="top" align="center"><inline-formula><mml:math id="M4"><mml:mfrac><mml:mrow><mml:mn>1</mml:mn></mml:mrow><mml:mrow><mml:msqrt><mml:mrow><mml:mi>Y</mml:mi></mml:mrow></mml:msqrt></mml:mrow></mml:mfrac></mml:math></inline-formula></td>
<td valign="top" align="center">0.2271</td>
</tr> <tr>
<td valign="top" align="left">Total amplitude of saccades</td>
<td valign="top" align="center">-</td>
<td valign="top" align="center">&#x0003C;0.0001<sup>&#x0002A;</sup></td>
<td valign="top" align="center">-</td>
<td valign="top" align="center">0.3417</td>
</tr></tbody>
</table>
<table-wrap-foot>
<p>Significance marked as <sup>&#x0002A;</sup> when <italic>p</italic> &#x0003C; 0.05.</p>
</table-wrap-foot>
</table-wrap>
<p>Testing for multiple comparisons among the significant metrics (<xref ref-type="table" rid="T2">Table 2</xref>) showed that some, but not all, demand level pairs differed in math-based models (<xref ref-type="fig" rid="F4">Figure 4</xref>). The metrics, including total fixation duration, number of fixations, number of saccades, average amplitude of saccades, and total amplitude of saccades, generally decreased with increasing demand levels (<xref ref-type="fig" rid="F4">Figure 4</xref>). In contrast, the average fixation duration tended to increase with higher demand levels. Specifically, at Level 1, the duration was 148 ms and 342 ms shorter than at Levels 3 and 5, respectively, while Levels 2&#x02013;4 were 195&#x02013;261 ms shorter than Level 5. For additional details on the pairwise comparison results, see <xref ref-type="supplementary-material" rid="SM1">Appendix B.IV</xref>.</p>
<fig id="F4" position="float">
<label>Figure 4</label>
<caption><p>Box plots and significance among math levels for eye tracking metrics <bold>(A&#x02013;F)</bold> (Significant differences between pairs indicated by * when <italic>p</italic> &#x0003C; 0005).</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fnrgo-05-1292627-g0004.tif"/>
</fig>
<p>For verbal questions, only the average peak velocity of saccades was significant. Specifically, verbal Level 3 was significantly lower than Level 1 (<xref ref-type="fig" rid="F5">Figure 5</xref>). <xref ref-type="supplementary-material" rid="SM1">Appendix B.V</xref> shows additional details on the pairwise comparison results.</p>
<fig id="F5" position="float">
<label>Figure 5</label>
<caption><p>Box plots and significance among verbal levels for eye tracking metrics (Significant differences between pairs indicated by &#x0002A; when <italic>p</italic> &#x0003C; 0.05).</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fnrgo-05-1292627-g0005.tif"/>
</fig>
</sec>
<sec>
<title>3.5 EEG</title>
<p>For math-based models, the following EEG metrics distinguished MWL levels: log(alpha) of channel F8 (<italic>p</italic> = 0.0056); log(beta) of channel T7 (<italic>p</italic> = 0.0496) and channel F8 (<italic>p</italic> = 0.0031); log(theta) of channel T7 (<italic>p</italic> = 0.0483), T8 (<italic>p</italic> = 0.0374), and F8 (<italic>p</italic> = 0.0049).</p>
<p>None of the EEG metrics can distinguish all pairs of math levels (<xref ref-type="fig" rid="F6">Figure 6</xref>). For log(alpha) of F8, log(beta) of T7, log(theta) of T7, and F8, the bandpowers showed inverse relationships with the demand levels. For example, log(alpha) of F8 metric math Level 1 was 0.89, 0.48, and 0.45 higher than Levels 3, 4, and 5; Level 2 was 0.61 higher than Level 3. Note that the log transformations and original metrics have positive relationships, the same tendency could be applied to the original alpha, beta, and theta metrics in the above interpretations.</p>
<fig id="F6" position="float">
<label>Figure 6</label>
<caption><p>The topographical plots of the significant metric (after applying log transformation) among different math levels with channels that differed between pairwise comparisons circled. The topographical plots were made based on the value difference between two levels of log(metric).</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fnrgo-05-1292627-g0006.tif"/>
</fig>
<p>Bandpowers of log(beta) of F8 and log(theta) of T8 metrics tended to decrease and then increase when the demand levels increased. <xref ref-type="supplementary-material" rid="SM1">Appendix B.VI</xref> shows additional details on the math-based significant EEG metrics pairwise comparison results.</p>
<p>For models of the verbal task (<xref ref-type="fig" rid="F7">Figure 7</xref>), only log(theta) of T7 decreased (<italic>p</italic> = 0.0370) when the verbal levels increased in T7 (Level 1 was 1.45 higher than Level 2) (<xref ref-type="fig" rid="F7">Figure 7</xref>). <xref ref-type="supplementary-material" rid="SM1">Appendix B.VII</xref> shows additional details on the verbal-based EEG metrics pairwise comparison results.</p>
<fig id="F7" position="float">
<label>Figure 7</label>
<caption><p>The topographical plots of the significant metric (after applying log transformation) among different verbal levels with channels that differed between pairwise comparisons circled. The topographical plots were made based on the value difference between two levels of log(metric).</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fnrgo-05-1292627-g0007.tif"/>
</fig>
</sec>
</sec>
<sec id="s4">
<title>4 Discussion</title>
<p>For MWL induced by varying math levels, the performance metric number of questions answered emerged as the most effective. It was the only metric capable of distinguishing all MWL levels. However, another performance metric, the percentage of correct answers, was less effective, distinguishing only six out of ten level pairs. Notably, regardless of the models&#x00027; granularity in detection, the levels identified as significantly different by performance metrics consistently showed a trend of decreasing performance as MWL levels increased. This observation aligns with findings reported in previous literature (Young et al., <xref ref-type="bibr" rid="B59">2015</xref>). The self-reported OW scores effectively distinguished all math levels, with the exception of Levels 1&#x00026;2. Similar to performance metrics, our findings corroborate earlier studies indicating that higher self-reported MWL levels are associated with increased MWL (Fallahi et al., <xref ref-type="bibr" rid="B23">2016</xref>; Mu&#x000F1;oz-de-Escalona et al., <xref ref-type="bibr" rid="B46">2020</xref>).</p>
<p>With respect to eye movements, we found a longer average fixation duration, a fewer number of fixations and number of saccades, and a shorter average amplitude of saccades with higher MWL. This finding is reasonable, as high MWL would require more time to process complex information (Mahanama et al., <xref ref-type="bibr" rid="B39">2022</xref>) and elicit greater engagement (Geisen, <xref ref-type="bibr" rid="B25">2017</xref>), leading participants&#x00027; attention to be more focused on task-relevant stimuli. The increased focus during more demanding tasks reduces the need for extensive visual search and exploration, limiting gaze shifts to a relatively small area relevant to the task. This results in fewer but more focused eye movements.</p>
<p>Another physiological sensor used in the study, the EEG, found that alpha bandpower decreased when MWL increased, a trend that aligns with findings from previous studies (Brookings et al., <xref ref-type="bibr" rid="B6">1996</xref>; Fairclough and Venables, <xref ref-type="bibr" rid="B22">2006</xref>; Jaquess et al., <xref ref-type="bibr" rid="B34">2018</xref>). For example, memory retrieval and arithmetic tasks were shown to decrease alpha bandpower (Harmony et al., <xref ref-type="bibr" rid="B28">1999</xref>). In contrast, previous studies observed that theta bandpower had a positive relationship with MWL, where high theta amplitude suggests sustained attention (Sasaki et al., <xref ref-type="bibr" rid="B55">1996</xref>; Gevins et al., <xref ref-type="bibr" rid="B26">1997</xref>). However, our present study indicates that theta bandpower was the highest at both Levels 1&#x00026;2. In contrast, Level 3 had the lowest theta, while Levels 4&#x00026;5 were in the middle. This contrasting finding may be partially explained by our simulation design. Specifically, participants were tasked to answer as many problems as possible continuously for 30 s at each milestone, regardless of the MWL level of the milestone. Therefore, participants&#x00027; attention should have been sustained for the entire 30 s for all the MWL levels. While the overall tendency was for theta to decrease while MWL increased. This, combined with the behavioral results, suggests some disengagement may have occurred at the higher levels of difficulty. Disengagement at lower or higher demand levels is a common finding in previous literature (Dehais et al., <xref ref-type="bibr" rid="B15">2020</xref>).</p>
<p>All of the metrics we investigated were able to discriminate between math demand levels, consistent with past work showing the utility of these metrics for detecting MWL. However, as with previous works, there appear to be some limitations in the granularity of the metrics (Zhou et al., <xref ref-type="bibr" rid="B67">2022</xref>). Specifically, we found only one metric (number of questions answered) can distinguish five math levels completely. Although performance metrics are strongly associated with incremental changes in workload, there are significant limitations to the practical application of performance-based models in safety-critical jobs like SAR, where assistance or support should be provided prior to operators showing impaired performance. In addition, performance metrics in real-world settings may not be as easily measured or defined as the math and verbal tasks in this study. Instead, as the physiologically based models can be collected in real-time and physiological responses to workload are indirect and not task specific (Zhang et al., <xref ref-type="bibr" rid="B64">2023</xref>), they may be more generalizable outside of a lab setting and may provide more opportunities for informing work and machine designs. Thus, relying solely on performance metrics is insufficient to represent MWL. The inclusion of subjective questionnaires and physiological data is also necessary for a more comprehensive understanding.</p>
<p>For all the other subjective and physiological metrics, math Levels 1&#x00026;2 and math Levels 3&#x00026;4 are the two most unlikely distinguishable level sets by all the metrics. This might be because the differences in demand required from math Levels 1&#x00026;2 and 3&#x00026;4 are less than the other level sets (for example, Levels 2&#x00026;3), which makes these two sets harder to distinguish. Despite these challenges, we believe our presented models are a step toward our goal of predicting more granular levels of workload. Specifically, each pair was distinguished by one or more metrics, suggesting future work integrating or combining multiple metrics together can lead to the stated goal of a comprehensive granular workload prediction model.</p>
<p>Contrary to math models, only a limited number of metrics succeeded in differentiating between levels of verbal MWL. Specifically, no metrics distinguished verbal Level 2 from Level 1. A likely explanation for this observation was the required cognitive functions demanded by the verbal questions. Specifically, the verbal questions were hard for most participants regardless of MWL workload as they required deep reasoning on vocabulary pairings that many participants may not be familiar with (these questions were removed in United States SAT standardized testing in 2005). Except for the most challenging level, where participants struggled to answer questions correctly, the other levels may have seemed similar to them. In these levels, participants knew some answers and made educated guesses for the rest. This challenge may also be amplified by familiarity with the English language. However, although our sensing approach was not capable of distinguishing granular (high, medium, and low) levels of verbal MWL, several metrics did distinguish between Levels 1&#x00026;3 and 2&#x00026;3, which likely represent the large differences in MWL from surface to deep reasoning of the verbal questions.</p>
<p>Several opportunities for further research emerge from this study. Firstly, the effects of gender and other demographic variables were not considered, though some studies suggest that different genders may yield varying results in MWL measurement metrics (Hancock, <xref ref-type="bibr" rid="B27">1988</xref>; Zeng et al., <xref ref-type="bibr" rid="B63">2020</xref>). Furthermore, our participant pool was limited to a university population, potentially differing in psychological cognition from other societal groups. Expanding the participant demographic in future studies could provide more generalized insights. Another future work is the scope of the study in modulating MWL. The MWL demands were not tailored to specific scenarios like Search and Rescue (SAR) or human-robotic interaction. While this approach was intentional to understand MWL&#x00027;s fundamental mechanisms, future research should aim to replicate more complex, real-world demands. Moreover, in this study, we employed single-channel EEG analysis to observe bandpower trends in specific brain regions, as measured by 14 channels, despite the small sample size. However, multi-channel EEG analysis, which can provide deeper insights into complex cognitive tasks (like mental math and verbal tasks) that involve multiple brain regions, indicates the need for future studies to explore aggregate effects across channels. Additionally, the study&#x00027;s controlled laboratory setting limits the applicability of findings to real-world scenarios. Future research should investigate factors affecting sensor performance in naturalistic settings, such as motion artifacts impacting EEG readings (Kappel et al., <xref ref-type="bibr" rid="B36">2017</xref>). Moreover, as has been demonstrated in past literature (Brookings et al., <xref ref-type="bibr" rid="B6">1996</xref>; Jaquess et al., <xref ref-type="bibr" rid="B34">2018</xref>), the relationship between MWL and physiological metrics is complex. Some metrics have a linear relationship, while others have a non-linear relationship. Our exploration of both linear and non-linear models indicates a context-dependent preference, highlighting the need for further research to clarify the nature of this relationship and its implications for MWL models in varied applications. Despite these limitations, our work demonstrates the potential of multi-modal sensing to distinguish granular levels of MWL in a simulated gaming environment.</p>
</sec>
<sec sec-type="data-availability" id="s5">
<title>Data availability statement</title>
<p>The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.</p>
</sec>
<sec sec-type="ethics-statement" id="s6">
<title>Ethics statement</title>
<p>The studies involving humans were approved by Institutional Review Board at Purdue University. The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study. Written informed consent was obtained from the individual(s) for the publication of any potentially identifiable images or data included in this article.</p>
</sec>
<sec sec-type="author-contributions" id="s7">
<title>Author contributions</title>
<p>JW: Conceptualization, Data curation, Formal analysis, Investigation, Writing&#x02014;original draft. CS: Conceptualization, Writing&#x02014;review &#x00026; editing. WB: Writing&#x02014;review &#x00026; editing. DY: Conceptualization, Supervision, Writing&#x02014;review &#x00026; editing.</p>
</sec>
</body>
<back>
<sec sec-type="funding-information" id="s8">
<title>Funding</title>
<p>The author(s) declare financial support was received for the research, authorship, and/or publication of this article. The publication fee for this article was funded by Purdue Libraries through the Purdue University Libraries Open Access Publishing Fund, dedicated exclusively to supporting the dissemination of research findings via open access publication.</p>
</sec>
<ack><p>We would like to especially thank Eugene Lee for helping us run the pilot study, figuring out different demand levels of math and verbal questions, and testing the snowcat simulation. Also, we are grateful to both Eugene Lee and Sitong Chen for their support with the data collection process. This research was supported in part by the Air Force Research Laboratory Airman Systems Directorate, through the Air Force Office of Scientific Research Summer Faculty Fellowship Program<sup>&#x000AE;</sup>, Contract Numbers FA8750-15-3-6003, FA9550-15-0001, and FA9550-20-F-0005.</p>
</ack>
<sec sec-type="COI-statement" id="conf1">
<title>Conflict of interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="s9">
<title>Publisher&#x00027;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<sec sec-type="disclaimer" id="s10">
<title>Author disclaimer</title>
<p>The views expressed are those of the authors and do not reflect the official guidance or position of the United States Government, the Department of Defense, or of the United States Air Force. The contents have been reviewed and deemed Distribution A. Approved for public release. Case number: AFRL-2024-0618.</p>
</sec>
<sec sec-type="supplementary-material" id="s11">
<title>Supplementary material</title>
<p>The Supplementary Material for this article can be found online at: <ext-link ext-link-type="uri" xlink:href="https://www.frontiersin.org/articles/10.3389/fnrgo.2024.1292627/full#supplementary-material">https://www.frontiersin.org/articles/10.3389/fnrgo.2024.1292627/full#supplementary-material</ext-link></p>
<supplementary-material xlink:href="Data_Sheet_1.docx" id="SM1" mimetype="application/vnd.openxmlformats-officedocument.wordprocessingml.document" xmlns:xlink="http://www.w3.org/1999/xlink"/>
</sec>
<fn-group>
<fn id="fn0001"><p><sup>1</sup><ext-link ext-link-type="uri" xlink:href="https://cdn2.hubspot.net/hubfs/360031/official_SAT_practice_test_2002.pdf">https://cdn2.hubspot.net/hubfs/360031/official_SAT_practice_test_2002.pdf</ext-link>; <ext-link ext-link-type="uri" xlink:href="https://cdn2.hubspot.net/hubfs/360031/official_SAT_practice_test_2001.pdf">https://cdn2.hubspot.net/hubfs/360031/official_SAT_practice_test_2001.pdf</ext-link>; <ext-link ext-link-type="uri" xlink:href="https://cdn2.hubspot.net/hubfs/360031/official_SAT_practice_test_2003-04.pdf">https://cdn2.hubspot.net/hubfs/360031/official_SAT_practice_test_2003-04.pdf</ext-link>; <ext-link ext-link-type="uri" xlink:href="https://cdn2.hubspot.net/hubfs/360031/official_SAT_practice_test_2004-05.pdf">https://cdn2.hubspot.net/hubfs/360031/official_SAT_practice_test_2004-05.pdf</ext-link></p></fn>
<fn id="fn0002"><p><sup>2</sup><ext-link ext-link-type="uri" xlink:href="https://www.tobiipro.com/product-listing/tobii-pro-glasses-2/">https://www.tobiipro.com/product-listing/tobii-pro-glasses-2/</ext-link></p></fn>
<fn id="fn0003"><p><sup>3</sup><ext-link ext-link-type="uri" xlink:href="https://connect.tobii.com/s/article/Gaze-Filter-functions-and-effects?language=en_US&#x00023;:&#x0007E;:text=Gaze%20Filter%20%2D%20I%2DVT%20(,pursuit%20and%20VOR%20eye%20movements">https://connect.tobii.com/s/article/Gaze-Filter-functions-and-effects?language=en_US&#x00023;:&#x0007E;:text=Gaze%20Filter%20%2D%20I%2DVT%20(,pursuit%20and%20VOR%20eye%20movements</ext-link></p></fn>
<fn id="fn0004"><p><sup>4</sup><ext-link ext-link-type="uri" xlink:href="https://documentation.sas.com/doc/en/pgmsascdc/9.4_3.4/statug/statug_mixed_syntax01.htm">https://documentation.sas.com/doc/en/pgmsascdc/9.4_3.4/statug/statug_mixed_syntax01.htm</ext-link></p></fn>
</fn-group>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ahmadi</surname> <given-names>N.</given-names></name> <name><surname>Sasangohar</surname> <given-names>F.</given-names></name> <name><surname>Yang</surname> <given-names>J.</given-names></name> <name><surname>Yu</surname> <given-names>D.</given-names></name> <name><surname>Danesh</surname> <given-names>V.</given-names></name> <name><surname>Klahn</surname> <given-names>S.</given-names></name> <etal/></person-group>. (<year>2022</year>). <article-title>Quantifying workload and stress in intensive care unit nurses: preliminary evaluation using continuous eye-tracking</article-title>. <source>Hum. Factors</source>. <volume>2022</volume>:<fpage>00187208221085335</fpage>. <pub-id pub-id-type="doi">10.1177/00187208221085335</pub-id></citation>
</ref>
<ref id="B2">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ashcraft</surname> <given-names>M. H.</given-names></name></person-group> (<year>1992</year>). <article-title>Cognitive arithmetic: a review of data and theory</article-title>. <source>Cognition.</source> <volume>44</volume>, <fpage>75</fpage>&#x02013;<lpage>106</lpage>. <pub-id pub-id-type="doi">10.1016/0010-0277(92)90051-I</pub-id><pub-id pub-id-type="pmid">1511587</pub-id></citation></ref>
<ref id="B3">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bahill</surname> <given-names>A. T.</given-names></name></person-group> (<year>1975</year>). <article-title>Most naturally occurring human saccades have magnitudes of 15 degrees or less</article-title>. <source>Invest. Ophthalmol</source>. <volume>14</volume>, <fpage>468</fpage>&#x02013;<lpage>469</lpage>. <pub-id pub-id-type="pmid">1132942</pub-id></citation></ref>
<ref id="B4">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bahill</surname> <given-names>A. T.</given-names></name> <name><surname>Clark</surname> <given-names>M. R.</given-names></name> <name><surname>Stark</surname> <given-names>L.</given-names></name></person-group> (<year>1975</year>). <article-title>The main sequence, a tool for studying human eye movements</article-title>. <source>Math. Biosci.</source> <volume>24</volume>, <fpage>191</fpage>&#x02013;<lpage>204</lpage>. <pub-id pub-id-type="doi">10.1016/0025-5564(75)90075-9</pub-id></citation>
</ref>
<ref id="B5">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bejar</surname> <given-names>I. I.</given-names></name> <name><surname>Embretson</surname> <given-names>S.</given-names></name> <name><surname>Mayer</surname> <given-names>R. E.</given-names></name></person-group> (<year>1987</year>). <article-title>Cognitive psychology and the SAT: a review of some implications</article-title>. <source>ETS Res. Rep. Series</source>. <volume>1987</volume>, <fpage>i</fpage>-<lpage>73</lpage>. <pub-id pub-id-type="doi">10.1002/j.2330-8516.1987.tb00232.x</pub-id></citation>
</ref>
<ref id="B6">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Brookings</surname> <given-names>J. B.</given-names></name> <name><surname>Wilson</surname> <given-names>G. F.</given-names></name> <name><surname>Swain</surname> <given-names>C. R.</given-names></name></person-group> (<year>1996</year>). <article-title>Psychophysiological responses to changes in workload during simulated air traffic control</article-title>. <source>Biol. Psychol.</source> <volume>42</volume>, <fpage>361</fpage>&#x02013;<lpage>377</lpage>. <pub-id pub-id-type="doi">10.1016/0301-0511(95)05167-8</pub-id><pub-id pub-id-type="pmid">8652753</pub-id></citation></ref>
<ref id="B7">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Brunner</surname> <given-names>C.</given-names></name> <name><surname>Delorme</surname> <given-names>A.</given-names></name> <name><surname>Makeig</surname> <given-names>S.</given-names></name></person-group> (<year>2013</year>). <article-title>Eeglab&#x02013;an open source matlab toolbox for electrophysiological research</article-title>. <source>Biomed. Eng.</source> <volume>58</volume>:<fpage>000010151520134182</fpage>. <pub-id pub-id-type="doi">10.1515/bmt-2013-4182</pub-id><pub-id pub-id-type="pmid">24042816</pub-id></citation></ref>
<ref id="B8">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cain</surname> <given-names>B.</given-names></name></person-group> (<year>2007</year>). <source>A review of the mental workload literature</source>. DTIC Document.</citation>
</ref>
<ref id="B9">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Casper</surname> <given-names>J. L.</given-names></name> <name><surname>Micire</surname> <given-names>M.</given-names></name> <name><surname>Murphy</surname> <given-names>R. R.</given-names></name></person-group> (<year>2000</year>). <article-title>Issues in intelligent robots for search and rescue</article-title>, in <source>SPIE</source>.</citation>
</ref>
<ref id="B10">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Charles</surname> <given-names>R. L.</given-names></name> <name><surname>Nixon</surname> <given-names>J.</given-names></name></person-group> (<year>2019</year>). <article-title>Measuring mental workload using physiological measures: a systematic review</article-title>. <source>Appl. Ergon.</source> <volume>74</volume>, <fpage>221</fpage>&#x02013;<lpage>232</lpage>. <pub-id pub-id-type="doi">10.1016/j.apergo.2018.08.028</pub-id></citation>
</ref>
<ref id="B11">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Collewijn</surname> <given-names>H.</given-names></name> <name><surname>Erkelens</surname> <given-names>C. J.</given-names></name> <name><surname>Steinman</surname> <given-names>R. M.</given-names></name></person-group> (<year>1988</year>). <article-title>Binocular co-ordination of human vertical saccadic eye movements</article-title>. <source>J. Physiol.</source> <volume>404</volume>, <fpage>183</fpage>&#x02013;<lpage>197</lpage>. <pub-id pub-id-type="doi">10.1113/jphysiol.1988.sp017285</pub-id><pub-id pub-id-type="pmid">3253430</pub-id></citation></ref>
<ref id="B12">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Coovert</surname> <given-names>M. D.</given-names></name> <name><surname>Pavlova Miller</surname> <given-names>E. E.</given-names></name> <name><surname>Bennett</surname> <given-names>W.</given-names></name></person-group> (<year>2017b</year>). <article-title>Assessing trust and effectiveness in virtual teams: latent growth curve and latent change score models</article-title>. <source>Soc. Sci.</source> <volume>6</volume>:<fpage>87</fpage>. <pub-id pub-id-type="doi">10.3390/socsci6030087</pub-id></citation>
</ref>
<ref id="B13">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Coovert</surname> <given-names>M. D.</given-names></name> <name><surname>Winner</surname> <given-names>J.</given-names></name> <name><surname>Bennett</surname> <given-names>W.</given-names></name></person-group> (<year>2017a</year>). <article-title>Construct development and validation in game-based research</article-title>. <source>Simul. Gaming.</source> <volume>48</volume>, <fpage>236</fpage>&#x02013;<lpage>248</lpage>. <pub-id pub-id-type="doi">10.1177/1046878116682661</pub-id></citation>
</ref>
<ref id="B14">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dadashi</surname> <given-names>N.</given-names></name> <name><surname>Stedmon</surname> <given-names>A. W.</given-names></name> <name><surname>Pridmore</surname> <given-names>T. P.</given-names></name></person-group> (<year>2013</year>). <article-title>Semi-automated CCTV surveillance: the effects of system confidence, system accuracy and task complexity on operator vigilance, reliance and workload</article-title>. <source>Appl. Ergon.</source> <volume>44</volume>, <fpage>730</fpage>&#x02013;<lpage>738</lpage>. <pub-id pub-id-type="doi">10.1016/j.apergo.2012.04.012</pub-id><pub-id pub-id-type="pmid">22704458</pub-id></citation></ref>
<ref id="B15">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dehais</surname> <given-names>F.</given-names></name> <name><surname>Lafont</surname> <given-names>A.</given-names></name> <name><surname>Roy</surname> <given-names>R.</given-names></name> <name><surname>Fairclough</surname> <given-names>S. A.</given-names></name></person-group> (<year>2020</year>). <article-title>neuroergonomics approach to mental workload, engagement and human performance</article-title>. <source>Front. Neurosci.</source> <volume>14</volume>:<fpage>268</fpage>. <pub-id pub-id-type="doi">10.3389/fnins.2020.00268</pub-id><pub-id pub-id-type="pmid">32317914</pub-id></citation></ref>
<ref id="B16">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>DeJong</surname> <given-names>B. P.</given-names></name> <name><surname>Colgate</surname> <given-names>J. E.</given-names></name> <name><surname>Peshkin</surname> <given-names>M. A.</given-names></name></person-group> (<year>2004</year>). <article-title>Improving teleoperation: reducing mental rotations and translations</article-title>, in <source>IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA&#x00027;04. 2004</source> (<publisher-loc>IEEE</publisher-loc>) <fpage>3708</fpage>&#x02013;<lpage>3714</lpage>. <pub-id pub-id-type="doi">10.1109/ROBOT.2004.1308838</pub-id></citation>
</ref>
<ref id="B17">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Delorme</surname> <given-names>A.</given-names></name> <name><surname>Makeig</surname> <given-names>S.</given-names></name></person-group> (<year>2004</year>). <article-title>EEGLAB. an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis</article-title>. <source>J. Neurosci. Methods.</source> <volume>134</volume>, <fpage>9</fpage>&#x02013;<lpage>21</lpage>. <pub-id pub-id-type="doi">10.1016/j.jneumeth.2003.10.009</pub-id><pub-id pub-id-type="pmid">15102499</pub-id></citation></ref>
<ref id="B18">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dias</surname> <given-names>R. D.</given-names></name> <name><surname>Ngo-Howard</surname> <given-names>M. C.</given-names></name> <name><surname>Boskovski</surname> <given-names>M. T.</given-names></name> <name><surname>Zenati</surname> <given-names>M. A.</given-names></name> <name><surname>Yule</surname> <given-names>S. J.</given-names></name></person-group> (<year>2018</year>). <article-title>Systematic review of measurement tools to assess surgeons&#x00027; intraoperative cognitive workload</article-title>. <source>J. Br. Surg.</source> <volume>105</volume>, <fpage>491</fpage>&#x02013;<lpage>501</lpage>. <pub-id pub-id-type="doi">10.1002/bjs.10795</pub-id><pub-id pub-id-type="pmid">29465749</pub-id></citation></ref>
<ref id="B19">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ding</surname> <given-names>Y.</given-names></name> <name><surname>Cao</surname> <given-names>Y.</given-names></name> <name><surname>Duffy</surname> <given-names>V. G.</given-names></name> <name><surname>Wang</surname> <given-names>Y.</given-names></name> <name><surname>Zhang</surname> <given-names>X.</given-names></name></person-group> (<year>2020</year>). <article-title>Measurement and identification of mental workload during simulated computer tasks with multimodal methods and machine learning</article-title>. <source>Ergonomics</source> <volume>63</volume>, <fpage>896</fpage>&#x02013;<lpage>908</lpage>. <pub-id pub-id-type="doi">10.1080/00140139.2020.1759699</pub-id><pub-id pub-id-type="pmid">32330080</pub-id></citation></ref>
<ref id="B20">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dirican</surname> <given-names>A. C.</given-names></name> <name><surname>G&#x000F6;kt&#x000FC;rk</surname> <given-names>M.</given-names></name></person-group> (<year>2011</year>). <article-title>Psychophysiological measures of human cognitive states applied in human computer interaction</article-title>. <source>Procedia Comput. Sci.</source> <volume>3</volume>, <fpage>1361</fpage>&#x02013;<lpage>1367</lpage>. <pub-id pub-id-type="doi">10.1016/j.procs.2011.01.016</pub-id></citation>
</ref>
<ref id="B21">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Dyer</surname> <given-names>R. F.</given-names></name> <name><surname>Matthews</surname> <given-names>J. J.</given-names></name> <name><surname>Wright</surname> <given-names>C. E.</given-names></name> <name><surname>Yudowitch</surname> <given-names>K. L.</given-names></name></person-group> (<year>1976</year>). <source>Questionnaire Construction Manual</source>. <publisher-loc>Palo Alto, CA</publisher-loc>: <publisher-name>Operations Research Associates</publisher-name>. <pub-id pub-id-type="doi">10.1037/e410402004-001</pub-id></citation>
</ref>
<ref id="B22">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fairclough</surname> <given-names>S. H.</given-names></name> <name><surname>Venables</surname> <given-names>L.</given-names></name></person-group> (<year>2006</year>). <article-title>Prediction of subjective states from psychophysiology: a multivariate approach</article-title>. <source>Biol. Psychol.</source> <volume>71</volume>, <fpage>100</fpage>&#x02013;<lpage>110</lpage>. <pub-id pub-id-type="doi">10.1016/j.biopsycho.2005.03.007</pub-id><pub-id pub-id-type="pmid">15978715</pub-id></citation></ref>
<ref id="B23">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fallahi</surname> <given-names>M.</given-names></name> <name><surname>Heidarimoghadam</surname> <given-names>R.</given-names></name> <name><surname>Motamedzade</surname> <given-names>M.</given-names></name> <name><surname>Farhadian</surname> <given-names>M.</given-names></name></person-group> (<year>2016</year>). <article-title>Psycho physiological and subjective responses to mental workload levels during N-back task</article-title>. <source>J. Ergon.</source> <volume>6</volume>, <fpage>1</fpage>&#x02013;<lpage>7</lpage>. <pub-id pub-id-type="doi">10.4172/2165-7556.1000181</pub-id></citation>
</ref>
<ref id="B24">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Galy</surname> <given-names>E.</given-names></name> <name><surname>Cariou</surname> <given-names>M.</given-names></name> <name><surname>M&#x000E9;lan</surname> <given-names>C.</given-names></name></person-group> (<year>2012</year>). <article-title>What is the relationship between mental workload factors and cognitive load types?</article-title> <source>Int. J. Psychophysiol.</source> <volume>83</volume>, <fpage>269</fpage>&#x02013;<lpage>275</lpage>. <pub-id pub-id-type="doi">10.1016/j.ijpsycho.2011.09.023</pub-id><pub-id pub-id-type="pmid">22008523</pub-id></citation></ref>
<ref id="B25">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Geisen</surname> <given-names>E.</given-names></name></person-group> (<year>2017</year>). <source>Usability Testing for Survey Research</source>. <publisher-loc>Burlington, MA</publisher-loc>: <publisher-name>Morgan Kaufmann</publisher-name>.</citation>
</ref>
<ref id="B26">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gevins</surname> <given-names>A.</given-names></name> <name><surname>Smith</surname> <given-names>M. E.</given-names></name> <name><surname>McEvoy</surname> <given-names>L.</given-names></name> <name><surname>Yu</surname> <given-names>D.</given-names></name></person-group> (<year>1997</year>). <article-title>High-resolution EEG mapping of cortical activation related to working memory: effects of task difficulty, type of processing, and practice</article-title>. <source>Cerebral Cortex</source>. <volume>7</volume>, <fpage>374</fpage>&#x02013;<lpage>385</lpage>. <pub-id pub-id-type="doi">10.1093/cercor/7.4.374</pub-id><pub-id pub-id-type="pmid">9177767</pub-id></citation></ref>
<ref id="B27">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Hancock</surname> <given-names>P. A.</given-names></name></person-group> (<year>1988</year>). <article-title>The effect of gender and time of day upon the subjective estimate of mental workload during the performance of a simple task</article-title>, in <source>Advances in Psychology</source> (<publisher-loc>North-Holland</publisher-loc>), <fpage>239</fpage>&#x02013;<lpage>250</lpage>. <pub-id pub-id-type="doi">10.1016/S0166-4115(08)62390-0</pub-id></citation>
</ref>
<ref id="B28">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Harmony</surname> <given-names>T.</given-names></name> <name><surname>Fern&#x000E1;ndez</surname> <given-names>T.</given-names></name> <name><surname>Silva</surname> <given-names>J.</given-names></name> <name><surname>Bosch</surname> <given-names>J.</given-names></name> <name><surname>Vald&#x000E9;s</surname> <given-names>P.</given-names></name> <name><surname>Fern&#x000E1;ndez-Bouzas</surname> <given-names>A.</given-names></name> <etal/></person-group>. (<year>1999</year>). <article-title>Do specific EEG frequencies indicate different processes during mental calculation?</article-title> <source>Neurosci. Lett</source>. <volume>266</volume>, <fpage>25</fpage>&#x02013;<lpage>28</lpage>. <pub-id pub-id-type="doi">10.1016/S0304-3940(99)00244-X</pub-id><pub-id pub-id-type="pmid">10336175</pub-id></citation></ref>
<ref id="B29">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Hart</surname> <given-names>S. G.</given-names></name> <name><surname>Wickens</surname> <given-names>C. D.</given-names></name></person-group> (<year>1990</year>). <source>Workload Assessment and Prediction</source>. (<publisher-loc>Cham</publisher-loc>: <publisher-name>Springer</publisher-name>), <fpage>257</fpage>&#x02013;<lpage>96</lpage>. <pub-id pub-id-type="doi">10.1007/978-94-009-0437-8_9</pub-id></citation>
</ref>
<ref id="B30">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hicks</surname> <given-names>T. G.</given-names></name> <name><surname>Wierwille</surname> <given-names>W. W.</given-names></name></person-group> (<year>1979</year>). <article-title>Comparison of five mental workload assessment procedures in a moving-base driving simulator</article-title>. <source>Hum. Factors.</source> <volume>21</volume>, <fpage>129</fpage>&#x02013;<lpage>143</lpage>. <pub-id pub-id-type="doi">10.1177/001872087902100201</pub-id></citation>
</ref>
<ref id="B31">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hill</surname> <given-names>S. G.</given-names></name> <name><surname>Iavecchia</surname> <given-names>H. P.</given-names></name> <name><surname>Byers</surname> <given-names>J. C.</given-names></name> <name><surname>Bittner</surname> <given-names>A. C.</given-names></name> <name><surname>Zaklade</surname> <given-names>A. L.</given-names></name> <name><surname>Christ</surname> <given-names>R. E.</given-names></name> <etal/></person-group>. (<year>1992</year>). <article-title>Comparison of four subjective workload rating scales</article-title>. <source>Hum. Factors.</source> <volume>34</volume>, <fpage>429</fpage>&#x02013;<lpage>439</lpage>. <pub-id pub-id-type="doi">10.1177/001872089203400405</pub-id></citation>
</ref>
<ref id="B32">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hitch</surname> <given-names>G. J.</given-names></name></person-group> (<year>1978</year>). <article-title>The role of short-term working memory in mental arithmetic</article-title>. <source>Cogn. Psychol.</source> <volume>10</volume>, <fpage>302</fpage>&#x02013;<lpage>323</lpage>. <pub-id pub-id-type="doi">10.1016/0010-0285(78)90002-6</pub-id></citation>
</ref>
<ref id="B33">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Hockey</surname> <given-names>G. R. J.</given-names></name> <name><surname>Nickel</surname> <given-names>P.</given-names></name> <name><surname>Roberts</surname> <given-names>A. C.</given-names></name> <name><surname>Roberts</surname> <given-names>M. H.</given-names></name></person-group> (<year>2009</year>). <article-title>Sensitivity of candidate markers of psychophysiological strain to cyclical changes in manual control load during simulated process control</article-title>. <source>Appl. Ergon.</source> <volume>40</volume>, <fpage>1011</fpage>&#x02013;<lpage>1018</lpage>. <pub-id pub-id-type="doi">10.1016/j.apergo.2009.04.008</pub-id><pub-id pub-id-type="pmid">19482260</pub-id></citation></ref>
<ref id="B34">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jaquess</surname> <given-names>K. J.</given-names></name> <name><surname>Lo</surname> <given-names>L. C.</given-names></name> <name><surname>Oh</surname> <given-names>H.</given-names></name> <name><surname>Lu</surname> <given-names>C.</given-names></name> <name><surname>Ginsberg</surname> <given-names>A.</given-names></name> <name><surname>Tan</surname> <given-names>Y. Y.</given-names></name> <etal/></person-group>. (<year>2018</year>). <article-title>Changes in mental workload and motor performance throughout multiple practice sessions under various levels of task difficulty</article-title>. <source>Neuroscience</source> <volume>393</volume>, <fpage>305</fpage>&#x02013;<lpage>318</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuroscience.2018.09.019</pub-id><pub-id pub-id-type="pmid">30266685</pub-id></citation></ref>
<ref id="B35">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Kantowitz</surname> <given-names>B. H.</given-names></name> <name><surname>Casper</surname> <given-names>P. A.</given-names></name></person-group> (<year>1988</year>). <article-title>Human workload in aviation</article-title>, in <source>Human Factors in Aviation</source> (<publisher-loc>Elsevier</publisher-loc>). p. <fpage>157</fpage>&#x02013;<lpage>87</lpage>. <pub-id pub-id-type="doi">10.1016/B978-0-08-057090-7.50012-6</pub-id></citation>
</ref>
<ref id="B36">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kappel</surname> <given-names>S. L.</given-names></name> <name><surname>Looney</surname> <given-names>D.</given-names></name> <name><surname>Mandic</surname> <given-names>D. P.</given-names></name> <name><surname>Kidmose</surname> <given-names>P.</given-names></name></person-group> (<year>2017</year>). <article-title>Physiological artifacts in scalp EEG and ear-EEG</article-title>. <source>Biomed. Eng.</source> <volume>16</volume>, <fpage>1</fpage>&#x02013;<lpage>16</lpage>. <pub-id pub-id-type="doi">10.1186/s12938-017-0391-2</pub-id><pub-id pub-id-type="pmid">28800744</pub-id></citation></ref>
<ref id="B37">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Longo</surname> <given-names>L.</given-names></name> <name><surname>Wickens</surname> <given-names>C. D.</given-names></name> <name><surname>Hancock</surname> <given-names>G.</given-names></name> <name><surname>Hancock</surname> <given-names>P. A.</given-names></name></person-group> (<year>2022</year>). <article-title>Human mental workload: a survey and a novel inclusive definition</article-title>. <source>Front. Psychol.</source> <volume>13</volume>:<fpage>883321</fpage>. <pub-id pub-id-type="doi">10.3389/fpsyg.2022.883321</pub-id><pub-id pub-id-type="pmid">35719509</pub-id></citation></ref>
<ref id="B38">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Longo</surname> <given-names>L. A.</given-names></name></person-group> (<year>2015</year>). <article-title>defeasible reasoning framework for human mental workload representation and assessment</article-title>. <source>Behav. Inf. Technol.</source> <volume>34</volume>, <fpage>758</fpage>&#x02013;<lpage>786</lpage>. <pub-id pub-id-type="doi">10.1080/0144929X.2015.1015166</pub-id></citation>
</ref>
<ref id="B39">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mahanama</surname> <given-names>B.</given-names></name> <name><surname>Jayawardana</surname> <given-names>Y.</given-names></name> <name><surname>Rengarajan</surname> <given-names>S.</given-names></name> <name><surname>Jayawardena</surname> <given-names>G.</given-names></name> <name><surname>Chukoskie</surname> <given-names>L.</given-names></name> <name><surname>Snider</surname> <given-names>J.</given-names></name> <etal/></person-group>. (<year>2022</year>). <article-title>Eye movement and pupil measures: a review</article-title>. <source>Front. Comput. Sci.</source> <volume>3</volume>:<fpage>733531</fpage>. <pub-id pub-id-type="doi">10.3389/fcomp.2021.733531</pub-id></citation>
</ref>
<ref id="B40">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>May</surname> <given-names>J. G.</given-names></name> <name><surname>Kennedy</surname> <given-names>R. S.</given-names></name> <name><surname>Williams</surname> <given-names>M. C.</given-names></name> <name><surname>Dunlap</surname> <given-names>W. P.</given-names></name> <name><surname>Brannan</surname> <given-names>J. R.</given-names></name></person-group> (<year>1990</year>). <article-title>Eye movement indices of mental workload</article-title>. <source>Acta Psychol.</source> <volume>75</volume>, <fpage>75</fpage>&#x02013;<lpage>89</lpage>. <pub-id pub-id-type="doi">10.1016/0001-6918(90)90067-P</pub-id><pub-id pub-id-type="pmid">2260494</pub-id></citation></ref>
<ref id="B41">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Meshkati</surname> <given-names>N.</given-names></name> <name><surname>Hancock</surname> <given-names>P. A.</given-names></name> <name><surname>Rahimi</surname> <given-names>M.</given-names></name> <name><surname>Dawes</surname> <given-names>S. M.</given-names></name></person-group> (<year>1995</year>). <article-title>Techniques in mental workload assessment</article-title>, in <source>Evaluation of Human Work: A Practical Ergonomics Methodology, 2nd ed</source>, eds <person-group person-group-type="editor"><name><surname>Wilson</surname> <given-names>J. R.</given-names></name> <name><surname>Corlett</surname> <given-names>E. N.</given-names></name></person-group> (<publisher-name>Taylor &#x00026; Francis</publisher-name>), <fpage>749</fpage>&#x02013;<lpage>782</lpage>.</citation>
</ref>
<ref id="B42">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Miller</surname> <given-names>M. W.</given-names></name> <name><surname>Rietschel</surname> <given-names>J. C.</given-names></name> <name><surname>McDonald</surname> <given-names>C. G.</given-names></name> <name><surname>Hatfield</surname> <given-names>B. D. A.</given-names></name></person-group> (<year>2011</year>). <article-title>novel approach to the physiological measurement of mental workload</article-title>. <source>Int. J. Psychophysiol.</source> <volume>80</volume>, <fpage>75</fpage>&#x02013;<lpage>78</lpage>. <pub-id pub-id-type="doi">10.1016/j.ijpsycho.2011.02.003</pub-id><pub-id pub-id-type="pmid">21320552</pub-id></citation></ref>
<ref id="B43">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Miller</surname> <given-names>S.</given-names></name></person-group> (<year>2001</year>). <source>Literature Review: Workload Measures</source>. <publisher-loc>Iowa City, IA</publisher-loc>: <publisher-name>The University of Iowa</publisher-name>.</citation>
</ref>
<ref id="B44">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Monfared</surname> <given-names>S.</given-names></name> <name><surname>Athanasiadis</surname> <given-names>D. I.</given-names></name> <name><surname>Umana</surname> <given-names>L.</given-names></name> <name><surname>Hernandez</surname> <given-names>E.</given-names></name> <name><surname>Asadi</surname> <given-names>H.</given-names></name> <name><surname>Colgate</surname> <given-names>C. L.</given-names></name> <etal/></person-group>. (<year>2022</year>). <article-title>A comparison of laparoscopic and robotic ergonomic risk</article-title>. <source>Surg. Endosc.</source> <volume>36</volume>, <fpage>8397</fpage>&#x02013;<lpage>8402</lpage>. <pub-id pub-id-type="doi">10.1007/s00464-022-09105-0</pub-id><pub-id pub-id-type="pmid">35182219</pub-id></citation></ref>
<ref id="B45">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Monk</surname> <given-names>C. A.</given-names></name> <name><surname>Boehm-Davis</surname> <given-names>D. A.</given-names></name> <name><surname>Trafton</surname> <given-names>J. G.</given-names></name></person-group> (<year>2002</year>). <source>The Attentional Costs of Interrupting Task Performance at Various Stages</source>. <publisher-name>SAGE Publications Sage CA</publisher-name>: <publisher-loc>Los Angeles, CA</publisher-loc>. <pub-id pub-id-type="doi">10.1177/154193120204602210</pub-id></citation>
</ref>
<ref id="B46">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mu&#x000F1;oz-de-Escalona</surname> <given-names>E.</given-names></name> <name><surname>Ca&#x000F1;as</surname> <given-names>J. J.</given-names></name> <name><surname>Leva</surname> <given-names>C.</given-names></name> <name><surname>Longo</surname> <given-names>L.</given-names></name></person-group> (<year>2020</year>). <article-title>Task demand transition peak point effects on mental workload measures divergence</article-title>, in <source>Human Mental Workload: Models and Applications: 4th International Symposium, H-WORKLOAD 2020, Granada, Spain, December 3&#x02013;</source>5, 2020. <italic>Proceedings 4</italic> (Springer International Publishing), <fpage>207</fpage>&#x02013;<lpage>226</lpage>. <pub-id pub-id-type="doi">10.1007/978-3-030-62302-9_13</pub-id></citation>
</ref>
<ref id="B47">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Murphy</surname> <given-names>R. R.</given-names></name></person-group> (<year>2001</year>). <article-title>Rescue robots at the world trade center from sept. 11-21, 2001</article-title>. <source>IEEE Robot. Automat. Mag</source>. <volume>13</volume>, <fpage>11</fpage>&#x02013;<lpage>21</lpage>. <pub-id pub-id-type="doi">10.1109/mra.2004.1337826</pub-id></citation>
</ref>
<ref id="B48">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Murphy</surname> <given-names>R. R.</given-names></name></person-group> (<year>2007</year>). <source>Search and Rescue Robotics</source>. <publisher-loc>New York</publisher-loc>: <publisher-name>Springer handbook of robotics</publisher-name>. <fpage>1151</fpage>&#x02013;<lpage>73</lpage>. <pub-id pub-id-type="doi">10.1007/978-3-540-30301-5_51</pub-id></citation>
</ref>
<ref id="B49">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Norman</surname> <given-names>D. A.</given-names></name> <name><surname>Draper</surname> <given-names>S. W.</given-names></name></person-group> (<year>1986</year>). <article-title>User centered system design: new perspectives on human-computer interaction</article-title>. <fpage>12</fpage>. <pub-id pub-id-type="doi">10.1201/b15703</pub-id></citation>
</ref>
<ref id="B50">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pion-Tonachini</surname> <given-names>L.</given-names></name> <name><surname>Kreutz-Delgado</surname> <given-names>K.</given-names></name> <name><surname>Makeig</surname> <given-names>S.</given-names></name></person-group> (<year>2019</year>). <article-title>ICLabel: an automated electroencephalographic independent component classifier, dataset, and website</article-title>. <source>Neuroimage</source> <volume>198</volume>, <fpage>181</fpage>&#x02013;<lpage>197</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuroimage.2019.05.026</pub-id><pub-id pub-id-type="pmid">31103785</pub-id></citation></ref>
<ref id="B51">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pourteimour</surname> <given-names>S.</given-names></name> <name><surname>Yaghmaei</surname> <given-names>S.</given-names></name> <name><surname>Babamohamadi</surname> <given-names>H.</given-names></name></person-group> (<year>2021</year>). <article-title>The relationship between mental workload and job performance among Iranian nurses providing care to COVID-19 patients: a cross-sectional study</article-title>. <source>J. Nurs. Manag.</source> <volume>29</volume>, <fpage>1723</fpage>&#x02013;<lpage>1732</lpage>. <pub-id pub-id-type="doi">10.1111/jonm.13305</pub-id><pub-id pub-id-type="pmid">33690932</pub-id></citation></ref>
<ref id="B52">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rubio</surname> <given-names>S.</given-names></name> <name><surname>D&#x000ED;az</surname> <given-names>E.</given-names></name> <name><surname>Mart&#x000ED;n</surname> <given-names>J.</given-names></name> <name><surname>Puente</surname> <given-names>J. M.</given-names></name></person-group> (<year>2004</year>). <article-title>Evaluation of subjective mental workload: a comparison of SWAT, NASA-TLX, and workload profile methods</article-title>. <source>Appl. Psychol.</source> <volume>53</volume>, <fpage>61</fpage>&#x02013;<lpage>86</lpage>. <pub-id pub-id-type="doi">10.1111/j.1464-0597.2004.00161.x</pub-id></citation>
</ref>
<ref id="B53">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ryu</surname> <given-names>K.</given-names></name> <name><surname>Myung</surname> <given-names>R.</given-names></name></person-group> (<year>2005</year>). <article-title>Evaluation of mental workload with a combined measure based on physiological indices during a dual task of tracking and mental arithmetic</article-title>. <source>Int. J. Ind. Ergon.</source> <volume>35</volume>, <fpage>991</fpage>&#x02013;<lpage>1009</lpage>. <pub-id pub-id-type="doi">10.1016/j.ergon.2005.04.005</pub-id></citation>
</ref>
<ref id="B54">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Salvucci</surname> <given-names>D. D.</given-names></name> <name><surname>Taatgen</surname> <given-names>N. A.</given-names></name></person-group> (<year>2010</year>). <source>The Multitasking Mind.</source> <publisher-loc>Oxford</publisher-loc>: <publisher-name>Oxford University Press</publisher-name>.</citation>
</ref>
<ref id="B55">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sasaki</surname> <given-names>K.</given-names></name> <name><surname>Nambu</surname> <given-names>A.</given-names></name> <name><surname>Tsujimoto</surname> <given-names>T.</given-names></name> <name><surname>Matsuzaki</surname> <given-names>R.</given-names></name> <name><surname>Kyuhou</surname> <given-names>S.</given-names></name> <name><surname>Gemba</surname> <given-names>H.</given-names></name> <etal/></person-group>. (<year>1996</year>). <article-title>Studies on integrative functions of the human frontal association cortex with MEG</article-title>. <source>Cogn. Brain Res.</source> <volume>5</volume>, <fpage>165</fpage>&#x02013;<lpage>174</lpage>. <pub-id pub-id-type="doi">10.1016/S0926-6410(96)00053-5</pub-id><pub-id pub-id-type="pmid">9049083</pub-id></citation></ref>
<ref id="B56">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Schlegel</surname> <given-names>R.</given-names></name></person-group> (<year>1993</year>). <source>Automotive ergonomics. Chapter 17. Driver Mental Workload.</source> <publisher-loc>New York</publisher-loc>: <publisher-name>Taylor and Francis Ltd</publisher-name>.</citation>
</ref>
<ref id="B57">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wang</surname> <given-names>S.</given-names></name> <name><surname>Gwizdka</surname> <given-names>J.</given-names></name> <name><surname>Chaovalitwongse</surname> <given-names>W. A.</given-names></name></person-group> (<year>2015</year>). <article-title>Using wireless EEG signals to assess memory workload in the $ n $-back task</article-title>. <source>IEEE Trans. Hum. Mach. Syst.</source> <volume>46</volume>, <fpage>424</fpage>&#x02013;<lpage>435</lpage>. <pub-id pub-id-type="doi">10.1109/THMS.2015.2476818</pub-id></citation>
</ref>
<ref id="B58">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wickens</surname> <given-names>C. D.</given-names></name></person-group> (<year>2008</year>). <article-title>Multiple resources and mental workload</article-title>. <source>Hum. Factors.</source> <volume>50</volume>, <fpage>449</fpage>&#x02013;<lpage>455</lpage>. <pub-id pub-id-type="doi">10.1518/001872008X288394</pub-id><pub-id pub-id-type="pmid">18689052</pub-id></citation></ref>
<ref id="B59">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Young</surname> <given-names>M. S.</given-names></name> <name><surname>Brookhuis</surname> <given-names>K. A.</given-names></name> <name><surname>Wickens</surname> <given-names>C. D.</given-names></name> <name><surname>Hancock</surname> <given-names>P. A.</given-names></name></person-group> (<year>2015</year>). <article-title>State of science: mental workload in ergonomics</article-title>. <source>Ergonomics</source> <volume>58</volume>, <fpage>1</fpage>&#x02013;<lpage>17</lpage>. <pub-id pub-id-type="doi">10.1080/00140139.2014.956151</pub-id><pub-id pub-id-type="pmid">25442818</pub-id></citation></ref>
<ref id="B60">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Young</surname> <given-names>M. S.</given-names></name> <name><surname>Stanton</surname> <given-names>N. A.</given-names></name></person-group> (<year>2004</year>). <article-title>Mental workload</article-title>, in <source>Handbook of Human Factors and Ergonomics Methods</source> (<publisher-loc>CRC Press</publisher-loc>). p. <fpage>416</fpage>&#x02013;<lpage>26</lpage>. <pub-id pub-id-type="doi">10.1201/9780203489925-50</pub-id></citation>
</ref>
<ref id="B61">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yu</surname> <given-names>D.</given-names></name> <name><surname>Antonik</surname> <given-names>C. W.</given-names></name> <name><surname>Webber</surname> <given-names>F.</given-names></name> <name><surname>Watz</surname> <given-names>E.</given-names></name> <name><surname>Bennett</surname> <given-names>W.</given-names></name></person-group> (<year>2019</year>). <article-title>Multi-modal physiological sensing approach for distinguishing high workload events in remotely piloted aircraft simulation</article-title>. <source>Hum. Intell. Syst. Integr.</source> <volume>1</volume>, <fpage>89</fpage>&#x02013;<lpage>99</lpage>. <pub-id pub-id-type="doi">10.1007/s42454-020-00016-w</pub-id></citation>
</ref>
<ref id="B62">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yu</surname> <given-names>D.</given-names></name> <name><surname>Antonik</surname> <given-names>C. W.</given-names></name> <name><surname>Webber</surname> <given-names>F.</given-names></name> <name><surname>Watz</surname> <given-names>E.</given-names></name> <name><surname>Bennett</surname> <given-names>W.</given-names></name></person-group> (<year>2021</year>). <article-title>Correction to: multi-modal physiological sensing approach for distinguishing high workload events in remotely piloted aircraft simulation</article-title>. <source>Hum. Intell. Syst. Integr.</source> <volume>3</volume>, <fpage>201</fpage>&#x02013;<lpage>211</lpage>. <pub-id pub-id-type="doi">10.1007/s42454-021-00033-3</pub-id></citation>
</ref>
<ref id="B63">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zeng</surname> <given-names>C.</given-names></name> <name><surname>Wang</surname> <given-names>W.</given-names></name> <name><surname>Chen</surname> <given-names>C.</given-names></name> <name><surname>Zhang</surname> <given-names>C.</given-names></name> <name><surname>Cheng</surname> <given-names>B.</given-names></name></person-group> (<year>2020</year>). <article-title>Sex differences in time-domain and frequency-domain heart rate variability measures of fatigued drivers</article-title>. <source>Int. J. Environ. Res. Public Health.</source> <volume>17</volume>:<fpage>8499</fpage>. <pub-id pub-id-type="doi">10.3390/ijerph17228499</pub-id><pub-id pub-id-type="pmid">33212769</pub-id></citation></ref>
<ref id="B64">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhang</surname> <given-names>T.</given-names></name> <name><surname>Yang</surname> <given-names>J.</given-names></name> <name><surname>Liang</surname> <given-names>N.</given-names></name> <name><surname>Pitts</surname> <given-names>B. J.</given-names></name> <name><surname>Prakah-Asante</surname> <given-names>K.</given-names></name> <name><surname>Curry</surname> <given-names>R.</given-names></name> <etal/></person-group>. (<year>2023</year>). <article-title>Physiological measurements of situation awareness: a systematic review</article-title>. <source>Hum. Factors</source> <volume>65</volume>, <fpage>737</fpage>&#x02013;<lpage>758</lpage>. <pub-id pub-id-type="doi">10.1177/0018720820969071</pub-id></citation>
</ref>
<ref id="B65">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhao</surname> <given-names>J.</given-names></name> <name><surname>Gao</surname> <given-names>J.</given-names></name> <name><surname>Zhao</surname> <given-names>F.</given-names></name> <name><surname>Liu</surname> <given-names>Y. A.</given-names></name></person-group> (<year>2017</year>). <article-title>search-and-rescue robot system for remotely sensing the underground coal mine environment</article-title>. <source>Sensors</source> <volume>17</volume>:<fpage>2426</fpage>. <pub-id pub-id-type="doi">10.3390/s17102426</pub-id><pub-id pub-id-type="pmid">29065560</pub-id></citation></ref>
<ref id="B66">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhou</surname> <given-names>T.</given-names></name> <name><surname>Cha</surname> <given-names>J. S.</given-names></name> <name><surname>Gonzalez</surname> <given-names>G.</given-names></name> <name><surname>Wachs</surname> <given-names>J. P.</given-names></name> <name><surname>Sundaram</surname> <given-names>C. P.</given-names></name> <name><surname>Yu</surname> <given-names>D.</given-names></name></person-group> (<year>2020</year>). <article-title>Multimodal physiological signals for workload prediction in robot-assisted surgery</article-title>. <source>ACM Trans. Hum. Robot Inter.</source> <volume>9</volume>, <fpage>1</fpage>&#x02013;<lpage>26</lpage>. <pub-id pub-id-type="doi">10.1145/3368589</pub-id></citation>
</ref>
<ref id="B67">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhou</surname> <given-names>Y.</given-names></name> <name><surname>Xu</surname> <given-names>Z.</given-names></name> <name><surname>Niu</surname> <given-names>Y.</given-names></name> <name><surname>Wang</surname> <given-names>P.</given-names></name> <name><surname>Wen</surname> <given-names>X.</given-names></name> <name><surname>Wu</surname> <given-names>X.</given-names></name> <etal/></person-group>. (<year>2022</year>). <article-title>Cross-task cognitive workload recognition based on EEG and domain adaptation</article-title>. <source>IEEE Trans. Neur. Syst. Rehabil. Eng.</source> <volume>30</volume>, <fpage>50</fpage>&#x02013;<lpage>60</lpage>. <pub-id pub-id-type="doi">10.1109/TNSRE.2022.3140456</pub-id><pub-id pub-id-type="pmid">34986098</pub-id></citation></ref>
</ref-list>
</back>
</article>