<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xml:lang="EN" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="review-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Neuroergon.</journal-id>
<journal-title>Frontiers in Neuroergonomics</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Neuroergon.</abbrev-journal-title>
<issn pub-type="epub">2673-6195</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fnrgo.2023.1059476</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Neuroergonomics</subject>
<subj-group>
<subject>Review</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>A narrative review of the interconnection between pilot acute stress, startle, and surprise effects in the aviation context: Contribution of physiological measurements</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Diarra</surname> <given-names>Moussa</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/2053418/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Marchitto</surname> <given-names>Mauro</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/2037709/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Bressolle</surname> <given-names>Marie-Christine</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
</contrib>
<contrib contrib-type="author">
<name><surname>Baccino</surname> <given-names>Thierry</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>Drai-Zerbib</surname> <given-names>V&#x000E9;ronique</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="corresp" rid="c002"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/1237209/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>LEAD-CNRS, UMR5022, Universit&#x000E9; Bourgogne</institution>, <addr-line>Dijon</addr-line>, <country>France</country></aff>
<aff id="aff2"><sup>2</sup><institution>LUTIN, University Paris 8</institution>, <addr-line>Paris</addr-line>, <country>France</country></aff>
<aff id="aff3"><sup>3</sup><institution>Universit&#x000E9; Paris 8</institution>, <addr-line>Saint-Denis</addr-line>, <country>France</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Carryl L. Baldwin, Wichita State University, United States</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Gianluca Borghini, Sapienza University of Rome, Italy; Giovanni Vecchiato, National Research Council of Italy, Italy; Giacinto Barresi, Italian Institute of Technology (IIT), Italy</p></fn>
<corresp id="c001">&#x0002A;Correspondence: Moussa Diarra &#x02709; <email>moussadiarra11&#x00040;hotmail.com</email></corresp>
<corresp id="c002">V&#x000E9;ronique Drai-Zerbib &#x02709; <email>veronique.drai-zerbib&#x00040;u-bourgogne.fr</email></corresp>
<fn fn-type="other" id="fn001"><p>This article was submitted to Cognitive Neuroergonomics, a section of the journal Frontiers in Neuroergonomics</p></fn></author-notes>
<pub-date pub-type="epub">
<day>23</day>
<month>02</month>
<year>2023</year>
</pub-date>
<pub-date pub-type="collection">
<year>2023</year>
</pub-date>
<volume>4</volume>
<elocation-id>1059476</elocation-id>
<history>
<date date-type="received">
<day>01</day>
<month>10</month>
<year>2022</year>
</date>
<date date-type="accepted">
<day>30</day>
<month>01</month>
<year>2023</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2023 Diarra, Marchitto, Bressolle, Baccino and Drai-Zerbib.</copyright-statement>
<copyright-year>2023</copyright-year>
<copyright-holder>Diarra, Marchitto, Bressolle, Baccino and Drai-Zerbib</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license></permissions>
<abstract>
<p>Aviation remains one of the safest modes of transportation. However, an inappropriate response to an unexpected event can lead to flight incidents and accidents. Among several contributory factors, startle and surprise, which can lead to or exacerbate the pilot&#x00027;s state of stress, are often cited. Unlike stress, which has been the subject of much study in the context of driving and piloting, studies on startle and surprise are less numerous and these concepts are sometimes used interchangeably. Thus, the definitions of stress, startle, and surprise are reviewed, and related differences are put in evidence. Furthermore, it is proposed to distinguish these notions in the evaluation and to add physiological measures to subjective measures in their study. Indeed, Landman&#x00027;s theoretical model makes it possible to show the links between these concepts and studies using physiological parameters show that they would make it possible to disentangle the links between stress, startle and surprise in the context of aviation. Finally, we draw some perspectives to set up further studies focusing specifically on these concepts and their measurement.</p></abstract>
<kwd-group>
<kwd>startle</kwd>
<kwd>surprise</kwd>
<kwd>stress</kwd>
<kwd>aviation</kwd>
<kwd>physiological measures</kwd>
<kwd>autonomic nervous system</kwd>
<kwd>sympathetic nervous system</kwd>
</kwd-group>
<counts>
<fig-count count="2"/>
<table-count count="0"/>
<equation-count count="0"/>
<ref-count count="117"/>
<page-count count="15"/>
<word-count count="14261"/>
</counts>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="s1">
<title>Introduction</title>
<p>While aviation remains the safest mode of transportation in the world, an inappropriate response to an unexpected event can lead to flight incidents and accidents. Some examples where an unexpected event led the pilot to make inappropriate/ineffective decisions leading to the crash are reported in the literature (Martin et al., <xref ref-type="bibr" rid="B71">2015</xref>). Two factors, among others, are recognized as having played an important role in these events: <bold>startle</bold> and <bold>surprise</bold>. They were identified as determining events in many aviation issues. The analysis of incident reports in the Aviation Safety Reporting System (ASRS) from 1994 to 2013 shows 902 reports of surprise and 134 reports of startle. Among the incidents involving the startle, 37% involved a high intense stimulus (e.g., a loud noise) which interrupted the task in progress and/or provoked a protective reaction, while most of the incidents included an unexpected event or the absence of an expected event (Rivera et al., <xref ref-type="bibr" rid="B86">2014</xref>). A more recent search on the Aviation Safety Reporting System (ASRS) database yields 4,361 incidents reports evoking &#x0201C;surprise&#x0201D; and 583 reports in which the term &#x0201C;startle&#x0201D; was mentioned (a wildcard % were used in the text search to imply all derivatives of these words, e.g., startl%, surpris%). For example, an instinctive reflex of Colgan Air Flight 3407 pilot (pulling back on the controls) following a startle event (a stall on an instrument-landing approach), is reported in the literature (Spangler and Park, <xref ref-type="bibr" rid="B99">2010</xref>). These studies and reports have stimulated research on startle, surprise and stress.</p>
<p>In aviation, <bold>startle</bold> effect is defined as &#x0201C;an uncontrollable automatic muscle reflex, raised heart rate, blood pressure, etc., elicited by exposure to a sudden intense event that violates a pilot&#x00027;s expectations&#x0201D; [Federal Aviation Administration, <xref ref-type="bibr" rid="B37">2015</xref>]. Similar to the definition given by the FAA, according to International Air Transport Association (IATA, <xref ref-type="bibr" rid="B48">2018</xref>), startle is defined as &#x0201C;the initial short-term, involuntary physiological and cognitive reactions to an unexpected event that commence the normal human stress response&#x0201D;. The reflex motor response emanates from the brainstem (Groves et al., <xref ref-type="bibr" rid="B42">1974</xref>; Bisdorff et al., <xref ref-type="bibr" rid="B12">1994</xref>; Martin et al., <xref ref-type="bibr" rid="B71">2015</xref>). In fact, &#x0201C;stimuli that are received through any modality (visual, auditory or tactile), are routed very rapidly to the amygdala, which makes a rapid appraisal of potential threat. It in turn sends signals to the top of the brain stem, where the reticularis pontis caudalis initiates motor responses <italic>via</italic> motor neurons emanating from the pons&#x0201D; (Martin et al., <xref ref-type="bibr" rid="B71">2015</xref>, p. 98). In the presence of a threat, this first motor response is accompanied by an activation of a stress response within the autonomic nervous system (ANS), known as the &#x0201C;fight-or-flight&#x0201D; response. This physiological response is characterized by an increase in heart rate (HR), blood pressure (BP), and muscle contraction (Rivera et al., <xref ref-type="bibr" rid="B86">2014</xref>). The startle response includes startle reflex as well as emotional (fear) and cognitive responses (attention deployment, interruption of ongoing activity). The startle response can be enhanced in magnitude following an aversive event or in threatening situations: this type of reaction is referred to as fear-potentiated startle, which have a longer-lasting effect and cause a fully developed stress reaction (Davis, <xref ref-type="bibr" rid="B27">1993</xref>; Bradley et al., <xref ref-type="bibr" rid="B15">2005</xref>; Eysenck et al., <xref ref-type="bibr" rid="B35">2005</xref>; Martin et al., <xref ref-type="bibr" rid="B71">2015</xref>).</p>
<p>Differently, <bold>surprise</bold> is an emotional and cognitive response to unexpected events that are (momentarily) difficult to explain, that force a person to change his/her understanding of the situation (Landman et al., <xref ref-type="bibr" rid="B62">2017a</xref>). It could also involve higher level processes and activate frontoparietal cortical networks (Meindertsma et al., <xref ref-type="bibr" rid="B76">2018</xref>). Indeed, fMRI studies indicate that surprise, unlike startle, would involve mainly subcortical brain regions, including the amygdala and striatum, as well as some cortical regions, such as the ventromedial prefrontal cortex and the cingulate cortex (Behrens et al., <xref ref-type="bibr" rid="B10">2007</xref>; Bartra et al., <xref ref-type="bibr" rid="B9">2013</xref>). Moreover, in a situation of persistent threat, this reaction leads to physiological responses related to those of stress [increased hearth rate, blood pressure (B&#x000FC;rki-Cohen, <xref ref-type="bibr" rid="B18">2010</xref>; Rivera et al., <xref ref-type="bibr" rid="B86">2014</xref>)]. Surprise is the consequence of a mismatch between mental expectations and perceptions of environment (Horstmann, <xref ref-type="bibr" rid="B47">2006</xref>; Rivera et al., <xref ref-type="bibr" rid="B86">2014</xref>). This suggests that the presence as well as the absence of a stimulus can elicit surprise. It contrasts with the startle effect, which is triggered by a sudden highly intensive stimulus and cannot be triggered by the absence of such a stimulus.</p>
<p>When startle and/or surprise effects are considerably important and persistent, they can lead to acute stress. Selye (<xref ref-type="bibr" rid="B96">1956</xref>) defined stress as &#x0201C;a response to change in order to maintain the state of stability or homology that the body has maintained against the stimulus to break the mental and physical balance and stability of the body&#x0201D; (Kim H.-G. et al., <xref ref-type="bibr" rid="B54">2018</xref>). There are two kinds of stress: acute and chronic. Acute stress results from events involving novelty or a threat. The body reacts by releasing hormones that help to deal with the situation. Chronic stress results from repeated exposure to situations that lead to the release of stress hormones. There are close correspondences of ANS responses between acute and chronic stress, but also between an emotional reaction of surprise and the startle response, which is most often followed by an emotional response of fear (B&#x000FC;rki-Cohen, <xref ref-type="bibr" rid="B18">2010</xref>; Coon and Mitterer, <xref ref-type="bibr" rid="B24">2012</xref>). Many studies have been conducted to assess stress in pilots and/or in driving situations (Healey and Picard, <xref ref-type="bibr" rid="B44">2005</xref>; Dehais et al., <xref ref-type="bibr" rid="B29">2008</xref>; Tichon et al., <xref ref-type="bibr" rid="B106">2014</xref>; Dismukes et al., <xref ref-type="bibr" rid="B31">2015</xref> for review; Alberdi et al., <xref ref-type="bibr" rid="B4">2016</xref>). In their systematic review on acute physiological stress response to driving, Antoun et al. (<xref ref-type="bibr" rid="B5">2017</xref>) screened nearly 27,295 studies on the subject and selected 28 showing significant change in at least one physiological outcome.</p>
<p>However, not many studies compared to those on stress have specifically addressed the startle response and surprise effect in driving or flying situations (Thackray, <xref ref-type="bibr" rid="B103">1988</xref>; B&#x000FC;rki-Cohen, <xref ref-type="bibr" rid="B18">2010</xref>; Martin et al., <xref ref-type="bibr" rid="B70">2012</xref>, <xref ref-type="bibr" rid="B71">2015</xref>, <xref ref-type="bibr" rid="B72">2016</xref>; Casner et al., <xref ref-type="bibr" rid="B22">2013</xref>; Rivera et al., <xref ref-type="bibr" rid="B86">2014</xref>; Schroeder et al., <xref ref-type="bibr" rid="B90">2014</xref>; Ledegang and Groen, <xref ref-type="bibr" rid="B64">2015</xref>; Talone et al., <xref ref-type="bibr" rid="B101">2015</xref>; Landman et al., <xref ref-type="bibr" rid="B62">2017a</xref>,<xref ref-type="bibr" rid="B61">b</xref>, <xref ref-type="bibr" rid="B63">2018</xref>; Kinney and O&#x00027;Hare, <xref ref-type="bibr" rid="B56">2019</xref>; Xie et al., <xref ref-type="bibr" rid="B114">2022</xref>). While it is clear that these two factors play an important role in the reporting of incidents and accidents (Talone et al., <xref ref-type="bibr" rid="B101">2015</xref>), they are often used interchangeably in the aviation domain. More recently, Xie et al. (<xref ref-type="bibr" rid="B114">2022</xref>) suggested that startle and surprise place the pilot in a stressful state. These cognitive states (surprise, startle, stress) are intertwined and in the literature their definitions are similar and can be confounded.</p>
<p>For example, Rivera et al. (<xref ref-type="bibr" rid="B86">2014</xref>) definition of surprise &#x0201C;<italic>Surprise is a cognitive-emotional response to something unexpected, which results from a mismatch between one&#x00027;s mental expectations and perceptions of one&#x00027;s environment</italic>&#x0201D; can be confounded with Edwards and Cooper&#x00027;s (<xref ref-type="bibr" rid="B33">1988</xref>) definition of stress &#x0201C;<italic>stress as a negative discrepancy between an individual&#x00027;s perceived state and desired state, provided that the presence of this discrepancy is considered important by the individual</italic>&#x0201D;.</p>
<p>Results presented in the literature suggest that the startle response is strongly connected to the fight or flight response. Thus, Sehlstr&#x000F6;m et al. (<xref ref-type="bibr" rid="B94">2022</xref>) show that physiological stress followed startling stimuli and Xie et al. (<xref ref-type="bibr" rid="B114">2022</xref>) mention that sympathetic nervous system weakness following startle, which manifests as a cognitive effect (attention shift), is related to stress.</p>
<p>All these elements contribute to the complexity of distinguishing these different cognitive states and to the fact that for example the terms startle and surprise are used interchangeably in the literature.</p>
<p>From a neurophysiological point of view, it has been shown that the amygdala and brain stem are involved in the startle response as well as the activation of the &#x0201C;fight or flight&#x0201D; stress response system through the hypothalamic-pituitary-adrenocortical (HPA) axis of the sympathetic nervous system (Martin et al., <xref ref-type="bibr" rid="B71">2015</xref>). It should be noted that acute stress response or fight-flight response originates in the amygdala which sends a distress signal to the hypothalamus. It seems that startle and stress activate the same brain regions involved more generally in the response to threat. Concerning surprise, it has also been shown that the amygdala is involved in the response to a surprising event (Holand et al., <xref ref-type="bibr" rid="B45">1999</xref>; Kim et al., <xref ref-type="bibr" rid="B55">2017</xref>). Therefore, these three cognitive states are interconnected because they share a common brain structure or structures, which further contributes to the complexity of distinguishing them. It seems necessary to review their respective definitions, their differences and similarities and the methods used to study them in order to take them into account in their evaluation and the development of experimental protocols in the field of aviation. The presentation of the concepts is done in a distinct way in this paper in order to better highlight the differences but the reader is invited to take into account the fact that these concepts are interconnected and their distinction in real situation can be difficult.</p>
<p>The objective of this review is thus to better clarify the definitions of these concepts that are used and even manipulated interchangeably in the literature. From the theoretical model presented by the Landman et al. (<xref ref-type="bibr" rid="B62">2017a</xref>), it is shown the links and interconnections that these concepts share. This also participates in the complexity of distinguishing them and the ambiguity of what is actually manipulated in the studies present in the literature. Finally, emphasis is placed on the need to disentangle them as they are identified as key events in many aviation problems. And for this, the use of physiological parameters can be a real contribution to their studies and measurements. The contribution of this paper is to review the literature of experimental studies conducted on these concepts of startle, surprise, stress in aviation, to show their contributions and limits and the positive impact that the addition of physiological measures can have in their study in order to better distinguish them but also to reveal the links they maintain. This review is therefore structured along the following lines: (1) the methodology adopted by the review, (2) the definitions of startle, surprise, and stress as well as the difference between these cognitive states according to the conceptual model provided by Landman et al. (<xref ref-type="bibr" rid="B62">2017a</xref>) represented in Figures 2, 3 the studies that have been carried out. For each of the concepts studied (startle, surprise, stress), we also describe the physiological effects, the implications at the cognitive level, and finally suggest further investigations on some still open issues.</p>
</sec>
<sec sec-type="methods" id="s2">
<title>Methodology</title>
<p>The review begins by searching the relevant papers that investigate surprise, startle and stress in the context of aviation. For this the searching strings included the terms &#x0201C;startle surprise stress&#x0201D; combined (&#x0201C;AND&#x0201D;) with one or more of the terms &#x0201C;aviation, pilot, airplane, aircraft&#x0201D;. The search is repeated in the following academic databases: Pubmed, Google Scholar, PsycINFO, IEEE Xplore and Elsevier.</p>
<p>The initial search results are then refined by the title, abstract and the objective of the study. As a general inclusion criteria, research articles evaluating startle, surprise or stress in aviation context are included. Since reviews on stress in aviation context exist in the literature, the emphasis was put on studies evaluating startle and/or surprise as a priority since these are less numerous. The rationale for this is that these terms are used interchangeably in the literature, they interact with stress, and the interconnections between them need to be unraveled.</p>
</sec>
<sec id="s3">
<title>Startle effect</title>
<p>In the scientific literature, startle effect is defined as a brief, fast and highly physiological reaction to an unexpected, sudden, intense, or threatening stimulus such as a loud noise, or a sudden loss of balance (Thackray, <xref ref-type="bibr" rid="B103">1988</xref>; Rivera et al., <xref ref-type="bibr" rid="B86">2014</xref>; Martin et al., <xref ref-type="bibr" rid="B71">2015</xref>). Following a startle event, the measurable effects are eye blinks (eyelid-closure), increased physiological arousal, stopping movements (freezing and/or reduced motor activity, Plappert et al., <xref ref-type="bibr" rid="B83">1993</xref>), muscle tension (in particular contraction of the facial and neck muscles), and declarative reports of fear or anger (Landman et al., <xref ref-type="bibr" rid="B62">2017a</xref>). The physiological responses induced by the startle effect involve physiological elements of survival in the limbic part of the brain (amygdala) and trigger an activation of the sympathetic nervous system (SNS) by the secretion of adrenaline and cortisol (known as the body&#x00027;s stress hormones). This automatic behavior induces a cognitive deterioration, such as information processing impairment between 30 and 60 s after the event occurrence (startle refractory period) (Vlasak, <xref ref-type="bibr" rid="B109">1969</xref>; Woodhead, <xref ref-type="bibr" rid="B113">1969</xref>; Thackray and Touchstone, <xref ref-type="bibr" rid="B104">1970</xref>; Maslovat et al., <xref ref-type="bibr" rid="B73">2015</xref>). It was studied in aviation because many induced cognitive disturbances negatively influence decision-making and problem-solving abilities, thus potentially leading to tragic events. Following a startle stimulus, the startle reflex occurs very quickly, i.e., about 14 ms after the event (startle-induced reflex movement in facial muscles, Yeomans and Frankland, <xref ref-type="bibr" rid="B115">1995</xref>), and the performance at basic motor responses are disrupted for 3 s, up to 10 s for complex motor tasks (Rivera et al., <xref ref-type="bibr" rid="B86">2014</xref>).</p>
<p>Attentional resources orientation toward the startling stimulus is as well as cognitive response that, when exacerbated, can lead to decisional errors (Driskell and Salas, <xref ref-type="bibr" rid="B32">1996</xref>). Several studies have determined the neural networks involved (Davis, <xref ref-type="bibr" rid="B27">1993</xref>; Lindner et al., <xref ref-type="bibr" rid="B66">2015</xref>). Thus, the amygdala center of emotions appears crucial to the startle response. While a signal with some significance induces the startle reflex, the same signal is sent to the sensory cortex for cognitive processing. While the processing in the prefrontal cortex takes around 500 ms (&#x000C5;sli and Flaten, <xref ref-type="bibr" rid="B1">2012</xref>), the amygdala analysis is very fast, leading to a startle reflex response (<xref ref-type="fig" rid="F1">Figure 1</xref>). Cortical processing later returns to the amygdala to strengthen or modify salient information. This double treatment creates a gap between a spontaneous evaluation of the emotional valence of a stimulus by the amygdala and the cortical evaluation which can lead to a false alarm. When the threat persists, the startle moves from a simple reflex aversive movement to a startle or surprise reaction. This reaction leads to activation of the SNS and the endocrine system, and it is known as the &#x0201C;fight or flight&#x0201D; reaction. It affects also HR and BP by directing blood away from the extremities to the major muscle groups. This contributes for example to the state of confusion, delays in processing and/or attentional tunneling noted following a strong startle.</p>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p>Two-ways processing of sudden stimulus eliciting startle effect. From Martin et al. (<xref ref-type="bibr" rid="B70">2012</xref>) adapted from LeDoux (<xref ref-type="bibr" rid="B65">1996</xref>).</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fnrgo-04-1059476-g0001.tif"/>
</fig>
<p>The physiological response to a startle event is attributed to the sympathetic response triggered by the emotional center, the amygdala. The release of norepinephrine (noradrenaline) on beta-adrenergic receptors, located on the sinus node and the ventricles of the heart, causes an increase in HR. The SNS includes the trochlear, oculomotor, and abducens cranial nerves, which innervate the muscles responsible for oculomotor movements. Thus, an amplified sympathetic innervation causes an increase in muscle contraction measurable at the intensity and speed of oculomotor movements. It also controls mydriasis (pupil dilation) used to improve the field of vision in an emergency. Following a startle event (e.g., a loud noise, an uncommanded lurch of the aircraft), an individual undergoes physiological arousal, and experiences an emotional state akin to fear (Dismukes et al., <xref ref-type="bibr" rid="B31">2015</xref>). Thus, fear is a measurable aspect of startle. It should be noted that few aviation studies (Thackray, <xref ref-type="bibr" rid="B103">1988</xref>; Kinney and O&#x00027;Hare, <xref ref-type="bibr" rid="B56">2019</xref>) have used physiological measurements to study the startle effect.</p>
<p>To sum up, during a startle there are three processes that occur over time: first, the startle reflex, which is an aversive physical reaction, is initiated very rapidly; second, the fight-or-flight reaction prepares the body for action by raising HR (tachycardia), and BP and introducing hormones such as adrenaline into the bloodstream. Third, a general activation of the SNS occurs in a wide-ranging stress reaction. False alarm startles will fade very quickly as cortical processing of the startling stimulus identifies the lack of threat: extinction signals will quickly replace activating signals. However, when an authentic threat is identified, the stress response will continue to develop. Research on fear conditioning has shown that when startle or surprise occur in the presence of perceived threat, the response can be exacerbated, leading to what is known as fear-potentiated startle, also referred to as acute stress (Kinney and O&#x00027;Hare, <xref ref-type="bibr" rid="B56">2019</xref>).</p>
</sec>
<sec id="s4">
<title>Surprise</title>
<p>In addition to the startle effect, surprise is one of the factors that significantly contributes to inappropriate responses from the piloting team and to loss of control in flight (Horstmann, <xref ref-type="bibr" rid="B47">2006</xref>). Surprise is a cognitive-emotional response to unexpectedness resulting from a disparity between expectations and actual perceptions (Rivera et al., <xref ref-type="bibr" rid="B86">2014</xref>; Foster and Keane, <xref ref-type="bibr" rid="B40">2015</xref>). Surprise can occur in the absence of startle, for example, when an event is appraised as not threatening at first sight and which evolves slowly. While the startle effect is an uncontrollable automatic reflex (involving muscles, HR, and BP) that is elicited by exposure to a threatening event, surprise too can be a slow emotional and cognitive response that stimulates research and a change in understanding of the situation. Research in this field has been done mainly at the level of mental schema theory. Schema (Bartlett and Bartlett, <xref ref-type="bibr" rid="B8">1995</xref>) are knowledge structures stored in the long-term memory that represent &#x0201C;our&#x0201D; knowledge of the world and are used to recognize rapidly already known situations, but also to detect changing environment. Meyer et al. (<xref ref-type="bibr" rid="B77">1991</xref>) described surprise as a mismatch between activated schema and actual perception.</p>
<p>Surprise has a cognitive-emotional response to a stimulus similar to startle reaction, as for example fear and physiological responses such as increased HR and BP. Surprise cognitive responses include confusion, loss of situational awareness, interruption of ongoing task (freezing), inability to analyze and remember appropriate operating procedures (B&#x000FC;rki-Cohen, <xref ref-type="bibr" rid="B18">2010</xref>; Rivera et al., <xref ref-type="bibr" rid="B86">2014</xref>). Although surprise and startle cognitive states often take place together, they can also be experienced alone. Thus, the startle effect can occur without surprise, for example when the situation is anticipated, an individual is warned of the occurrence of a loud noise that does not prevent him from having a startle response (Ekman et al., <xref ref-type="bibr" rid="B34">1985</xref>). Similarly, surprise can happen without startle, for example in aviation when subtle technical failures of automation occur, generating surprises that are &#x0226A;confusing&#x0226B; and difficult to explain.</p>
<p>Studies have shown that surprise occurs quite frequently in aviation, but in most cases, it is inconsequential for the outcome of the flight (Kochan et al., <xref ref-type="bibr" rid="B59">2004</xref>). In extreme cases, surprise can impair the pilot troubleshooting capabilities.</p>
<p>The response time to a surprising event is longer than to a startle response. Indeed, the discrepancy between the current situation and the expected one forces to reassess the situation. The wider the discrepancy, the longer the time needed to reassess the situation. In addition, the surprise state lasts longer when the discrepancy requires an update of the surprised person&#x00027;s expectations (Horstmann, <xref ref-type="bibr" rid="B47">2006</xref>).</p>
<p>Surprise increases arousal and draws attention to the triggering event. It mobilizes the attentional system on the most salient information, which is not the most important in that moment. This condition can significantly affect decision-making, problem solving, and critical skills in handling complex emergency situations. This allocation of attention toward the cause is known in research on emotions. Indeed, it has been shown that emotions modulate our perception and attention; in fact, the amygdala is involved in the processing of emotional information and has a direct impact on sensory cortices by increasing the neural representation of an emotional stimulus (Vuilleumier et al., <xref ref-type="bibr" rid="B110">2004</xref>). However, it may also recruit fronto-parietal attention networks toward the location of the stimulus so that the information arriving at the same location as the emotional cues benefits from enhanced treatment resources (Brosch et al., <xref ref-type="bibr" rid="B16">2013</xref>). Studies using fMRI have shown that the amygdala is most likely to be active at surprising situations, which can induce the activity of SNS (Holland and Gallagher, <xref ref-type="bibr" rid="B46">2006</xref>; Kim et al., <xref ref-type="bibr" rid="B55">2017</xref>).</p>
<p>Brainstem involvement is also reported for surprise, in addition to cortical and subcortical involvement (amygdala). Indeed, surprise can transiently boost arousal state, increasing the organism&#x00027;s sensitivity (Dayan and Yu, <xref ref-type="bibr" rid="B28">2006</xref>) and suppresses ongoing beta-band oscillations within regions of prefrontal and parietal associative cortex (Meindertsma et al., <xref ref-type="bibr" rid="B76">2018</xref>). These results are in line with the ideas that beta-oscillations help maintaining the current sensorimotor or cognitive state (termed the &#x0201C;status quo&#x0201D;) or help activating the currently relevant task set. In both frameworks, the need for maintaining the current status quo, or task set, is low in the case of surprise (Meindertsma et al., <xref ref-type="bibr" rid="B76">2018</xref>). In addition, studies have shown an effect of surprise on the pupil dilation amplitudes which are closely linked to phasic responses in neuromodulatory brain systems, in particular the noradrenergic locus coeruleus (Kloosterman et al., <xref ref-type="bibr" rid="B58">2015</xref>).</p>
</sec>
<sec id="s5">
<title>Stress</title>
<p>Stress was defined as a maladaptive state in which SNS is overactivated, causing acute or chronic physical, psychological, and behavioral impairment (Campkin, <xref ref-type="bibr" rid="B19">2000</xref>). &#x0201C;Both startle and surprise may cause acute stress&#x0201D; (Landman et al., <xref ref-type="bibr" rid="B62">2017a</xref>, p. 1165). Startle may increase stress very briefly and rapidly at first, and subsequent appraisal of the startling stimulus as threatening may cause a further increase in stress. Surprise may also cause stress, as it may pose, on the one hand, an increase in task demands to solve the situation and, on the other hand, a perceived decrease of available resources when one becomes aware of the inadequateness of the active frame. The function of stress is to facilitate recruitment of additional resources to respond to the threat. In the aviation domain, number of studies have shown that aspects of stress such as impaired top-down and increased stimulus-driven attentional control, emotions of fear and frustration, excessive physiological arousal, or performance rigidity, may also impair a pilot&#x00027;s cognitive and motor performance (Dismukes et al., <xref ref-type="bibr" rid="B31">2015</xref>; Landman et al., <xref ref-type="bibr" rid="B62">2017a</xref>). It is therefore necessary to understand the impact of stress on cognition and performance, particularly in high-risk systems such as aviation, medicine, the military, etc., in which threats are widespread and can lead to devastating consequences.</p>
<p>In the literature, many studies have looked at pilot stress and mainly used HR, heart rate variability (HRV), and cortisol saliva as metrics. Indeed, the physiological, biochemical, endocrine, metabolic and immunological indicators change under stress. Faced with a stressful event, the first reacting system is the SNS that controls the functioning of organs such as the heart, the vessels, the lungs, the digestive system, and the secretion of catecholamines by the adrenal medulla (adrenaline and noradrenaline) which are sent to those organs in order to modify their functioning (Selye, <xref ref-type="bibr" rid="B95">1950</xref>). The secretion of catecholamines and the stimulation they generate within the organs as well as within the nervous centers provoke the following reactions: vasoconstriction of peripheral vessels to reserve blood flow to the main organs (heart, lungs, and brain); increased blood pressure and heart acceleration; acceleration of oxygen in organs and muscles; preferential muscles vascularization (Selye, <xref ref-type="bibr" rid="B95">1950</xref>; Dismukes et al., <xref ref-type="bibr" rid="B31">2015</xref>; Martin et al., <xref ref-type="bibr" rid="B71">2015</xref>). In the face of a stressor, the adaptive response of the body is extremely fast, organized by the sympathetic system and the medullo-adrenal gland under the control of the central nervous system. This is a general activation with emotional reaction (Gu et al., <xref ref-type="bibr" rid="B43">2019</xref>; Wang et al., <xref ref-type="bibr" rid="B111">2020</xref>).</p>
<p>Although several studies have been carried out to study stress in the literature, few studies have focused on distinguishing the physiological effects associated with the concepts of acute stress, startle effect, and surprise. More specifically, the startle effect was studied earlier in the 1970s to understand the consequences of a brutal (loud sound) shock on pilots (Thackray and Touchstone, <xref ref-type="bibr" rid="B104">1970</xref>); differently, the surprise effect was studied more recently in connection with the automation surprise and the occurrence of an unexpected event in the cockpit (Kochan et al., <xref ref-type="bibr" rid="B59">2004</xref>).</p>
<p>Landman et al. (<xref ref-type="bibr" rid="B62">2017a</xref>) recently proposed a conceptual model that brings together current knowledge about the startle effect, surprise and acute stress (<xref ref-type="fig" rid="F2">Figure 2</xref>).</p>
<fig id="F2" position="float">
<label>Figure 2</label>
<caption><p>Landman et al. (<xref ref-type="bibr" rid="B62">2017a</xref>) conceptual model of startle and surprise. Solid lines indicate sequenced events. Dashed lines indicate potential influences, with plus signs indicating an increasing effect and minus signs indicating an impairing effect. Double lines indicate thresholds.</p></caption>
<graphic mimetype="image" mime-subtype="tiff" xlink:href="fnrgo-04-1059476-g0002.tif"/>
</fig>
<p>The authors present their model as a synthesis of sensemaking theories (Klein et al., <xref ref-type="bibr" rid="B57">2007</xref>), cognitive models of surprise (Meyer et al., <xref ref-type="bibr" rid="B78">1997</xref>), perceptual cycle model (Neisser, <xref ref-type="bibr" rid="B80">1976</xref>) and literature on stress and the startle effect. In this model, the perceptual cycle is defined as the process by which a person perceives an external stimulus, interprets it (appraisal), assesses the situation, selects and executes actions. Appraisal can be fast and automatic but also slower and effortful. Decision making to action is a continuous process of hypotheses generation and test. In this model, the startle reaction results from a rapid and reflexive appraisal of a stimulus as threatening. When the threat is persistent, it can lead to stress increase. In the perceptual cycle, hypotheses based on the active frame are continuously tested and their consequences evaluated. The more the results are consistent with the hypotheses, the more the active frame is strengthened in memory. However, surprise is induced when there is a mismatch between the feedback and the active frame. Appraisal of surprising events is effortful and requires a reframing process that can lead to further increase of stress.</p>
<p>In this model, the startle reaction results from a rapid and reflexive appraisal of a stimulus as threatening. The left loop (<italic>startle response</italic>) is activated following a startle event without surprise. The appraisal of the situation and the response are extremely fast. Differently, when the appraisal of the startling situation highlights unexpected or incomprehensible information, the right loop (<italic>surprise response</italic>) is subsequently activated.</p>
<p>Surprise is described here as a mismatch between feedback from hypothesis testing of the active frame and their practical consequences (encountered data), given that the mismatch exceeds a certain threshold (double intersecting lines before surprise). Evaluation of a surprising event involves efforts (top-down or goal directed processing) to understand the cause of the mismatch between the data encountered and the active frame. It can be particularly problematic when pilots are not mentally prepared, for example after a long period of automatic flight (Young and Stanton, <xref ref-type="bibr" rid="B116">2002</xref>).</p>
<p>Stress can impair slow appraisal and reframing, as these are more top-down or goal-directed processes, for instance by determining an incorrect frame selection, confusion, or loss of situational awareness. The authors of the model report that &#x0201C;stress is thought to cause a shift from analytical skills toward intuitive judgment, making one susceptible to biases. And this bias may, for instance, cause the incorrect application of a partially fitting frame that is easily retrieved from memory due to recent experiences&#x0201D; (Landman et al., <xref ref-type="bibr" rid="B62">2017a</xref>, p. 1165). In fact, the adoption of an inappropriate frame or the loss of a fitting frame may lead to a complete &#x0201C;loss of grip&#x0201D; on the situation, because there is no longer a frame to guide perception and decision-making. This can negatively affect the pilot&#x00027;s ability to assess the situation and to make the right decisions, or lead to information overload (Landman et al., <xref ref-type="bibr" rid="B62">2017a</xref>). In fact, the data encountered can no longer be compared to past experiences and they no longer make sense. Selection and execution of actions in this case become reactive and sequential (bottom-up) instead of being proactive and anticipatory (top-down). This can lead to a tunnel vision effect or even to a cognitive lockup (Sheridan, <xref ref-type="bibr" rid="B98">1981</xref>; Landman et al., <xref ref-type="bibr" rid="B62">2017a</xref>).</p>
<p>This conceptual model allows to provide elements to the design of experimental protocols in simulations inducing surprise or startle effect. Therefore, to induce surprise, they recommend setting up a situation that mismatches with a previously activated frame. A mismatch not immediately understood will incite to reframe the situation. Thus, the surprise and the reframing process can be shown by presenting well-known situations to the pilot and one subtly different. In order to induce a startle effect, a startle stimulus must be highly salient, as for example a loud and abrupt sound, or a sudden uncommanded motion of the aircraft. The magnitude of the accompanying ANS response will vary depending on the level of perceived threat. Then, the autonomic reaction can be substantial, cascading into a full stress response. Moreover, the startle stimulus will not require reframing the situation.</p>
<p>However, there are two major differences between the startle effect and the surprise. The startle results in an acute accentuation of stress that can lead to cognitive impairment and to reduced motor performance (Martin et al., <xref ref-type="bibr" rid="B71">2015</xref>). Differently, surprise requires, before decision-making and action planning, an additional cognitive effort to reframe the situation and resolve the mismatch between current perception and previously activated patterns. This reframing process is effortful and vulnerable to the negative effects of stress that can potentially lead to confusion, inadequate frames adoption, and &#x0201C;loss of grip&#x0201D; on the situation (Landman et al., <xref ref-type="bibr" rid="B62">2017a</xref>).</p>
</sec>
<sec id="s6">
<title>State of the art on stress, startle and surprise experimental studies</title>
<p>While many studies have been carried out on stress in driving or flying situations (Kuroda et al., <xref ref-type="bibr" rid="B60">1976</xref>; Lindqvist et al., <xref ref-type="bibr" rid="B67">1983</xref>; Dehais et al., <xref ref-type="bibr" rid="B29">2008</xref>; Iizuka et al., <xref ref-type="bibr" rid="B49">2012</xref>; Regula et al., <xref ref-type="bibr" rid="B85">2014</xref>; Tichon et al., <xref ref-type="bibr" rid="B106">2014</xref>; Dismukes et al., <xref ref-type="bibr" rid="B31">2015</xref> for a review; Bruna et al., <xref ref-type="bibr" rid="B17">2018</xref>; Cao et al., <xref ref-type="bibr" rid="B20">2019</xref>; Shao et al., <xref ref-type="bibr" rid="B97">2019</xref>), only few studies [mainly reports: technical (Field et al., <xref ref-type="bibr" rid="B38">2015</xref>) and accident reports (Kochan et al., <xref ref-type="bibr" rid="B59">2004</xref>; Rivera et al., <xref ref-type="bibr" rid="B86">2014</xref>; Talone et al., <xref ref-type="bibr" rid="B101">2015</xref>)] focused specifically on startle effect and surprise. Especially as mentioned by Rivera et al. (<xref ref-type="bibr" rid="B86">2014</xref>) and Landman et al. (<xref ref-type="bibr" rid="B62">2017a</xref>) most of the time these cognitive states (surprise, startle) are used interchangeably in the literature and no clear distinction is made between them. This makes it difficult to characterize each of them as well as the techniques and measures to assess them. Moreover, reports do not always specify explicitly whether the manipulation induced startle, surprise, or both, at least until the contribution by Landman et al. (<xref ref-type="bibr" rid="B62">2017a</xref>). For this reason, this section reviews this literature to introduce the methodologies adopted in such studies, trying as much as possible to group the studies according to the concept studied.</p>
<sec>
<title>Startle</title>
<p>Startle has been shown to negatively impact response time to simple and complex tasks. In a laboratory experiment (outside the aviation context) Sternbach (<xref ref-type="bibr" rid="B100">1960</xref>) showed that motor performance, i.e., key presses, is affected following an unexpected startle event (loud sound). The author tested the hypothesis of physiological differences between people (undergraduate students) who recover quickly from startle effect vs. those who recover slowly. Physiological measurements (cf. <xref ref-type="supplementary-material" rid="SM1">Appendix A</xref> for a synthesis of effects) showed that the latter had a greater increase in systolic blood pressure, pulse pressure, palmar skin conductance, HR and decrease in finger pulse volume. No difference was found for EEG measurements at frontal, temporal, parietal and occipital level. Similarly, May and Rice (<xref ref-type="bibr" rid="B75">1971</xref>) showed impaired motor performance and increased response time following a loud pistol shot in students and secretaries in a laboratory study. Alterations to simple reaction (1&#x02013;3 s) and to information processing (30&#x02013;60 s) after a startle stimulus have also been reported (Thackray, <xref ref-type="bibr" rid="B102">1965</xref>; Thackray and Touchstone, <xref ref-type="bibr" rid="B105">1983</xref>). Indeed, the authors compared the recovery performance following an auditory startling vs. non-startling event in simulated air traffic radar control. They note that their high intensity noise stimulus was manifestly startling while the lower intensity elicited only surprise reaction measured through physiological measures of HR, skin conductance, and video recording of the face. The results indicate longer response times and increased HR for the startled group. The participants in this group also made more errors in serial reaction time task. The authors note that recovery time for perceptual motor responses following an emergency shock takes 1&#x02013;3 s, depending on whether the emergency was startling and emotionally arousing or only surprising and unexpected. If the shock causes emotional (and physiological) arousal as in a startle, then the information processing capacities can be altered for 30&#x02013;60 s and lead to increased incorrect responses (Thackray, <xref ref-type="bibr" rid="B103">1988</xref>). These studies suggest that the physiological reactions following a startle event are comparable to those following a surprising event, although of higher intensity for startle effect. These results support those of Vlasak (<xref ref-type="bibr" rid="B109">1969</xref>) and Woodhead (<xref ref-type="bibr" rid="B113">1969</xref>). The former showed impaired participant performances on continuous mental subtraction during the first 30 s following a startle stimulation (unexpected 100-db sound). The latter showed impaired performances on a continuous symbol-matching task lasting from 17 to 31 s after startle induced by a loud reproduced sonic bang in a laboratory context and with one hundred and eight Royal Naval ratings, which have acted as subjects. Startle effect has also a negative impact on ongoing cortical processes during go/no-go task (to press or not a button, depending on display color) in a laboratory experiment, with participants making more errors in startle vs. non-startle trials (Carlsen et al., <xref ref-type="bibr" rid="B21">2008</xref>).</p>
<p>In aviation context, the results obtained previously in the laboratory are verified or amplified by the context. B&#x000FC;rki-Cohen (<xref ref-type="bibr" rid="B18">2010</xref>) defined startle as the ultimate surprising event with instant and uncontrollable motor responses, without distinguishing it from surprise as in the Landman model, in which the two responses might occur independently, with startle effect involving unexpectedness and intense stimulation, and surprise elicited by the presence or absence of an (un)expected event. B&#x000FC;rki-Cohen (<xref ref-type="bibr" rid="B18">2010</xref>) showed the interconnection between these two notions and mentions that depending on the pilot&#x00027;s anticipation, the same event can trigger either a surprise reaction or a startle, knowing that the latter is most often triggered by a unexpected event involving intense stimulation (e.g., compressor stalls, tire bursts, bird strikes, intense wakes). Moreover, it has been reported that the deterioration in pilot performance (cognitive impairment) is linked to the development of fear potentiated startle in response to an abnormal event (Rivera et al., <xref ref-type="bibr" rid="B86">2014</xref>; Martin et al., <xref ref-type="bibr" rid="B71">2015</xref>).</p>
<p>Few researches evaluated experimentally the impact of surprise and startle on pilot performance. Martin et al. (<xref ref-type="bibr" rid="B72">2016</xref>) designed an experiment to study the effects of a startle stimulus on pilot performance during abnormal events. This study is one of the few empirical studies explicitly studying the startle effect in pilots. Thus, they tested 18 pilots in a simulated flight involving two hand-flown instrument landing system approaches where the weather was such that a missed approach would have been required upon reaching the decision altitude. Startling stimulus was presented to the pilot through a cargo fire warning bell followed by a loud bang on the first approach. Following this, pilots were vectored for a second approach without startling stimulus. They were required to commence a standard missed approach when they failed to become visual at the minimum altitude. Height losses of second and first missed approach (i.e., following startle) were compared. The results indicate a deterioration of the performance for one third of the pilots following a startle, manifested by a delay in commencing the missed approach, or even some pilots continuing on an unstable approach up to affecting the safety of the flight. They also show interindividual differences in the startle response, some pilots more affected taking more time to recover compared to others less affected who recover quickly. No physiological measures are used to quantify the pilot&#x00027;s reaction as in previous studies evaluating the startle (Thackray, <xref ref-type="bibr" rid="B103">1988</xref>; Martin et al., <xref ref-type="bibr" rid="B70">2012</xref>, <xref ref-type="bibr" rid="B71">2015</xref>; Rivera et al., <xref ref-type="bibr" rid="B86">2014</xref>).</p>
<p>As suggested in the literature, it is highly recommended to measure physiological and subjective responses in order to account for the strength of a stressor (Bourne and Yaroush, <xref ref-type="bibr" rid="B14">2003</xref>). Recently, Kinney and O&#x00027;Hare (<xref ref-type="bibr" rid="B56">2019</xref>) extend Casner&#x00027;s studies and test the hypothesis that the startle effect can occur due to unexpectedness, without having to distract or cause a loud noise; they found that the startle response to the unexpected flight events (engine failure) contributes to the degradation of pilot performance. To this end, the authors use two physiological measures indicative of the startle response: HR and pupil diameter (PD). Twenty-two pilots faced a simulated expected or unexpected abnormal flight event (engine failure). In addition to physiological data, flight data (altitude, airspeed) and task performance were compared between these conditions. The results indicate that compared to an expected situation, pilots have a higher HR and increased PD when unexpected engine failure occurs. In terms of performance, 54.5% of pilots in the unexpected engine failure (with no forewarning) condition landed safely and 45.5% either crashed or attempted a water landing while no pilot had crashed in the expected condition. Authors also noted a reduction in instrument scan following an unexpected engine failure. These results are in line with previous studies showing the impact of an unexpected inflight event on performance and information processing (attention tunneling). It is noted that both experimental conditions lead to ANS arousal, more evident in the unexpected condition. If compared to other studies on the startle effect, the response to unexpected engine failure resulted in a similar arousal increase. Thus, it is possible to trigger a physiological response analogous to startle without any distracting or intrusive stimuli, by setting up unexpected events close to real life. According to Landman&#x00027;s model, it would appear that the unexpected condition was more startling due to the intensity or perceived threat.</p>
<p>The results of this study provide information on the usefulness of combining physiological and subjective measurements in order to verify the effects of the experimental manipulation on the subjects&#x00027; responses. Comparison between expected, unexpected, and baseline flight showed that pilots&#x00027; HR and pupil dilation were significantly different between the unexpected and expected engine failure conditions. Moreover, they were higher in the expected engine failure vs. baseline flight condition. This result confirms previous studies on the effects of surprise and startle. The surprise and startle reactions trigger similar physiological responses, but at different proportions, i.e., more sustained following a startling stimulus. Thus, HR and pupil dilation, which are widely used to measure acute stress, seem to be reliable indicators for future research on startle and surprise. Previous research on the effect of a startle response on HR indicates an increase from 7.5 to 15 bpm following a loud noise (Holand et al., <xref ref-type="bibr" rid="B45">1999</xref>; Deuter et al., <xref ref-type="bibr" rid="B30">2012</xref>; Chou et al., <xref ref-type="bibr" rid="B23">2014</xref>). Kinney and O&#x00027;Hare (<xref ref-type="bibr" rid="B56">2019</xref>) indicate an increase of 9.01 bpm following an unexpected engine failure.</p>
<p>More recently, a study by Xie et al. (<xref ref-type="bibr" rid="B114">2022</xref>) evaluated the effects of an abnormal flight environment (turbulence, startle, and surprise) using touch-based navigation displays (TNDs). They used Fitts&#x00027; law, a predictive model used in human-computer interaction and ergonomics (Fitts, <xref ref-type="bibr" rid="B39">1954</xref>), to compare the performance of TNDs with control display units (CDUs) and mode control panels (MCPs) under different flight scenarios (normal vs. abnormal). The authors suggested that startle and surprise can place the pilot in a stressful state. They noted that the startle had an influence on pilots&#x00027; behavior by making them forget what to do. They simulated startle and surprise in their experience with failure scenarios (engine fire alarm) of the aviation system. Thus, they showed in their experiment that when excited by a startling and surprising scenario pilots are in a state of stress and prone to event interruption and the reaction time increased (Xie et al., <xref ref-type="bibr" rid="B114">2022</xref>). They found that under normal flight conditions touchscreen interactive device show high accuracy and a short operation time. But under abnormal conditions, TNDs showed operation performance and stability worse than control CDUs and MCPs. In addition, under these conditions the pilots have less confidence in the touchscreen device. This study has the merit of distinguishing the notions of startle and surprise according to the theoretical framework of Landman et al. (<xref ref-type="bibr" rid="B62">2017a</xref>). However, the objective of this study was not to study the differences and/or interaction between these concepts, so the authors manipulated the two notions of startle and surprise together and not in a unitary way. An experimental setup manipulating, in addition, each of these notions could contribute further to a better understanding of the interaction and links between these mental states and stress. Nevertheless, as already mentioned, a link is made here between the surprise and the startle, which causes pilot stress. Performance and subjective measures are used in this study.</p>
<p>Rooseleer et al. (<xref ref-type="bibr" rid="B87">2022a</xref>) used neurophysiological measures coupled with subjective measures to measure pilot performance in severe wake turbulence events, which can induce the startle effect. The authors acknowledge that startle and surprise can have adverse consequences on pilot performance (inappropriate reaction, freezing, over reaction), and flight safety. Pilots are exposed to strong simulated wake vortex, with (wake imminent &#x0003C;1 mn &#x00026; wake expected in 3 mn) or without prior ATC (Air Traffic Control) wake alert. The objective measures used by the authors are EDA, EEG &#x00026; eyetracking data in order to measure pilot mental stress, workload and arousal and thus evaluate the impact of the wake vortex alert. The objective of this alert system is to reduce the startle effect that pilots may experience in case of aircraft upset induced by wake turbulence encounters. The authors state that the combination of psychophysiological measurements, expert observations and subjective feedback make it possible to better account for the performance of pilots with or without ATC wake alert as well as the potential advantages in terms of safety (reduction startle effect and potential loss of control Rooseleer et al., <xref ref-type="bibr" rid="B88">2022b</xref>). And preliminary results show that the combination of subjective and objective measures make it possible to account for the effectiveness of the alert system &#x0201C;to prevent flight crew from startle response, smooth their workload and raised their situation awareness during the event&#x0201D; (Rooseleer et al., <xref ref-type="bibr" rid="B88">2022b</xref>, p. 3149). It should be noted that the authors in order to study the startle effect used neurophysiological measures: EDA to evaluate the startle effect and EEG for stress as well as ocular data coupled with subjective measures.</p>
<p>In summary, the results from the literature have shown that the startle is physiologically measurable and is manifested by increase in blood pressure and heart rate (Rivera et al., <xref ref-type="bibr" rid="B86">2014</xref>), eye blinks and pupil diameter modification, contraction of facial and neck muscles (Landman et al., <xref ref-type="bibr" rid="B62">2017a</xref>; Kinney and O&#x00027;Hare, <xref ref-type="bibr" rid="B56">2019</xref>).</p>
</sec>
<sec>
<title>Surprise</title>
<p>Beringer and Howard (1999) assess pilot responses to automation malfunctions and show maladaptive responses and longer reaction time response to situations that can lead to altitude loss or pilot disorientation. Casner et al. (<xref ref-type="bibr" rid="B22">2013</xref>) test eighteen pilots on three abnormal events: aerodynamic stall, low-level wind shear, and engine failure on take-off. This study, similar to that of Beringer and Howard (<xref ref-type="bibr" rid="B11">1999</xref>), evaluated pilot performance using response times, altitude loss, errors, pitch attitude, percentage of successful recoveries, and detection/correction times. No physiological measurements were used. The results indicate that response times are longer after a surprising event compared to a non-surprising event, and that correct performance of the procedures is impaired. Since unexpected events have been shown to generate startle effect (Ziperman and Smith, <xref ref-type="bibr" rid="B117">1975</xref>; Kinney and O&#x00027;Hare, <xref ref-type="bibr" rid="B56">2019</xref>), the results of Casner et al. (<xref ref-type="bibr" rid="B22">2013</xref>) in terms of pilot performance impairment could be attributed to the effects of surprise and/or startle effect.</p>
<p>Schroeder et al. (<xref ref-type="bibr" rid="B90">2014</xref>) tested pilots on two stall maneuvers (high altitude vs. low altitude). In addition to the expert pilot rating, other performance measures based on flight data were used by the authors: maximum roll angle, altitude loss in the recovery, recovery time. Similar to the aforementioned studies, no physiological measurements were used in this study. A limitation that can be put in evidence in such a study is the absence of a control group to attribute the decline in performance to surprise. The authors conclude that the occurrence of an unexpected abnormal event in flight impairs pilot&#x00027;s response. Ledegang and Groen (<xref ref-type="bibr" rid="B64">2015</xref>) extend the previous results and observe that pilots are struggling in recovering from aerodynamic stalls when they have not reviewed the recovery procedures beforehand. In this study, the authors use flight parameters (time, altitude, angles control inputs, etc.) and subjective ratings as dependent variables. It is worth noting that no physiological measurement is used to assess the pilot&#x00027;s reaction to surprise.</p>
<p>Landman et al. (<xref ref-type="bibr" rid="B61">2017b</xref>) set up a study in a simulated environment in order to report specifically the impact of surprise on pilot performance. To overcome the limits of previous surprise studies, authors include a control condition (Schroeder et al., <xref ref-type="bibr" rid="B90">2014</xref>) and a manipulation check (Casner et al., <xref ref-type="bibr" rid="B22">2013</xref>). In addition to flight data and subjective ratings for surprise and startle, physiological measures are used to check the surprise manipulation. Recovery performance of twenty airlines pilots is tested in an expected (anticipated) and unexpected (surprise) stall event. In the last condition, experimenters adopt measures to mislead and distract the pilots into activating a cognitive frame that mismatches with the stall event. They were asked to pay attention to pitch because a spatial disorientation was possible and their attention was moved from the displays before the initiation of the event by asking them to give a rating on a sickness scale. The results indicate that only 75% of the pilots successfully adhere to standard recovery procedure in the surprise condition. Surprise negatively affected cognitive ability to manage an upset situation. Subjective and physiological measurements (HR, as well as Galvanic Skin Response, GSR) indicate that experience induces a greater proportion of surprise than of startle. These results are in line with the authors&#x00027; model (Landman et al., <xref ref-type="bibr" rid="B62">2017a</xref>), so it can be postulated that recovery was mentally more demanding in resources in a situation of surprise as compared to the anticipated situation, due to reframing process. As for subjective evaluation of surprise, startle, and mental load, significant differences between the two conditions were found for all of the three variables. Finally, as for physiological measurements, only galvanic skin response showed significant differences. However, a limit can be addressed to Landman et al. (<xref ref-type="bibr" rid="B61">2017b</xref>) study. Since studies have shown that distraction causes deterioration in flight performance (Barnes and Monan, <xref ref-type="bibr" rid="B7">1990</xref>; Airbus, <xref ref-type="bibr" rid="B3">2004</xref>; B&#x000FC;rki-Cohen, <xref ref-type="bibr" rid="B18">2010</xref>), the performance impairment noted may be due either to surprise or to distraction. Nevertheless, this study fills the glaring lack of empirical research within aviation using physiological measurement.</p>
<p>In the above studies, the authors evaluated the subjective rating to the surprise and to the startle, although the surprise effect was manipulated in the first place. Their results suggest that the surprising upset event induced by their scenario was startling (Landman et al., <xref ref-type="bibr" rid="B61">2017b</xref>). It is postulated that unexpectedness can trigger a startle response without the presence of intense stimulation. Indeed, it has been shown that unexpectedness can trigger surprise reaction (Rivera et al., <xref ref-type="bibr" rid="B86">2014</xref>) and startle effect (Ziperman and Smith, <xref ref-type="bibr" rid="B117">1975</xref>). However, there is a lack of physiological evidence to support those effects of startle and surprise in aviation.</p>
<p>The use of HR and GSR to evaluate the surprise effect by Landman et al. (<xref ref-type="bibr" rid="B61">2017b</xref>) also seem to be a good complement to subjective measurements. In their study, only the pilots&#x00027; GSR response is significantly different between an expected (anticipated) vs. unexpected (surprise) stall events. The difference in HR, although not significant, shows an increase of 14 bpm for these two conditions compared to baseline. Indeed, pilot levels of perceived startle and surprise were collected on 11-points Likert-type scales and their ratings are significantly higher in the unexpected condition as compared to the expected condition. It is important to note that, in real-life situations, abnormal flight events likely induce startle and surprise, and therefore these factors are confounded in the pilot&#x00027;s stress reactions.</p>
<p>In summary, the results from the literature show that surprise can be studied physiologically and also manifests itself as for the startle by increased heart rate, increased blood pressure (Rivera et al., <xref ref-type="bibr" rid="B86">2014</xref>) and finally increased galvanic skin response (Landman et al., <xref ref-type="bibr" rid="B61">2017b</xref>).</p>
</sec>
<sec>
<title>Stress</title>
<p>B&#x000FC;rki-Cohen (<xref ref-type="bibr" rid="B18">2010</xref>) notes that stress, surprise and startle are among the psychological factors involved in several accidents following a loss of control. As said above about the reactions to startle and surprise, the physiological and cognitive responses to surprise and stress are similar, although with different proportions. These reactions include increased HR, respiratory rates, BP, stress hormone secretion, sweating, change in GSR and narrowing of peripheral vision by pupil dilation (B&#x000FC;rki-Cohen, <xref ref-type="bibr" rid="B18">2010</xref>). This author also notes that stress causes a loss of situation awareness and an oversight of adequate standard operating procedures applicable to the situation. Behaviorally, this can lead to a delay or absence of response (&#x0201C;freezing&#x0201D;).</p>
<p>As outlined in Landman conceptual model and recently by Xie et al. (<xref ref-type="bibr" rid="B114">2022</xref>), startle and surprise can both place the pilot in a stressful state. Thus, it is plausible to think that these two elements occur concurrently in real situations.</p>
<p>In fact, following startle, fight-or-flight reaction develops and SNS activates to prepare the body to react, i.e., both startle and surprise reactions cause acute stress, whose main role is to respond to emotional stressors which can disrupt the homeostatic balance. The typical response of SNS to a stressor is manifested by increased respiratory rate, heartbeat, blood flow to organs and release of catecholamines. These physiological changes are captured in research studies through various methods that can be used in the context of aviation in order to better account for and differentiate the concepts of surprise and startle, depending on the activation or inhibition of one of these indicators. In addition to these physiological measurements, there are measurements of brain activity. Indeed, studies have shown that the analysis of brain activity (e.g., EEG) makes it possible to account for the pilot&#x00027;s state of stress, so such measurements seem suitable (Fabre et al., <xref ref-type="bibr" rid="B36">2021</xref>; Rooseleer et al., <xref ref-type="bibr" rid="B87">2022a</xref>,<xref ref-type="bibr" rid="B88">b</xref>; Sciaraffa et al., <xref ref-type="bibr" rid="B93">2022</xref>) for a better assessment of these in-flight cognitive states.</p>
<p>In summary, in order to account for the stress, startle and surprise effect in aviation, physiological measures (HR, EDA, oculomotor measures, muscle contraction, brain activity) can be proper measures to be coupled with subjective measures during experiments.</p>
</sec>
</sec>
<sec id="s7">
<title>Discussion and conclusion</title>
<p>The objective of the present paper was to review the definitions of stress, startle and surprise, the methods used to measure them. It stresses the real need to study the differences and interconnections that these concepts may have. As well as the fact that the analysis of physiological responses can contribute to disentangling differences between these cognitive states.</p>
<p>In aviation, few empirical studies have focused on the startle and surprise effect. Very few of them distinguish these two concepts, whereas the majority use them interchangeably. Nevertheless, accident reviews indicate a high proportion of causes related to surprise but also to performance following a startling stimulus.</p>
<p>In the literature, surprise most often refers to a cognitive-emotional response following an unexpected event, while the startle refers to an involuntary reflex following a sudden intense stimulation. Landman et al. (<xref ref-type="bibr" rid="B62">2017a</xref>) propose a conceptual model to distinguish the cognitive states of surprise, startle, and stress: the model indicates that they can occur independently as well as simultaneously. Based on both data from the literature and Landman&#x00027;s conceptual model, it appears that we could assess these cognitive states through the use of physiological measures, in addition to subjective measures.</p>
<p>Landman et al. (<xref ref-type="bibr" rid="B61">2017b</xref>) study showed that when surprise is manipulated in an experiment through an unexpected event, participants experienced a startling effect. And recently, Kinney and O&#x00027;Hare (<xref ref-type="bibr" rid="B56">2019</xref>) showed that in order to trigger a physiological reaction similar to a startle effect, there is no need for a loud external stimulus, an unexpected threatening event might be enough. These results indicate the close links between these concepts. Biologically, the amygdala seems to be the most important hub that manages these two types of reactions. Neuroimaging studies have shown that surprise and fear emotions, noted following a startle, activate similar brain loci, such as amygdala and some studies suggest that surprise and fear might be the same basic emotions (Jack et al., <xref ref-type="bibr" rid="B50">2014</xref>). Additionally, it has been proposed that surprise transiently boosts the central arousal state, mediated by phasic responses in brainstem neuromodulatory systems (such as the locus coeruleus noradrenaline system) (Dayan and Yu, <xref ref-type="bibr" rid="B28">2006</xref>). Among the neurophysiological markers of locus coeruleus activity, studies have shown an increased pupil dilation (Rajkowski, <xref ref-type="bibr" rid="B84">1993</xref>; Critchley et al., <xref ref-type="bibr" rid="B25">2005</xref>), a greater P3 component of event-related potentials (Nieuwenhuis et al., <xref ref-type="bibr" rid="B81">2005</xref>), and accompany salient action outcomes, such as errors. The involvement of locus coeruleus is reported when we are suddenly startled, or when we experience a stressful situation (Schwarz and Luo, <xref ref-type="bibr" rid="B92">2015</xref>). It is also reported a relationship between an increased function of locus coeruleus and sympathetic activation; the greater the activation, the greater the correlation (Vermetten et al., <xref ref-type="bibr" rid="B108">2002</xref>). Indeed, the norepinephrine from the locus coeruleus has an excitatory effect on most of the brain, mediating arousal and priming the brain&#x00027;s neurons to be activated by stimuli. It has also been reported that norepinephrine is the substrate for emotions that triggers &#x0201C;fight or flight&#x0201D; or acute stress response such as fear, and a monoamine model of basic emotions have been proposed (Wang et al., <xref ref-type="bibr" rid="B111">2020</xref>). Furthermore, electrophysiological and neurochemical data have shown that brain norepinephrine system is activated by surprise/unexpected events (Ma and Morilak, <xref ref-type="bibr" rid="B69">2005</xref>; Morilak et al., <xref ref-type="bibr" rid="B79">2005</xref>; Bott-Fl&#x000FC;gel et al., <xref ref-type="bibr" rid="B13">2011</xref>).</p>
<p>Coon and Mitterer (<xref ref-type="bibr" rid="B24">2012</xref>) considers surprise as a transient emotional state resulting from an unexpected event and which may have a different intensity (neutral, moderate, intense). Therefore, it is considered in some studies that experience with a surprising event commonly induces a startle response (Jang et al., <xref ref-type="bibr" rid="B51">2015</xref>). Acute stress response or fight-flight response originates from the amygdala which sends a distress signal to the hypothalamus. Startle, surprise and acute stress are interconnected because they could share common brain structure or structures, which further contributes to the complexity of distinguishing them. Further studies will be needed to better identify measurable neurophysiological markers that could distinguish them.</p>
<p>In the model from Landman et al. (<xref ref-type="bibr" rid="B62">2017a</xref>), it can be noted that a startle reaction can be triggered by a stimulus according to its intensity or the perceived threat. Thus, an unexpected event could trigger either a surprise reaction or a startle response, depending on the intensity of the threat that it reflects for the subject. As a consequence, individual differences exist in relation to the reactions and the recovery following a startling, with some less affected and recovering faster than others (Sternbach, <xref ref-type="bibr" rid="B100">1960</xref>; Martin et al., <xref ref-type="bibr" rid="B72">2016</xref>).</p>
<p>Depending on the strength of the threatening stimulus, the physiological response to a startling and/or surprising event is similar to a stress response and measurable. Indeed, it has been shown that a persisting startle stimulus causes increase in HR and BP (Rivera et al., <xref ref-type="bibr" rid="B86">2014</xref>), in addition to a motor response (muscle contraction). A startling event may also impact the respiration rate of pilots, although more evidence remains to be provided (Agha, <xref ref-type="bibr" rid="B2">2020</xref>). In fact, there is evidence in the literature of startle modulation by respiration (Schulz et al., <xref ref-type="bibr" rid="B91">2016</xref>). Bruna et al. (<xref ref-type="bibr" rid="B17">2018</xref>) showed an increase in the respiratory rate in pilots facing an unexpected engine failure during a simulated flight. Kinney and O&#x00027;Hare (<xref ref-type="bibr" rid="B56">2019</xref>) suggested that an unexpected event can trigger a physiological response analogous to startle. Indeed, they showed that an unexpected engine failure changes PD and HR.</p>
<p>Surprise has also been shown to impact the physiological system measurable through an increase in HR and respiratory rate, GSR, PD (Landman et al., <xref ref-type="bibr" rid="B61">2017b</xref>; Ruscio et al., <xref ref-type="bibr" rid="B89">2017</xref>; Bruna et al., <xref ref-type="bibr" rid="B17">2018</xref>; Kinney and O&#x00027;Hare, <xref ref-type="bibr" rid="B56">2019</xref>; Agha, <xref ref-type="bibr" rid="B2">2020</xref>). Indeed, a persistence of the surprising/unexpected situation also increases stress.</p>
<p>Studies on stress have shown that it elicits several physiological responses: increased HR, respiratory rate, BP, muscle contraction, PD, ST, GSR, secretion of stress hormones (cortisol) (Lundberg et al., <xref ref-type="bibr" rid="B68">2002</xref>; Healey and Picard, <xref ref-type="bibr" rid="B44">2005</xref>; Otsuka et al., <xref ref-type="bibr" rid="B82">2006</xref>; Kaklauskas et al., <xref ref-type="bibr" rid="B52">2011</xref>; Dismukes et al., <xref ref-type="bibr" rid="B31">2015</xref>) and brain responses (Alberdi et al., <xref ref-type="bibr" rid="B4">2016</xref>; Kim H.-G. et al., <xref ref-type="bibr" rid="B54">2018</xref>; Katmah et al., <xref ref-type="bibr" rid="B53">2021</xref> for a review).</p>
<p>Effects at the behavioral and cognitive level add to these physiological impacts. In fact, the startle reaction induces information processing impairment between 30 and 60 s (Vlasak, <xref ref-type="bibr" rid="B109">1969</xref>; Woodhead, <xref ref-type="bibr" rid="B113">1969</xref>; Thackray and Touchstone, <xref ref-type="bibr" rid="B104">1970</xref>) which manifests behaviorally by a delay or absence of response (&#x0201C;freezing&#x0201D;), potentially leading to a deterioration of decision-making and problem-solving skills. A similar impairment of decision-making and problem-solving skills might also occur following a surprising event, since the attentional system is primarily mobilized on the most salient event, which often is not the most important information at that moment.</p>
<p>Finally, stress also impairs top-down cognitive functions and increases stimulus-driven attentional control. Indeed, Dismukes et al. (<xref ref-type="bibr" rid="B31">2015</xref>) noted that under stress, people are less able to manage their attention effectively, as they are more distracted from their task by the salience of the stimuli (alarm, threatening aspect). Therefore, they may process information less exhaustively, and they may have difficulty switching their attention among multiple tasks, thus resulting in chaotic situation management. In addition, individuals might have difficulty in making sense of the situation and in updating its mental model, thus making more errors. This is due to the fact that stressful/anxious thoughts tend to preempt working memory&#x00027;s limited storage capacity. Following a highly surprising/startling event, attention tunneling is another potential consequence of the experienced psychological stress. Importantly, stress influences attention as well as emotion. Indeed, it is typical to have psychological ratings that indicate a negatively valenced emotional stress response such as increased ratings of anxiety, irritability and loss of control. It is recognized that negative emotions such as fear and anxiety are cognitive stressors which have been shown to degrade decision making and situation awareness (Tichon et al., <xref ref-type="bibr" rid="B106">2014</xref>). Indeed, the work of Weigmann and Shappell (<xref ref-type="bibr" rid="B112">1997</xref>) showed the impact of negative affects in many flight accidents, and Gluck and Gunzelmann (<xref ref-type="bibr" rid="B41">2013</xref>) underlined the important role of emotions in influencing cognitive processing and performance. Damasio (<xref ref-type="bibr" rid="B26">1995</xref>) also demonstrated the interdependent links between emotions and skills. Tichon et al. (<xref ref-type="bibr" rid="B106">2014</xref>) reported that emotions prepare us to respond to trigger stimuli by coordinating a system for responses. Thus, anger prepares the body to fight, and fear prepares it for flight (Matsumoto and Wilson, <xref ref-type="bibr" rid="B74">2008</xref>).</p>
<p>In summary, the behavioral and cognitive consequences of stress, startle and surprise might be very similar. Therefore, measuring physiological metrics (besides subjective data) would help to quantify the proportion of physiological reaction to a certain event, thus enabling understanding the level of its impact (in terms of level and duration) on operational performance. It is important to conduct further research on these different concepts while controlling the confounding variables in order to better distinguish them. Because most studies in the field use the concepts of startle/surprise interchangeably. In order to account for the manipulations of each of these concepts and to better define the factors manipulated in the studies, it would be appropriate to add physiological and subjective data in order to better account for the state of an individual in a given experimental situation. The comparison of metrics such as HR, PD, GSR, could be used to account for the intensity of the stimuli and whether they were surprising or startling (or both) for the individual. Subjective measurements of related concepts like workload and stress should be used, in order to support conclusions made in relation to physiological data. Indeed, Tyler and Cushway (<xref ref-type="bibr" rid="B107">1995</xref>) have established that there is a significant and positive relation between stress level and workload.</p>
<p>More specifically, concerning the startle measurement, physiological measures such as the HR, HRV, change in GSR, in muscle contraction and in PD have been shown as effective, in addition to the traditional measures of reaction time and task performance. Other measures such as facial expressions are quite effective as it has been suggested that fear is a measurable aspect of startle (Dismukes et al., <xref ref-type="bibr" rid="B31">2015</xref>). The optical system technique developed to remotely measure acoustic startle reflex (ASR) in humans also seems to be a promising technique (Balogiannis et al., <xref ref-type="bibr" rid="B6">2020</xref>). Regarding surprise, evidence has been shown regarding the use of heart and respiratory rate, GSR, and pupil dilation. Time- and frequency-domain features of HRV and respiration appear to be additional measures. Similarly, Bruna et al. (<xref ref-type="bibr" rid="B17">2018</xref>) used respiration to assess stress. Moreover, various metrics have been shown to be valid for stress measurement: HR, HRV, EMG features (RMS), PD, Blink rate, change in GSR, hormonal secretion measurement (cortisol), BP, ST.</p>
<p>The results of the studies on startle effect and surprise stress the need to train pilots to unexpected events in order to better prepare them to react appropriately to real life unexpected events. Training to variable unexpected scenario in simulated environment could allow to extinguish fear-potentiated startle caused by unexpected situations encountered in flight situation (Landman et al., <xref ref-type="bibr" rid="B63">2018</xref>). Moreover, the assessment of individual differences in response to unexpected events seems to be an important criterion in the selection and training of pilots.</p>
<p>Future research in the aviation field might be conducted based on the Landman model and using physiological measurements in order to study under what circumstances an unexpected event, e.g., an automation problem, can trigger a startle or surprise reaction and lead to a change in activated mental schema. Future research should shed more light on beyond what threshold of intensity or threat an abnormal event triggers a startle response. It would also be important to know what types of flight events are likely to lead either to an arousal indicative of a startle or to a surprise reaction among pilots. The effect of the pilots&#x00027; expertise and experience should also be assessed. This research should be conducted in order to remove the ambiguity between these notions about measurement, therefore to define the type of stress reaction measured although similar to other stress type (stress following startle or surprise), avoid confounding factors (distraction), include control condition as well as manipulation check and larger sample size. These results could be used to inform other areas where performance and adherence to standard are impaired by unexpected events (nuclear power plant control, surgery, etc.) and provide good substrate for training.</p>
<p>In order to take into account the potential impact of these cognitive states on pilots, field studies in simulators could be considered in order to assess and confirm their physiological effects on the pilot. Thus, based on the presented experimental framework (Landman model &#x0002B; physiology) experimental manipulations evaluating one or more of these cognitive states according to the definitions and examples provided in this article but also those of the Landman model, coupled with physiological measurements having shown their sensitivity would make it possible to advance knowledge of the effects and measures of these cognitive states. This would allow to clarify their respective definitions, to avoid confusion in the terms used in the literature and in the reports of incidents and thus to provide training and countermeasures adapted to the negative impacts of these cognitive states. Neuroimaging techniques coupled with physiological measurements could also allow for the categorization of the structures involved in these states.</p>
<p>Thus, further experimental studies are needed to disentangle the close links that the notions of surprise, startle and stress may have. This will help to better understand the systems and structures involved in each of them and provide information on the best measure(s)/technique(s) to assess each concept.</p>
</sec>
<sec sec-type="author-contributions" id="s8">
<title>Author contributions</title>
<p>VD-Z, TB, and MD conceptualized the idea. MD performed the bibliographic search and wrote the first draft of the manuscript. All authors contributed to the revised manuscript, contributed to the article, and approved the submitted version.</p>
</sec>
</body>
<back>
<sec sec-type="funding-information" id="s9">
<title>Funding</title>
<p>This research was granted by DGAC in the context of the project COCOTIER.</p>
</sec>
<sec sec-type="COI-statement" id="conf1">
<title>Conflict of interest</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec sec-type="disclaimer" id="s10">
<title>Publisher&#x00027;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<sec sec-type="supplementary-material" id="s11">
<title>Supplementary material</title>
<p>The Supplementary Material for this article can be found online at: <ext-link ext-link-type="uri" xlink:href="https://www.frontiersin.org/articles/10.3389/fnrgo.2023.1059476/full#supplementary-material">https://www.frontiersin.org/articles/10.3389/fnrgo.2023.1059476/full#supplementary-material</ext-link></p>
<supplementary-material xlink:href="Table_1.pdf" id="SM1" mimetype="application/pdf" xmlns:xlink="http://www.w3.org/1999/xlink"/>
</sec>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>&#x000C5;sli</surname> <given-names>O.</given-names></name> <name><surname>Flaten</surname> <given-names>M. A.</given-names></name></person-group> (<year>2012</year>). <article-title>How fast is fear? Automatic and controlled processing in conditioned fear</article-title>. <source>J Psychophysiol.</source> <volume>26</volume>, <fpage>20</fpage>&#x02013;<lpage>28</lpage>. <pub-id pub-id-type="doi">10.1027/0269-8803/a000063</pub-id></citation>
</ref>
<ref id="B2">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Agha</surname> <given-names>R. D.</given-names></name></person-group> (<year>2020</year>). <source>Evaluating Scenarios That Can Startle and Surprise Pilots (Master thesis)</source>. Available online at: <ext-link ext-link-type="uri" xlink:href="https://commons.erau.edu/edt/510/">https://commons.erau.edu/edt/510/</ext-link> (accessed January 15, 2023).</citation>
</ref>
<ref id="B3">
<citation citation-type="web"><person-group person-group-type="author"><collab>Airbus</collab></person-group> (<year>2004</year>). <source>Human Performance: Managing Interruptions and Distractions (FOBN Reference: FLT_OPS-HUM_PER-SEQ03-REV03-OCT. 2003). Flight Operations Briefing Notes</source>. Available online at: <ext-link ext-link-type="uri" xlink:href="https://www.skybrary.aero/bookshelf/books/176.pdf">https://www.skybrary.aero/bookshelf/books/176.pdf</ext-link> (accessed January 15, 2023).</citation>
</ref>
<ref id="B4">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Alberdi</surname> <given-names>A.</given-names></name> <name><surname>Aztiria</surname> <given-names>A.</given-names></name> <name><surname>Basarab</surname> <given-names>A.</given-names></name></person-group> (<year>2016</year>). <article-title>Towards an automatic early stress recognition system for office environments based on multimodal measurements: a review</article-title>. <source>J. Biomed. Inform.</source> <volume>59</volume>, <fpage>49</fpage>&#x02013;<lpage>75</lpage>. <pub-id pub-id-type="doi">10.1016/j.jbi.2015.11.007</pub-id><pub-id pub-id-type="pmid">26621099</pub-id></citation></ref>
<ref id="B5">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Antoun</surname> <given-names>M.</given-names></name> <name><surname>Edwards</surname> <given-names>K. M.</given-names></name> <name><surname>Sweeting</surname> <given-names>J.</given-names></name> <name><surname>Ding</surname> <given-names>D.</given-names></name></person-group> (<year>2017</year>). <article-title>The acute physiological stress response to driving: a systematic review</article-title>. <source>PLoS ONE</source> <volume>12</volume>, <fpage>e0185517</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0185517</pub-id><pub-id pub-id-type="pmid">29036199</pub-id></citation></ref>
<ref id="B6">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Balogiannis</surname> <given-names>G.</given-names></name> <name><surname>Stachtea</surname> <given-names>X.</given-names></name> <name><surname>Yova</surname> <given-names>D.</given-names></name> <name><surname>Papageorgiou</surname> <given-names>C.</given-names></name></person-group> (<year>2020</year>). <article-title>A novel optical non-intrusive method for measuring acoustic startle reflex in humans</article-title>. <source>Physiol. Meas</source>. <volume>41</volume>:<fpage>065003</fpage>. <pub-id pub-id-type="doi">10.1088/1361-6579/ab8e60</pub-id><pub-id pub-id-type="pmid">32348963</pub-id></citation></ref>
<ref id="B7">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Barnes</surname> <given-names>V. E.</given-names></name> <name><surname>Monan</surname> <given-names>W. P.</given-names></name></person-group> (<year>1990</year>). <article-title>Cockpit distractions: Precursors to emergencies</article-title>. <source>Proc. Hum. Fact. Soc. Ann. Meet.</source> <volume>34</volume>, <fpage>1142</fpage>&#x02013;<lpage>1144</lpage>. <pub-id pub-id-type="doi">10.1177/154193129003401610</pub-id></citation>
</ref>
<ref id="B8">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bartlett</surname> <given-names>F. C.</given-names></name> <name><surname>Bartlett</surname> <given-names>F. C.</given-names></name></person-group> (<year>1995</year>). <source>Remembering: A Study in Experimental and Social Psychology</source>. Cambridge University Press.</citation>
</ref>
<ref id="B9">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bartra</surname> <given-names>O.</given-names></name> <name><surname>McGuire</surname> <given-names>J. T.</given-names></name> <name><surname>Kable</surname> <given-names>J. W.</given-names></name></person-group> (<year>2013</year>). <article-title>The valuation system: a coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value</article-title>. <source>Neuroimage</source> <volume>76</volume>, <fpage>412</fpage>&#x02013;<lpage>427</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuroimage.2013.02.063</pub-id><pub-id pub-id-type="pmid">23507394</pub-id></citation></ref>
<ref id="B10">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Behrens</surname> <given-names>T. E.</given-names></name> <name><surname>Woolrich</surname> <given-names>M. W.</given-names></name> <name><surname>Walton</surname> <given-names>M. E.</given-names></name> <name><surname>Rushworth</surname> <given-names>M. F.</given-names></name></person-group> (<year>2007</year>). <article-title>Learning the value of information in an uncertain world</article-title>. <source>Nat. Neurosci.</source> <volume>10</volume>, <fpage>1214</fpage>&#x02013;<lpage>1221</lpage>. <pub-id pub-id-type="doi">10.1038/nn1954</pub-id><pub-id pub-id-type="pmid">17676057</pub-id></citation></ref>
<ref id="B11">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Beringer</surname> <given-names>D. B.</given-names></name> <name><surname>Howard</surname> <given-names>C. H.</given-names> <suffix>Jr.</suffix></name></person-group> (<year>1999</year>). <article-title>Automation in general aviation: two studies of pilot responses to autopilot malfunctions</article-title>. <source>Int. J. Aviat. Psychol.</source> <volume>9</volume>, <fpage>155</fpage>&#x02013;<lpage>174</lpage>. <pub-id pub-id-type="doi">10.1207/s15327108ijap0902_5</pub-id></citation>
</ref>
<ref id="B12">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bisdorff</surname> <given-names>A. R.</given-names></name> <name><surname>Bronstein</surname> <given-names>A. M.</given-names></name> <name><surname>Gresty</surname> <given-names>M. A.</given-names></name></person-group> (<year>1994</year>). <article-title>Responses in neck and facial muscles to sudden free fall and a startling auditory stimulus</article-title>. <source>Electroencephalogr. Clin. Neurophysiol. Evok. Potentials Sect.</source> <volume>93</volume>, <fpage>409</fpage>&#x02013;<lpage>416</lpage>. <pub-id pub-id-type="doi">10.1016/0168-5597(94)90146-5</pub-id><pub-id pub-id-type="pmid">7529689</pub-id></citation></ref>
<ref id="B13">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bott-Fl&#x000FC;gel</surname> <given-names>L.</given-names></name> <name><surname>Bernshausen</surname> <given-names>A.</given-names></name> <name><surname>Schneider</surname> <given-names>H.</given-names></name> <name><surname>Luppa</surname> <given-names>P.</given-names></name> <name><surname>Zimmermann</surname> <given-names>K.</given-names></name> <name><surname>Albrecht-K&#x000FC;pper</surname> <given-names>B.</given-names></name> <etal/></person-group>. (<year>2011</year>). <article-title>Selective attenuation of norepinephrine release and stress-induced heart rate increase by partial adenosine A 1 agonism</article-title>. <source>PLoS ONE</source> <volume>6</volume>, <fpage>e18048</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0018048</pub-id><pub-id pub-id-type="pmid">21464936</pub-id></citation></ref>
<ref id="B14">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Bourne</surname> <given-names>L. E.</given-names> <suffix>Jr.</suffix></name> <name><surname>Yaroush</surname> <given-names>R. A.</given-names></name></person-group> (<year>2003</year>). <source>Stress and Cognition: A Cognitive Psychological Perspective (NASA/CR-2003-212282). National Aeronautics and Space Administration Grant Number NAG2-1561: Outline Stress and Cognition: A Cognitive Psychological Perspective. Moffett Field, CA: National Aeronautics and Space Administration</source>. Available online at: <ext-link ext-link-type="uri" xlink:href="https://ntrs.nasa.gov/api/citations/20040034070/downloads/20040034070.pdf">https://ntrs.nasa.gov/api/citations/20040034070/downloads/20040034070.pdf</ext-link></citation>
</ref>
<ref id="B15">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bradley</surname> <given-names>M. M.</given-names></name> <name><surname>Moulder</surname> <given-names>B.</given-names></name> <name><surname>Lang</surname> <given-names>P. J.</given-names></name></person-group> (<year>2005</year>). <article-title>When good things go bad: The reflex physiology of defense</article-title>. <source>Psychol. Sci.</source> <volume>16</volume>, <fpage>468</fpage>&#x02013;<lpage>473</lpage>.<pub-id pub-id-type="pmid">15943673</pub-id></citation></ref>
<ref id="B16">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Brosch</surname> <given-names>T.</given-names></name> <name><surname>Scherer</surname> <given-names>K. R.</given-names></name> <name><surname>Grandjean</surname> <given-names>D. M.</given-names></name> <name><surname>Sander</surname> <given-names>D.</given-names></name></person-group> (<year>2013</year>). <article-title>The impact of emotion on perception, attention, memory, and decision-making</article-title>. <source>Swiss Med. Wkly.</source> <volume>143</volume>, <fpage>w13786</fpage>. <pub-id pub-id-type="doi">10.4414/smw.2013.13786</pub-id><pub-id pub-id-type="pmid">23740562</pub-id></citation></ref>
<ref id="B17">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Bruna</surname> <given-names>O.</given-names></name> <name><surname>Levora</surname> <given-names>T.</given-names></name> <name><surname>Holub</surname> <given-names>J.</given-names></name></person-group> (<year>2018</year>). <article-title>Assessment of ECG and respiration recordings from simulated emergency landings of ultra light aircraft</article-title>. <source>Sci. Rep.</source> <volume>8</volume>, <fpage>1</fpage>&#x02013;<lpage>10</lpage>. <pub-id pub-id-type="doi">10.1038/s41598-018-25528-z</pub-id><pub-id pub-id-type="pmid">29740046</pub-id></citation></ref>
<ref id="B18">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Burki-Cohen</surname> <given-names>J.</given-names></name></person-group> (<year>2010</year>). <article-title>&#x0201C;Technical challenges of upset recovery training: Simulating the element of surprise,&#x0201D;</article-title> in <source>Proceedings of the AIAA Modeling and Simulation Technologies Conference (Paper No. AIAA 2010-8008)</source> (<publisher-loc>Reston, VA</publisher-loc>: <publisher-name>AIAA</publisher-name>).</citation>
</ref>
<ref id="B19">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Campkin</surname> <given-names>M.</given-names></name></person-group> (<year>2000</year>). <article-title>Stress management in primary care</article-title>. <source>Fam. Pract.</source> <volume>17</volume>, <fpage>98</fpage>&#x02013;<lpage>99</lpage>. <pub-id pub-id-type="doi">10.1093/fampra/17.1.98&#x02013;a</pub-id></citation>
</ref>
<ref id="B20">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Cao</surname> <given-names>X.</given-names></name> <name><surname>MacNaughton</surname> <given-names>P.</given-names></name> <name><surname>Cadet</surname> <given-names>L. R.</given-names></name> <name><surname>Cedeno-Laurent</surname> <given-names>J. G.</given-names></name> <name><surname>Flanigan</surname> <given-names>S.</given-names></name> <name><surname>Vallarino</surname> <given-names>J.</given-names></name> <etal/></person-group>. (<year>2019</year>). <article-title>Heart rate variability and performance of commercial airline pilots during flight simulations</article-title>. <source>Int. J. Environ. Res. Public Health</source> <volume>16</volume>, <fpage>237</fpage>. <pub-id pub-id-type="doi">10.3390/ijerph16020237</pub-id><pub-id pub-id-type="pmid">30654438</pub-id></citation></ref>
<ref id="B21">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Carlsen</surname> <given-names>A. N.</given-names></name> <name><surname>Chua</surname> <given-names>R.</given-names></name> <name><surname>Dakin</surname> <given-names>C. J.</given-names></name> <name><surname>Sanderson</surname> <given-names>D. J.</given-names></name> <name><surname>Inglis</surname> <given-names>J. T.</given-names></name> <name><surname>Franks</surname> <given-names>I. M.</given-names></name></person-group> (<year>2008</year>). <article-title>Startle reveals an absence of advance motor programming in a Go/No-go task</article-title>. <source>Neurosci. Lett.</source> <volume>434</volume>, <fpage>61</fpage>&#x02013;<lpage>65</lpage>. <pub-id pub-id-type="doi">10.1016/j.neulet.2008.01.029</pub-id><pub-id pub-id-type="pmid">18262355</pub-id></citation></ref>
<ref id="B22">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Casner</surname> <given-names>S. M.</given-names></name> <name><surname>Geven</surname> <given-names>R. W.</given-names></name> <name><surname>Williams</surname> <given-names>K. T.</given-names></name></person-group> (<year>2013</year>). <article-title>The effectiveness of airline pilot training for abnormal events</article-title>. <source>Hum. Fact.</source> <volume>55</volume>, <fpage>477</fpage>&#x02013;<lpage>485</lpage>. <pub-id pub-id-type="doi">10.1177/0018720812466893</pub-id><pub-id pub-id-type="pmid">23829023</pub-id></citation></ref>
<ref id="B23">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chou</surname> <given-names>C.-Y.</given-names></name> <name><surname>Marca</surname> <given-names>R. L.</given-names></name> <name><surname>Steptoe</surname> <given-names>A.</given-names></name> <name><surname>Brewin</surname> <given-names>C. R.</given-names></name></person-group> (<year>2014</year>). <article-title>Heart rate, startle response, and intrusive trauma memories</article-title>. <source>Psychophysiology</source> <volume>51</volume>, <fpage>236</fpage>&#x02013;<lpage>246</lpage>. <pub-id pub-id-type="doi">10.1111/psyp.12176</pub-id><pub-id pub-id-type="pmid">24397333</pub-id></citation></ref>
<ref id="B24">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Coon</surname> <given-names>D.</given-names></name> <name><surname>Mitterer</surname> <given-names>J. O.</given-names></name></person-group> (<year>2012</year>). <source>Introduction to Psychology: Gateways to Mind and Behavior With Concept Maps and Reviews</source>. <publisher-loc>Belmont, CA</publisher-loc>: <publisher-name>Cengage Learning</publisher-name>.</citation>
</ref>
<ref id="B25">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Critchley</surname> <given-names>H. D.</given-names></name> <name><surname>Tang</surname> <given-names>J.</given-names></name> <name><surname>Glaser</surname> <given-names>D.</given-names></name> <name><surname>Butterworth</surname> <given-names>B.</given-names></name> <name><surname>Dolan</surname> <given-names>R. J.</given-names></name></person-group> (<year>2005</year>). <article-title>Anterior cingulate activity during error and autonomic response</article-title>. <source>Neuroimage</source> <volume>27</volume>, <fpage>885</fpage>&#x02013;<lpage>895</lpage>. <pub-id pub-id-type="doi">10.1016/j.neuroimage.2005.05.047</pub-id><pub-id pub-id-type="pmid">15996878</pub-id></citation></ref>
<ref id="B26">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Damasio</surname> <given-names>A. R.</given-names></name></person-group> (<year>1995</year>). <source>Descartes&#x00027; Error: Emotion, Reason, and the Human Brain.</source> <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Harper Collins</publisher-name>.<pub-id pub-id-type="pmid">16147458</pub-id></citation></ref>
<ref id="B27">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Davis</surname> <given-names>M.</given-names></name></person-group> (<year>1993</year>). <article-title>Pharmacological analysis of fear-potentiated startle</article-title>. <source>Braz. J. Med. Bio. Res.</source> <volume>26</volume>, <fpage>235</fpage>&#x02013;<lpage>260</lpage>. <pub-id pub-id-type="doi">10.1016/0166-4328(93)90102-V</pub-id><pub-id pub-id-type="pmid">8136044</pub-id></citation></ref>
<ref id="B28">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Dayan</surname> <given-names>P.</given-names></name> <name><surname>Yu</surname> <given-names>A. J.</given-names></name></person-group> (<year>2006</year>). <article-title>Phasic norepinephrine: <bold>a</bold> neural interrupt signal for unexpected events</article-title>. <source>Netw. Comput. Neural Syst.</source> <volume>17</volume>, <fpage>335</fpage>&#x02013;<lpage>350</lpage>. <pub-id pub-id-type="doi">10.1080/09548980601004024</pub-id><pub-id pub-id-type="pmid">17162459</pub-id></citation></ref>
<ref id="B29">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Dehais</surname> <given-names>F.</given-names></name> <name><surname>Causse</surname> <given-names>M.</given-names></name> <name><surname>Pastor</surname> <given-names>J.</given-names></name></person-group> (<year>2008</year>). <source>Embedded Eye Tracker in a Real Aircraft: New Perspectives on Pilot/Aircraft Interaction Monitoring, 1&#x02013;7</source>. Available online at: <ext-link ext-link-type="uri" xlink:href="http://www.icrat.org/">http://www.icrat.org/</ext-link> (accessed January 15, 2023).</citation>
</ref>
<ref id="B30">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Deuter</surname> <given-names>C. E.</given-names></name> <name><surname>Kuehl</surname> <given-names>L. K.</given-names></name> <name><surname>Blumenthal</surname> <given-names>T. D.</given-names></name> <name><surname>Schulz</surname> <given-names>A.</given-names></name> <name><surname>Oitzl</surname> <given-names>M. S.</given-names></name> <name><surname>Schachinger</surname> <given-names>H.</given-names></name></person-group> (<year>2012</year>). <article-title>Effects of cold pressor stress on the human startle response</article-title>. <source>PLoS ONE</source> <volume>7</volume>, <fpage>49866</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0049866</pub-id><pub-id pub-id-type="pmid">23166784</pub-id></citation></ref>
<ref id="B31">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Dismukes</surname> <given-names>R.</given-names></name> <name><surname>Goldsmith</surname> <given-names>T. E.</given-names></name> <name><surname>Kochan</surname> <given-names>J. A.</given-names></name></person-group> (<year>2015</year>). <source>Effects of Acute Stress on Aircrew Performance: Literature Review and Analysis of Operational Aspects. (NASA/TM-2015-218930)</source>. <publisher-loc>Moffett Field, CA</publisher-loc>: <publisher-name>National Aeronautics and Space Administration</publisher-name>.</citation>
</ref>
<ref id="B32">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Driskell</surname> <given-names>J. E.</given-names></name> <name><surname>Salas</surname> <given-names>E.</given-names></name></person-group> (<year>1996</year>). <source>Stress and Human Performance</source>. Lawrence Erlbaum Associates, Inc. p. 314.</citation>
</ref>
<ref id="B33">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Edwards</surname> <given-names>J. R.</given-names></name> <name><surname>Cooper</surname> <given-names>C. L.</given-names></name></person-group> (<year>1988</year>). <article-title>The impacts of positive psychological states on physical health: a review and theoretical framework</article-title>. <source>Soc. Sci. Med.</source> <volume>27</volume>, <fpage>1447</fpage>&#x02013;<lpage>1459</lpage>. <pub-id pub-id-type="doi">10.1016/0277-9536(88)90212-2</pub-id><pub-id pub-id-type="pmid">3070765</pub-id></citation></ref>
<ref id="B34">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ekman</surname> <given-names>P.</given-names></name> <name><surname>Friesen</surname> <given-names>W. V.</given-names></name> <name><surname>Simons</surname> <given-names>R. C.</given-names></name></person-group> (<year>1985</year>). <article-title>Is the startle reaction an emotion?</article-title> <source>J. Pers. Soc. Psychol.</source> <volume>49</volume>, <fpage>1416</fpage>&#x02013;<lpage>1426</lpage>. <pub-id pub-id-type="doi">10.1037/0022-3514.49.5.1416</pub-id></citation>
</ref>
<ref id="B35">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Eysenck</surname> <given-names>M.</given-names></name> <name><surname>Payne</surname> <given-names>S.</given-names></name> <name><surname>Derakshan</surname> <given-names>N.</given-names></name></person-group> (<year>2005</year>). <article-title>Trait anxiety, visuospatial processing, and working memory</article-title>. <source>Cogn. Emot.</source> <volume>19</volume>, <fpage>1214</fpage>&#x02013;<lpage>1228</lpage>.<pub-id pub-id-type="pmid">18686056</pub-id></citation></ref>
<ref id="B36">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fabre</surname> <given-names>E. F.</given-names></name> <name><surname>Jahanpour</surname> <given-names>E. S.</given-names></name> <name><surname>Causse</surname> <given-names>M.</given-names></name></person-group> (<year>2021</year>). <article-title>Human mirror neuron system based alarms in the cockpit: a neuroergonomic evaluation</article-title>. <source>Appl. Psychophysiol. Biofeedback</source> <volume>46</volume>, <fpage>29</fpage>&#x02013;<lpage>42</lpage>. <pub-id pub-id-type="doi">10.1007/s10484-020-09481-0</pub-id><pub-id pub-id-type="pmid">32602072</pub-id></citation></ref>
<ref id="B37">
<citation citation-type="web"><person-group person-group-type="author"><collab>Federal Aviation Administration</collab></person-group> (<year>2015</year>). <source>Upset Prevention and Recovery Training (Advisory Circular AC 120-111)</source>. Available online at: <ext-link ext-link-type="uri" xlink:href="https://www.faa.gov/regulations_policies/advisory_circulars/index.cfm/go/document.information/documentid/1027328">https://www.faa.gov/regulations_policies/advisory_circulars/index.cfm/go/document.information/documentid/1027328</ext-link> (accessed January 15, 2023).</citation>
</ref>
<ref id="B38">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Field</surname> <given-names>J. N.</given-names></name> <name><surname>Boland</surname> <given-names>E. J.</given-names></name> <name><surname>Van Rooij</surname> <given-names>J. M.</given-names></name> <name><surname>Mohrmann</surname> <given-names>J. F. W.</given-names></name> <name><surname>Smeltink</surname> <given-names>J. W.</given-names></name></person-group> (<year>2015</year>). <source>Startle Effect Management (NLR-CR-2018-242). European Aviation Safety Agency</source>. Available online at: <ext-link ext-link-type="uri" xlink:href="https://www.easa.europa.eu/sites/default/files/dfu/EASA_Research_Startle_Effect_Managements_Final_Report.pdf">https://www.easa.europa.eu/sites/default/files/dfu/EASA_Research_Startle_Effect_Managements_Final_Report.pdf</ext-link> (accessed January 15, 2023).</citation>
</ref>
<ref id="B39">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fitts</surname> <given-names>P. M.</given-names></name></person-group> (<year>1954</year>). <article-title>The information capacity of the human motor system in controlling the amplitude of movement</article-title>. <source>J. Exp. Psychol.</source> <volume>47</volume>, <fpage>381</fpage>&#x02013;<lpage>391</lpage>. <pub-id pub-id-type="doi">10.1037/h0055392</pub-id><pub-id pub-id-type="pmid">1402698</pub-id></citation></ref>
<ref id="B40">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Foster</surname> <given-names>M. I.</given-names></name> <name><surname>Keane</surname> <given-names>M. T.</given-names></name></person-group> (<year>2015</year>). <article-title>Why some surprises are more surprising than others: surprise as a metacognitive sense of explanatory difficulty</article-title>. <source>Cogn. Psychol.</source> <volume>81</volume>, <fpage>74</fpage>&#x02013;<lpage>116</lpage>. <pub-id pub-id-type="doi">10.1016/j.cogpsych.2015.08.004</pub-id><pub-id pub-id-type="pmid">26330382</pub-id></citation></ref>
<ref id="B41">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gluck</surname> <given-names>K. A.</given-names></name> <name><surname>Gunzelmann</surname> <given-names>G.</given-names></name></person-group> (<year>2013</year>). <article-title>&#x0201C;Computational process modeling and cognitive stressors: Background and prospects for application in cognitive engineering,&#x0201D;</article-title> in <source>The Oxford Handbook of Cognitive Engineering</source>, eds J. D. Lee and A. Kirlik (Oxford University Press), <fpage>424</fpage>&#x02013;<lpage>432</lpage>.</citation>
</ref>
<ref id="B42">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Groves</surname> <given-names>P. M.</given-names></name> <name><surname>Wilson</surname> <given-names>C. J.</given-names></name> <name><surname>Boyle</surname> <given-names>R. D.</given-names></name></person-group> (<year>1974</year>). <article-title>Brain stem pathways, cortical modulation, and habituation of the acoustic startle response</article-title>. <source>Behav. Biol.</source> <volume>10</volume>, <fpage>391</fpage>&#x02013;<lpage>418</lpage>.<pub-id pub-id-type="pmid">4832941</pub-id></citation></ref>
<ref id="B43">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Gu</surname> <given-names>S.</given-names></name> <name><surname>Wang</surname> <given-names>F.</given-names></name> <name><surname>Wu</surname> <given-names>E.</given-names></name> <name><surname>Tang</surname> <given-names>Y.</given-names></name> <name><surname>Huang</surname> <given-names>J. H.</given-names></name></person-group> (<year>2019</year>). <article-title>An integrative way for studying neural basis of basic emotions with fMRI</article-title>. <source>Front. Neurosci.</source> <volume>13</volume>, <fpage>628</fpage>. <pub-id pub-id-type="doi">10.3389/fnins.2019.00628</pub-id><pub-id pub-id-type="pmid">31275107</pub-id></citation></ref>
<ref id="B44">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Healey</surname> <given-names>J. A.</given-names></name> <name><surname>Picard</surname> <given-names>R. W.</given-names></name></person-group> (<year>2005</year>). <article-title>Detecting stress during real-world driving tasks using physiological sensors</article-title>. <source>IEEE Transact. Intell. Transport. Syst.</source> <volume>6</volume>, <fpage>156</fpage>&#x02013;<lpage>166</lpage>. <pub-id pub-id-type="doi">10.1109/TITS.2005.848368</pub-id></citation>
</ref>
<ref id="B45">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Holand</surname> <given-names>S.</given-names></name> <name><surname>Girard</surname> <given-names>A.</given-names></name> <name><surname>Laude</surname> <given-names>D.</given-names></name> <name><surname>Meyer-Bisch</surname> <given-names>C.</given-names></name> <name><surname>Elghozi</surname> <given-names>J.-L.</given-names></name></person-group> (<year>1999</year>). <article-title>Effects of an auditory startle stimulus on blood pressure and heart rate in humans</article-title>. <source>J. Hypertens.</source> <volume>17</volume>, <fpage>1893</fpage>&#x02013;<lpage>1897</lpage>. <pub-id pub-id-type="doi">10.1097/00004872-199917121-00018</pub-id><pub-id pub-id-type="pmid">10703886</pub-id></citation></ref>
<ref id="B46">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Holland</surname> <given-names>P. C.</given-names></name> <name><surname>Gallagher</surname> <given-names>M.</given-names></name></person-group> (<year>2006</year>). <article-title>Different roles for amygdala central nucleus and substantia innominata in the surprise-induced enhancement of learning</article-title>. <source>J. Neurosci.</source> <volume>26</volume>, <fpage>3791</fpage>&#x02013;<lpage>3797</lpage>. <pub-id pub-id-type="doi">10.1523/JNEUROSCI.0390-06.2006</pub-id><pub-id pub-id-type="pmid">16597732</pub-id></citation></ref>
<ref id="B47">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Horstmann</surname> <given-names>G.</given-names></name></person-group> (<year>2006</year>). <article-title>Latency and duration of the action interruption in surprise</article-title>. <source>Cogn. Emot.</source> <volume>20</volume>, <fpage>242</fpage>&#x02013;<lpage>273</lpage>. <pub-id pub-id-type="doi">10.1080/02699930500262878</pub-id></citation>
</ref>
<ref id="B48">
<citation citation-type="web"><person-group person-group-type="author"><collab>IATA</collab></person-group> (<year>2018</year>). <source>Guidance Material and Best Practices for the Implementation of Upset Prevention and Recovery Training. International Air Transport Association</source>. Available online at: <ext-link ext-link-type="uri" xlink:href="https://www.iata.org/contentassets/b6eb2adc248c484192101edd1ed36015/gmbp_uprt.pdf">https://www.iata.org/contentassets/b6eb2adc248c484192101edd1ed36015/gmbp_uprt.pdf</ext-link> (accessed January 15, 2023).</citation>
</ref>
<ref id="B49">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Iizuka</surname> <given-names>N.</given-names></name> <name><surname>Awano</surname> <given-names>S.</given-names></name> <collab>JOUR</collab></person-group>. (<year>2012</year>). <article-title>Salivary alpha-amylase activity and stress in Japan air self-defense force cargo pilots involved in Iraq reconstruction</article-title>. <source>Am. J. Hum. Biol</source>. <volume>24</volume>, <fpage>468</fpage>&#x02013;<lpage>472</lpage>. <pub-id pub-id-type="doi">10.1002/ajhb.22247</pub-id><pub-id pub-id-type="pmid">22344628</pub-id></citation></ref>
<ref id="B50">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jack</surname> <given-names>R. E.</given-names></name> <name><surname>Garrod</surname> <given-names>O. G.</given-names></name> <name><surname>Schyns</surname> <given-names>P. G.</given-names></name></person-group> (<year>2014</year>). <article-title>Dynamic facial expressions of emotion transmit an evolving hierarchy of signals over time</article-title>. <source>Curr. Biol.</source> <volume>24</volume>, <fpage>187</fpage>&#x02013;<lpage>192</lpage>. <pub-id pub-id-type="doi">10.1016/j.cub.2013.11.064</pub-id><pub-id pub-id-type="pmid">24388852</pub-id></citation></ref>
<ref id="B51">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jang</surname> <given-names>E.-H.</given-names></name> <name><surname>Park</surname> <given-names>B.-J.</given-names></name> <name><surname>Park</surname> <given-names>M.-S.</given-names></name> <name><surname>Kim</surname> <given-names>S.-H.</given-names></name> <name><surname>Sohn</surname> <given-names>J.-H.</given-names></name></person-group> (<year>2015</year>). <article-title>Analysis of physiological signals for recognition of boredom, pain, and surprise emotions</article-title>. <source>J. Physiol. Anthropol.</source> <volume>34</volume>, <fpage>25</fpage>. <pub-id pub-id-type="doi">10.1186/s40101-015-0063-5</pub-id><pub-id pub-id-type="pmid">26084816</pub-id></citation></ref>
<ref id="B52">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kaklauskas</surname> <given-names>A.</given-names></name> <name><surname>Zavadskas</surname> <given-names>E. K.</given-names></name> <name><surname>Seniut</surname> <given-names>M.</given-names></name> <name><surname>Dzemyda</surname> <given-names>G.</given-names></name> <name><surname>Stankevic</surname> <given-names>V.</given-names></name> <name><surname>Simkevi&#x0010D;ius</surname> <given-names>C.</given-names></name> <etal/></person-group>. (<year>2011</year>). <article-title>Web-based biometric computer mouse advisory system to analyze a user&#x00027;s emotions and work productivity</article-title>. <source>Eng. Appl. Artif. Intell.</source> <volume>24</volume>, <fpage>928</fpage>&#x02013;<lpage>945</lpage>. <pub-id pub-id-type="doi">10.1016/j.engappai.2011.04.006</pub-id></citation>
</ref>
<ref id="B53">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Katmah</surname> <given-names>R.</given-names></name> <name><surname>Al-Shargie</surname> <given-names>F.</given-names></name> <name><surname>Tariq</surname> <given-names>U.</given-names></name> <name><surname>Babiloni</surname> <given-names>F.</given-names></name> <name><surname>Al-Mughairbi</surname> <given-names>F.</given-names></name> <name><surname>Al-Nashash</surname> <given-names>H.</given-names></name></person-group> (<year>2021</year>). <article-title>A review on mental stress assessment methods using EEG signals</article-title>. <source>Sensors</source> <volume>21</volume>, <fpage>15</fpage>. <pub-id pub-id-type="doi">10.3390/s21155043</pub-id><pub-id pub-id-type="pmid">34372280</pub-id></citation></ref>
<ref id="B54">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kim</surname> <given-names>H.-G.</given-names></name> <name><surname>Cheon</surname> <given-names>E.-J.</given-names></name> <name><surname>Bai</surname> <given-names>D.-S.</given-names></name> <name><surname>Lee</surname> <given-names>Y. H.</given-names></name> <name><surname>Koo</surname> <given-names>B.-H.</given-names></name></person-group> (<year>2018</year>). <article-title>Stress and heart rate variability: a meta-analysis and review of the literature</article-title>. <source>Psychiatry Investig.</source> <volume>15</volume>, <fpage>235</fpage>&#x02013;<lpage>245</lpage>. <pub-id pub-id-type="doi">10.30773/pi.2017.08.17</pub-id><pub-id pub-id-type="pmid">29486547</pub-id></citation></ref>
<ref id="B55">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kim</surname> <given-names>M. J.</given-names></name> <name><surname>Mattek</surname> <given-names>A. M.</given-names></name> <name><surname>Bennett</surname> <given-names>R. H.</given-names></name> <name><surname>Solomon</surname> <given-names>K. M.</given-names></name> <name><surname>Shin</surname> <given-names>J.</given-names></name> <name><surname>Whalen</surname> <given-names>P. J.</given-names></name></person-group> (<year>2017</year>). <article-title>Human amygdala tracks a feature-based valence signal embedded within the facial expression of surprise</article-title>. <source>J. Neurosci.</source> <volume>37</volume>, <fpage>9510</fpage>&#x02013;<lpage>9518</lpage>. <pub-id pub-id-type="doi">10.1523/JNEUROSCI.1375-17.2017</pub-id><pub-id pub-id-type="pmid">28874449</pub-id></citation></ref>
<ref id="B56">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kinney</surname> <given-names>L.</given-names></name> <name><surname>O&#x00027;Hare</surname> <given-names>D.</given-names></name></person-group> (<year>2019</year>). <article-title>Responding to an unexpected in-flight event: physiological arousal, information processing, and performance</article-title>. <source>Hum. Fact</source>. <volume>62</volume>, <fpage>737</fpage>&#x02013;<lpage>750</lpage>. <pub-id pub-id-type="doi">10.1177/0018720819854830</pub-id><pub-id pub-id-type="pmid">31237440</pub-id></citation></ref>
<ref id="B57">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Klein</surname> <given-names>G.</given-names></name> <name><surname>Phillips</surname> <given-names>J. K.</given-names></name> <name><surname>Rall</surname> <given-names>E. L.</given-names></name> <name><surname>Peluso</surname> <given-names>D. A.</given-names></name></person-group> (<year>2007</year>). <article-title>&#x0201C;A data-frame theory of sensemaking. In Expertise out of context,&#x0201D;</article-title> in <source>Proceedings of the Sixth International Conference on Naturalistic Decision Making</source> (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>Lawrence Erlbaum Associates Publishers</publisher-name>), <fpage>113</fpage>&#x02013;<lpage>155</lpage>.</citation>
</ref>
<ref id="B58">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kloosterman</surname> <given-names>N. A.</given-names></name> <name><surname>Meindertsma</surname> <given-names>T.</given-names></name> <name><surname>van Loon</surname> <given-names>A. M.</given-names></name> <name><surname>Lamme</surname> <given-names>V. A.</given-names></name> <name><surname>Bonneh</surname> <given-names>Y. S.</given-names></name> <name><surname>Donner</surname> <given-names>T. H.</given-names></name></person-group> (<year>2015</year>). <article-title>Pupil size tracks perceptual content and surprise</article-title>. <source>Eur. J. Neurosci.</source> <volume>41</volume>, <fpage>1068</fpage>&#x02013;<lpage>1078</lpage>. <pub-id pub-id-type="doi">10.1111/ejn.12859</pub-id><pub-id pub-id-type="pmid">25754528</pub-id></citation></ref>
<ref id="B59">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kochan</surname> <given-names>J. A.</given-names></name> <name><surname>Breiter</surname> <given-names>E. G.</given-names></name> <name><surname>Jentsch</surname> <given-names>F.</given-names></name></person-group> (<year>2004</year>). <article-title>Surprise and unexpectedness in flying: database reviews and analyses</article-title>. <source>Proc. Hum. Fact. Ergon. Soc. Ann. Meet.</source> <volume>48</volume>, <fpage>335</fpage>&#x02013;<lpage>339</lpage>. <pub-id pub-id-type="doi">10.1177/154193120404800313</pub-id></citation>
</ref>
<ref id="B60">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kuroda</surname> <given-names>I.</given-names></name> <name><surname>Fujiwara</surname> <given-names>O.</given-names></name> <name><surname>Okamura</surname> <given-names>N.</given-names></name> <name><surname>Utsuki</surname> <given-names>N.</given-names></name></person-group> (<year>1976</year>). <article-title>Method for determining pilot stress through analysis of voice communication</article-title>. <source>Aviat. Space Environ. Med.</source> <volume>47</volume>, <fpage>528</fpage>&#x02013;<lpage>533</lpage>.<pub-id pub-id-type="pmid">1275844</pub-id></citation></ref>
<ref id="B61">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Landman</surname> <given-names>A.</given-names></name> <name><surname>Groen</surname> <given-names>E. L.</given-names></name> <name><surname>Paassen</surname> <given-names>M. M.</given-names></name> <name><surname>(Ren&#x000E9;) van</surname></name> <name><surname>Bronkhorst</surname> <given-names>A. W.</given-names></name> <name><surname>Mulder</surname> <given-names>M.</given-names></name></person-group> (<year>2017b</year>). <article-title>The influence of surprise on upset recovery performance in airline pilots</article-title>. <source>Int. J. Aerosp. Psychol</source>. <volume>27</volume>, <fpage>2</fpage>&#x02013;<lpage>14</lpage>. <pub-id pub-id-type="doi">10.1080/10508414.2017.1365610</pub-id></citation>
</ref>
<ref id="B62">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Landman</surname> <given-names>A.</given-names></name> <name><surname>Groen</surname> <given-names>E. L.</given-names></name> <name><surname>van Paassen</surname> <given-names>M. M.</given-names></name> <name><surname>(Ren&#x000E9;)</surname></name> <name><surname>Bronkhorst</surname> <given-names>A. W.</given-names></name> <name><surname>Mulder</surname> <given-names>M.</given-names></name></person-group> (<year>2017a</year>). <article-title>Dealing with unexpected events on the flight deck: a conceptual model of startle and surprise</article-title>. <source>Hum. Fact.</source> <volume>59</volume>, <fpage>1161</fpage>&#x02013;<lpage>1172</lpage>. <pub-id pub-id-type="doi">10.1177/0018720817723428</pub-id><pub-id pub-id-type="pmid">28777917</pub-id></citation></ref>
<ref id="B63">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Landman</surname> <given-names>A.</given-names></name> <name><surname>van Oorschot</surname> <given-names>P.</given-names></name> <name><surname>van Paassen</surname> <given-names>M. M.</given-names></name> <name><surname>(Ren&#x000E9;)</surname></name> <name><surname>Groen</surname> <given-names>E. L.</given-names></name> <name><surname>Bronkhorst</surname> <given-names>A. W.</given-names></name> <name><surname>Mulder</surname> <given-names>M.</given-names></name></person-group> (<year>2018</year>). <article-title>Training pilots for unexpected events: a simulator study on the advantage of unpredictable and variable scenarios</article-title>. <source>Hum. Fact.</source> <volume>60</volume>, <fpage>793</fpage>&#x02013;<lpage>805</lpage>. <pub-id pub-id-type="doi">10.1177/0018720818779928</pub-id><pub-id pub-id-type="pmid">29913086</pub-id></citation></ref>
<ref id="B64">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ledegang</surname> <given-names>W. D.</given-names></name> <name><surname>Groen</surname> <given-names>E. L.</given-names></name></person-group> (<year>2015</year>). <article-title>Stall recovery in a centrifuge-based flight simulator with an extended aerodynamic model</article-title>. <source>Int. J. Aviat. Psychol.</source> <volume>25</volume>, <fpage>122</fpage>&#x02013;<lpage>140</lpage>. <pub-id pub-id-type="doi">10.1080/10508414.2015.1131085</pub-id></citation>
</ref>
<ref id="B65">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>LeDoux</surname> <given-names>J. E.</given-names></name></person-group> (<year>1996</year>). <source>The Emotional Brain</source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>Simon and Schuster</publisher-name></citation>
</ref>
<ref id="B66">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lindner</surname> <given-names>K.</given-names></name> <name><surname>Neubert</surname> <given-names>J.</given-names></name> <name><surname>Pfannm&#x000F6;ller</surname> <given-names>J.</given-names></name> <name><surname>Lotze</surname> <given-names>M.</given-names></name> <name><surname>Hamm</surname> <given-names>A. O.</given-names></name> <name><surname>Wendt</surname> <given-names>J.</given-names></name></person-group> (<year>2015</year>). <article-title>Fear-potentiated startle processing in humans: parallel fMRI and orbicularis EMG assessment during cue conditioning and extinction</article-title>. <source>Int. J. Psychophysiol.</source> <volume>98</volume>(<issue>3, Part 2</issue>), <fpage>535</fpage>&#x02013;<lpage>545</lpage>. <pub-id pub-id-type="doi">10.1016/j.ijpsycho.2015.02.025</pub-id><pub-id pub-id-type="pmid">25725377</pub-id></citation></ref>
<ref id="B67">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lindqvist</surname> <given-names>A.</given-names></name> <name><surname>Keskinen</surname> <given-names>E.</given-names></name> <name><surname>Antila</surname> <given-names>K.</given-names></name> <name><surname>Halkola</surname> <given-names>L.</given-names></name> <name><surname>Peltonen</surname> <given-names>T.</given-names></name> <name><surname>V&#x000E4;lim&#x000E4;ki</surname> <given-names>I.</given-names></name></person-group> (<year>1983</year>). <article-title>Heart rate variability, cardiac mechanics, and subjectively evaluated stress during simulator flight</article-title>. <source>Aviat. Space Environ. Med.</source> <volume>54</volume>, <fpage>685</fpage>&#x02013;<lpage>690</lpage>.<pub-id pub-id-type="pmid">6626075</pub-id></citation></ref>
<ref id="B68">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lundberg</surname> <given-names>U.</given-names></name> <name><surname>Forsman</surname> <given-names>M.</given-names></name> <name><surname>Zachau</surname> <given-names>G.</given-names></name> <name><surname>Ekl&#x000F6;f</surname> <given-names>M.</given-names></name> <name><surname>Palmerud</surname> <given-names>G.</given-names></name> <name><surname>Melin</surname> <given-names>B.</given-names></name> <name><surname>Kadefors</surname> <given-names>R.</given-names></name></person-group> (<year>2002</year>). <article-title>Effects of experimentally induced mental and physical stress on motor unit recruitment in the trapezius muscle</article-title>. <source>Work Stress</source> <volume>16</volume>, <fpage>166</fpage>&#x02013;<lpage>178</lpage>. <pub-id pub-id-type="doi">10.1080/02678370210136699</pub-id></citation>
</ref>
<ref id="B69">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ma</surname> <given-names>S.</given-names></name> <name><surname>Morilak</surname> <given-names>D. A.</given-names></name></person-group> (<year>2005</year>). <article-title>Norepinephrine release in medial amygdala facilitates activation of the hypothalamic-pituitary-adrenal axis in response to acute immobilisation stress</article-title>. <source>J. Neuroendocrinol.</source> <volume>17</volume>, <fpage>22</fpage>&#x02013;<lpage>28</lpage>. <pub-id pub-id-type="doi">10.1111/j.1365-2826.2005.01279.x</pub-id><pub-id pub-id-type="pmid">15720472</pub-id></citation></ref>
<ref id="B70">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Martin</surname> <given-names>W.</given-names></name> <name><surname>Murray</surname> <given-names>P.</given-names></name> <name><surname>Bates</surname> <given-names>P.</given-names></name></person-group> (<year>2012</year>). <source>The Effects of Startle on Pilots During Critical Events: A Case Study Analysis</source>. EAAP 30. Available online at: <ext-link ext-link-type="uri" xlink:href="https://research-repository.griffith.edu.au/handle/10072/54072">https://research-repository.griffith.edu.au/handle/10072/54072</ext-link> (accessed January 15, 2023).</citation>
</ref>
<ref id="B71">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Martin</surname> <given-names>W. L.</given-names></name> <name><surname>Murray</surname> <given-names>P. S.</given-names></name> <name><surname>Bates</surname> <given-names>P. R.</given-names></name> <name><surname>Lee</surname> <given-names>P. S. Y.</given-names></name></person-group> (<year>2015</year>). <article-title>Fear-potentiated startle: a review from an aviation perspective</article-title>. <source>Int. J. Aviat. Psychol.</source> <volume>25</volume>, <fpage>97</fpage>&#x02013;<lpage>107</lpage>. <pub-id pub-id-type="doi">10.1080/10508414.2015.1128293</pub-id></citation>
</ref>
<ref id="B72">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Martin</surname> <given-names>W. L.</given-names></name> <name><surname>Murray</surname> <given-names>P. S.</given-names></name> <name><surname>Bates</surname> <given-names>P. R.</given-names></name> <name><surname>Lee</surname> <given-names>P. S. Y.</given-names></name></person-group> (<year>2016</year>). <article-title>A flight simulator study of the impairment effects of startle on pilots during unexpected critical events</article-title>. <source>Aviat. Psychol. Appl. Hum. Fact.</source> <volume>6</volume>, <fpage>24</fpage>&#x02013;<lpage>32</lpage>. <pub-id pub-id-type="doi">10.1027/2192-0923/a000092</pub-id></citation>
</ref>
<ref id="B73">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Maslovat</surname> <given-names>D.</given-names></name> <name><surname>Chua</surname> <given-names>R.</given-names></name> <name><surname>Carlsen</surname> <given-names>A. N.</given-names></name> <name><surname>May</surname> <given-names>C.</given-names></name> <name><surname>Forgaard</surname> <given-names>C. J.</given-names></name> <name><surname>Franks</surname> <given-names>I. M.</given-names></name></person-group> (<year>2015</year>). <article-title>A startling acoustic stimulus interferes with upcoming motor preparation: evidence for a startle refractory period</article-title>. <source>Acta Psychol.</source> <volume>158</volume>, <fpage>36</fpage>&#x02013;<lpage>42</lpage>. <pub-id pub-id-type="doi">10.1016/j.actpsy.2015.04.003</pub-id><pub-id pub-id-type="pmid">25919668</pub-id></citation></ref>
<ref id="B74">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Matsumoto</surname> <given-names>D.</given-names></name> <name><surname>Wilson</surname> <given-names>J.</given-names></name></person-group> (<year>2008</year>). <article-title>&#x0201C;Culture, emotion, and motivation,&#x0201D;</article-title> in <source>Handbook of Motivation and Cognition Across Cultures</source>, eds R. M. Sorrentino and S. Yamaguchi (<publisher-loc>San Diego, CA</publisher-loc>: <publisher-name>Academic Press</publisher-name>), <fpage>541</fpage>&#x02013;<lpage>563</lpage>.</citation>
</ref>
<ref id="B75">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>May</surname> <given-names>D. N.</given-names></name> <name><surname>Rice</surname> <given-names>C. G.</given-names></name></person-group> (<year>1971</year>). <article-title>Effects of startle due to pistol shots on control precision performance</article-title>. <source>J. Sound Vib.</source> <volume>15</volume>, <fpage>197</fpage>&#x02013;<lpage>202</lpage>. <pub-id pub-id-type="doi">10.1016/0022-460X(71)90534-7</pub-id></citation>
</ref>
<ref id="B76">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Meindertsma</surname> <given-names>T.</given-names></name> <name><surname>Kloosterman</surname> <given-names>N. A.</given-names></name> <name><surname>Engel</surname> <given-names>A. K.</given-names></name> <name><surname>Wagenmakers</surname> <given-names>E.-J.</given-names></name> <name><surname>Donner</surname> <given-names>T. H.</given-names></name></person-group> (<year>2018</year>). <article-title>Surprise about sensory event timing drives cortical transients in the beta frequency band</article-title>. <source>J. Neurosci.</source> <volume>38</volume>, <fpage>7600</fpage>&#x02013;<lpage>7610</lpage>. <pub-id pub-id-type="doi">10.1523/JNEUROSCI.0307-18.2018</pub-id><pub-id pub-id-type="pmid">30030396</pub-id></citation></ref>
<ref id="B77">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Meyer</surname> <given-names>W.-U.</given-names></name> <name><surname>Niepel</surname> <given-names>M.</given-names></name> <name><surname>Rudolph</surname> <given-names>U.</given-names></name> <name><surname>Sch&#x000FC;tzwohl</surname> <given-names>A.</given-names></name></person-group> (<year>1991</year>). <article-title>An experimental analysis of surprise</article-title>. <source>Cogn. Emot.</source> <volume>5</volume>, <fpage>295</fpage>&#x02013;<lpage>311</lpage>. <pub-id pub-id-type="doi">10.1080/02699939108411042</pub-id></citation>
</ref>
<ref id="B78">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Meyer</surname> <given-names>W.-U.</given-names></name> <name><surname>Reisenzein</surname> <given-names>R.</given-names></name> <name><surname>Sch&#x000FC;tzwohl</surname> <given-names>A.</given-names></name></person-group> (<year>1997</year>). <article-title>Toward a process analysis of emotions: the case of surprise</article-title>. <source>Motiv. Emot.</source> <volume>21</volume>, <fpage>251</fpage>&#x02013;<lpage>274</lpage>. <pub-id pub-id-type="doi">10.1023/A:1024422330338</pub-id></citation>
</ref>
<ref id="B79">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Morilak</surname> <given-names>D. A.</given-names></name> <name><surname>Barrera</surname> <given-names>G.</given-names></name> <name><surname>Echevarria</surname> <given-names>D. J.</given-names></name> <name><surname>Garcia</surname> <given-names>A. S.</given-names></name> <name><surname>Hernandez</surname> <given-names>A.</given-names></name> <name><surname>Ma</surname> <given-names>S.</given-names></name> <name><surname>Petre</surname> <given-names>C. O.</given-names></name></person-group> (<year>2005</year>). <article-title>Role of brain norepinephrine in the behavioral response to stress</article-title>. <source>Progr. Neuropsychopharmacol. Biol. Psychiatry</source> <volume>29</volume>, <fpage>1214</fpage>&#x02013;<lpage>1224</lpage>. <pub-id pub-id-type="doi">10.1016/j.pnpbp.2005.08.007</pub-id><pub-id pub-id-type="pmid">16226365</pub-id></citation></ref>
<ref id="B80">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Neisser</surname> <given-names>U.</given-names></name></person-group> (<year>1976</year>). <source>Cognition and Reality: Principles and Implications of Cognitive Psychology</source>. <publisher-loc>New York, NY</publisher-loc>: <publisher-name>W. H. Freeman</publisher-name>.<pub-id pub-id-type="pmid">8232367</pub-id></citation></ref>
<ref id="B81">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nieuwenhuis</surname> <given-names>S.</given-names></name> <name><surname>Aston-Jones</surname> <given-names>G.</given-names></name> <name><surname>Cohen</surname> <given-names>J. D.</given-names></name></person-group> (<year>2005</year>). <article-title>Decision making, the P3, and the locus coeruleus&#x02014;Norepinephrine system</article-title>. <source>Psychol. Bull.</source> <volume>131</volume>, <fpage>510</fpage>. <pub-id pub-id-type="doi">10.1037/0033-2909.131.4.510</pub-id><pub-id pub-id-type="pmid">16060800</pub-id></citation></ref>
<ref id="B82">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Otsuka</surname> <given-names>Y.</given-names></name> <name><surname>Onozawa</surname> <given-names>A.</given-names></name> <name><surname>Miyamoto</surname> <given-names>Y.</given-names></name></person-group> (<year>2006</year>). <article-title>Hormonal responses of pilots to training flights: the effects of experience on apparent stress</article-title>. <source>Aviat. Space Environ. Med.</source> <volume>77</volume>, <fpage>410</fpage>&#x02013;<lpage>414</lpage>.<pub-id pub-id-type="pmid">16676652</pub-id></citation></ref>
<ref id="B83">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Plappert</surname> <given-names>C. F.</given-names></name> <name><surname>Pilz</surname> <given-names>P. K.</given-names></name> <name><surname>Schnitzler</surname> <given-names>H.-U.</given-names></name></person-group> (<year>1993</year>). <article-title>Acoustic startle response and habituation in freezing and nonfreezing rats</article-title>. <source>Behav. Neurosci.</source> <volume>107</volume>, <fpage>981</fpage>. <pub-id pub-id-type="doi">10.1037/0735-7044.107.6.981</pub-id><pub-id pub-id-type="pmid">8136073</pub-id></citation></ref>
<ref id="B84">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rajkowski</surname> <given-names>J.</given-names></name></person-group> (<year>1993</year>). <article-title>Correlations between locus coeruleus (LC) neural activity, pupil diameter and behavior in monkey support a role of LC in attention</article-title>. <source>Soc. Neurosc.</source> 19, 974.</citation>
</ref>
<ref id="B85">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Regula</surname> <given-names>M.</given-names></name> <name><surname>Socha</surname> <given-names>V.</given-names></name> <name><surname>Kutilek</surname> <given-names>P.</given-names></name> <name><surname>Socha</surname> <given-names>L.</given-names></name> <name><surname>Hana</surname> <given-names>K.</given-names></name> <name><surname>Hanakova</surname> <given-names>L.</given-names></name> <etal/></person-group>. (<year>2014</year>). <article-title>&#x0201C;Study of heart rate as the main stress indicator in aircraft pilots,&#x0201D;</article-title> in <source>Proceedings of the 16th International Conference on Mechatronics-Mechatronika (Brno)</source>, 639&#x02013;643. <pub-id pub-id-type="doi">10.1109/MECHATRONIKA.2014.7018334</pub-id><pub-id pub-id-type="pmid">26099122</pub-id></citation></ref>
<ref id="B86">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rivera</surname> <given-names>J.</given-names></name> <name><surname>Talone</surname> <given-names>A. B.</given-names></name> <name><surname>Boesser</surname> <given-names>C. T.</given-names></name> <name><surname>Jentsch</surname> <given-names>F.</given-names></name> <name><surname>Yeh</surname> <given-names>M.</given-names></name></person-group> (<year>2014</year>). <article-title>Startle and surprise on the flight deck: similarities, differences, and prevalence</article-title>. <source>Proc. Hum. Fact. Ergon. Soc. Ann. Meet</source>. <volume>58</volume>, <fpage>1047</fpage>&#x02013;<lpage>1051</lpage>. <pub-id pub-id-type="doi">10.1177/1541931214581219</pub-id></citation>
</ref>
<ref id="B87">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rooseleer</surname> <given-names>F.</given-names></name> <name><surname>Kirwan</surname> <given-names>B.</given-names></name> <name><surname>Humm</surname> <given-names>E.</given-names></name> <name><surname>Moreno_Alarcon</surname> <given-names>D. P.</given-names></name></person-group> (<year>2022a</year>). <article-title>The application of human factors in wake vortex encounter flight simulations for the reduction of flight upset risk and startle response</article-title>. <source>Hum. Error Reliabil. Resil. Perform.</source> <volume>33</volume>, <fpage>32</fpage>&#x02013;<lpage>42</lpage>. <pub-id pub-id-type="doi">10.54941/ahfe1001565</pub-id></citation>
</ref>
<ref id="B88">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Rooseleer</surname> <given-names>F.</given-names></name> <name><surname>Kling</surname> <given-names>F.</given-names></name> <name><surname>Pasztor</surname> <given-names>A.</given-names></name> <name><surname>Kirwan</surname> <given-names>B.</given-names></name> <name><surname>Humm</surname> <given-names>E.</given-names></name> <name><surname>Borghini</surname> <given-names>G.</given-names></name> <etal/></person-group>. (<year>2022b</year>). <article-title>&#x0201C;A tale of two simulations - the challenges of validating a ground-air collaborative safety alert,&#x0201D;</article-title> in <source>Proceedings of the 32nd European Safety and Reliability Conference</source> (<publisher-loc>Dublin</publisher-loc>). <pub-id pub-id-type="doi">10.3850/978-981-18-5183-4_S31-02-307-cd</pub-id></citation>
</ref>
<ref id="B89">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ruscio</surname> <given-names>D.</given-names></name> <name><surname>Bos</surname> <given-names>A. J.</given-names></name> <name><surname>Ciceri</surname> <given-names>M. R.</given-names></name></person-group> (<year>2017</year>). <article-title>Distraction or cognitive overload? Using modulations of the autonomic nervous system to discriminate the possible negative effects of advanced assistance system</article-title>. <source>Accid. Anal. Prev.</source> <volume>103</volume>, <fpage>105</fpage>&#x02013;<lpage>111</lpage>. <pub-id pub-id-type="doi">10.1016/j.aap.2017.03.023</pub-id><pub-id pub-id-type="pmid">28399463</pub-id></citation></ref>
<ref id="B90">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Schroeder</surname> <given-names>J. A.</given-names></name> <name><surname>Burki-Cohen</surname> <given-names>J. S.</given-names></name> <name><surname>Shikany</surname> <given-names>D.</given-names></name> <name><surname>Gingras</surname> <given-names>D. R.</given-names></name> <name><surname>Desrochers</surname> <given-names>P. P.</given-names></name></person-group> (<year>2014</year>). <article-title>&#x0201C;An evaluation of several stall models for commercial transport training,&#x0201D;</article-title> in <source>AIAA Modeling and Simulation Technologies Conference</source> (<publisher-loc>Reston, VA</publisher-loc>).</citation>
</ref>
<ref id="B91">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schulz</surname> <given-names>A.</given-names></name> <name><surname>Schilling</surname> <given-names>T. M.</given-names></name> <name><surname>V&#x000F6;gele</surname> <given-names>C.</given-names></name> <name><surname>Larra</surname> <given-names>M. F.</given-names></name> <name><surname>Sch&#x000E4;chinger</surname> <given-names>H.</given-names></name></person-group> (<year>2016</year>). <article-title>Respiratory modulation of startle eye blink: a new approach to assess afferent signals from the respiratory system</article-title>. <source>Philos. Transact. R. Soc. B Biol. Sci.</source> <volume>371</volume>, <fpage>20160019</fpage>. <pub-id pub-id-type="doi">10.1098/rstb.2016.0019</pub-id><pub-id pub-id-type="pmid">28080976</pub-id></citation></ref>
<ref id="B92">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Schwarz</surname> <given-names>L. A.</given-names></name> <name><surname>Luo</surname> <given-names>L.</given-names></name></person-group> (<year>2015</year>). <article-title>Organization of the locus coeruleus-norepinephrine system</article-title>. <source>Curr. Biol.</source> <volume>25</volume>, <fpage>R1051</fpage>&#x02013;<lpage>R1056</lpage>. <pub-id pub-id-type="doi">10.1016/j.cub.2015.09.039</pub-id><pub-id pub-id-type="pmid">26528750</pub-id></citation></ref>
<ref id="B93">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sciaraffa</surname> <given-names>N.</given-names></name> <name><surname>Di Flumeri</surname> <given-names>G.</given-names></name> <name><surname>Germano</surname> <given-names>D.</given-names></name> <name><surname>Giorgi</surname> <given-names>A.</given-names></name> <name><surname>Di Florio</surname> <given-names>A.</given-names></name> <name><surname>Borghini</surname> <given-names>G.</given-names></name> <etal/></person-group>. (<year>2022</year>). <article-title>Validation of a light EEG-based measure for real-time stress monitoring during realistic driving</article-title>. <source>Brain Sci.</source> <volume>12</volume>, <fpage>3</fpage>. <pub-id pub-id-type="doi">10.3390/brainsci12030304</pub-id><pub-id pub-id-type="pmid">35326261</pub-id></citation></ref>
<ref id="B94">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sehlstr&#x000F6;m</surname> <given-names>M.</given-names></name> <name><surname>Ljungberg</surname> <given-names>J. K.</given-names></name> <name><surname>Claeson</surname> <given-names>A.</given-names></name> <name><surname>Nystr&#x000F6;m</surname> <given-names>M. B. T.</given-names></name></person-group> (<year>2022</year>). <article-title>The relation of neuroticism to physiological and behavioral stress responses induced by auditory startle</article-title>. <source>Brain Behav.</source> <volume>12</volume>, <fpage>e2554</fpage>. <pub-id pub-id-type="doi">10.1002/brb3.2554</pub-id><pub-id pub-id-type="pmid">35403836</pub-id></citation></ref>
<ref id="B95">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Selye</surname> <given-names>H.</given-names></name></person-group> (<year>1950</year>). <article-title>Stress and the general adaptation syndrome</article-title>. <source>Br. Med. J.</source> <volume>1</volume>, <fpage>1383</fpage>&#x02013;<lpage>1392</lpage>.</citation>
</ref>
<ref id="B96">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Selye</surname> <given-names>H.</given-names></name></person-group> (<year>1956</year>). <source>The Stress of Life</source>. McGraw-Hill. <pub-id pub-id-type="doi">10.1001/jama.1975.03260050042018</pub-id><pub-id pub-id-type="pmid">25996397</pub-id></citation></ref>
<ref id="B97">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shao</surname> <given-names>S.</given-names></name> <name><surname>Zhou</surname> <given-names>Q.</given-names></name> <name><surname>Liu</surname> <given-names>Z.</given-names></name></person-group> (<year>2019</year>). <article-title>A New assessment method of the pilot stress using ECG signals during complex special flight operation</article-title>. <source>IEEE Access</source> <volume>7</volume>, <fpage>185360</fpage>&#x02013;<lpage>185368</lpage>. <pub-id pub-id-type="doi">10.1109/ACCESS.2019.2959626</pub-id></citation>
</ref>
<ref id="B98">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Sheridan</surname> <given-names>T. B.</given-names></name></person-group> (<year>1981</year>). <article-title>&#x0201C;Understanding human error and aiding human diagnostic behaviour in nuclear power plants,&#x0201D;</article-title> in <source>Human Detection and Diagnosis of System Failures. NATO Conference Series</source>, Vol 15, eds J. Rasmussen and W. B. Rouse (<publisher-loc>Boston</publisher-loc>: <publisher-name>Springer</publisher-name>). <pub-id pub-id-type="doi">10.1007/978-1-4615-9230-3_3</pub-id></citation>
</ref>
<ref id="B99">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Spangler</surname> <given-names>C.</given-names></name> <name><surname>Park</surname> <given-names>A.</given-names></name></person-group> (<year>2010</year>). <article-title>&#x0201C;Loss of control on approach colgan air, Inc., Operating as Continental Connection Flight 3407 Bombardier DHC-8-400, N200WQ Clarence Center, New York February 12, 2009,&#x0201D;</article-title> in <source>ACM SIGGRAPH 2010 Dailies. SIGGRAPH &#x00027;10</source> (<publisher-loc>New York, NY, USA</publisher-loc>: <publisher-name>Association for Computing Machinery</publisher-name>). <pub-id pub-id-type="doi">10.1145/1834518.1834525</pub-id></citation>
</ref>
<ref id="B100">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sternbach</surname> <given-names>R. A.</given-names></name></person-group> (<year>1960</year>). <article-title>Correlates of differences in time to recover from startle</article-title>. <source>Psychosom. Med.</source> <volume>22</volume>, <fpage>143</fpage>&#x02013;<lpage>148</lpage>. <pub-id pub-id-type="doi">10.1097/00006842-196003000-00006</pub-id><pub-id pub-id-type="pmid">13834479</pub-id></citation></ref>
<ref id="B101">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Talone</surname> <given-names>A.</given-names></name> <name><surname>Rivera</surname> <given-names>J.</given-names></name> <name><surname>Jimenez</surname> <given-names>C.</given-names></name> <name><surname>Jentsch</surname> <given-names>F.</given-names></name></person-group> (<year>2015</year>). <article-title>&#x0201C;Evaluating startle, surprise, and distraction: an analysis of aircraft incident and accident reports,&#x0201D;</article-title> in <source>18th International Symposium on Aviation Psychology</source> (<publisher-loc>Dayton, OH</publisher-loc>), <fpage>278</fpage>&#x02013;<lpage>283</lpage>. Available online at: <ext-link ext-link-type="uri" xlink:href="https://corescholar.libraries.wright.edu/isap_2015/60">https://corescholar.libraries.wright.edu/isap_2015/60</ext-link></citation>
</ref>
<ref id="B102">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Thackray</surname> <given-names>R. I.</given-names></name></person-group> (<year>1965</year>). <article-title>Correlates of reaction time to startle</article-title>. <source>Hum. Fact.</source> <volume>7</volume>, <fpage>74</fpage>&#x02013;<lpage>80</lpage>. <pub-id pub-id-type="doi">10.1177/001872086500700109</pub-id><pub-id pub-id-type="pmid">5832330</pub-id></citation></ref>
<ref id="B103">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Thackray</surname> <given-names>R. I.</given-names></name></person-group> (<year>1988</year>). <source>Performance Recovery Following Startle: A Laboratory Approach to the Study of Behavioral Response to Sudden Aircraft Emergencies (DOT/FAA/AM-88/4)</source>. Available online at: <ext-link ext-link-type="uri" xlink:href="https://trid.trb.org/view/643595">https://trid.trb.org/view/643595</ext-link> (accessed January 15, 2023).</citation>
</ref>
<ref id="B104">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Thackray</surname> <given-names>R. I.</given-names></name> <name><surname>Touchstone</surname> <given-names>R. M.</given-names></name></person-group> (<year>1970</year>). <article-title>Recovery of motor performance following startle</article-title>. <source>Percept. Mot. Skills</source> <volume>30</volume>, <fpage>279</fpage>&#x02013;<lpage>292</lpage>. <pub-id pub-id-type="doi">10.2466/pms.1970.30.1.279</pub-id><pub-id pub-id-type="pmid">5476117</pub-id></citation></ref>
<ref id="B105">
<citation citation-type="web"><person-group person-group-type="author"><name><surname>Thackray</surname> <given-names>R. I.</given-names></name> <name><surname>Touchstone</surname> <given-names>R. M.</given-names></name></person-group> (<year>1983</year>). <source>Rate of Initial Recovery and Subsequent Radar Monitoring Performance Following a Simulated Emergency Involving Startle</source>. <publisher-loc>Washington, DC</publisher-loc>: <publisher-name>Federal Aviation Administration</publisher-name>. Available online at: <ext-link ext-link-type="uri" xlink:href="https://rosap.ntl.bts.gov/view/dot/21242">https://rosap.ntl.bts.gov/view/dot/21242</ext-link></citation>
</ref>
<ref id="B106">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tichon</surname> <given-names>J. G.</given-names></name> <name><surname>Mavin</surname> <given-names>T.</given-names></name> <name><surname>Wallis</surname> <given-names>G.</given-names></name> <name><surname>Visser</surname> <given-names>T. A.</given-names></name> <name><surname>Riek</surname> <given-names>S.</given-names></name></person-group> (<year>2014</year>). <article-title>Using pupillometry and electromyography to track positive and negative affect during flight simulation</article-title>. <source>Aviat. Psychol. Appl. Hum. Fact</source>. <volume>4</volume>, <fpage>23</fpage>&#x02013;<lpage>32</lpage>. <pub-id pub-id-type="doi">10.1027/2192-0923/a000052</pub-id></citation>
</ref>
<ref id="B107">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tyler</surname> <given-names>P.</given-names></name> <name><surname>Cushway</surname> <given-names>D.</given-names></name></person-group> (<year>1995</year>). <article-title>Stress in nurses: the effects of coping and social support</article-title>. <source>Stress Med.</source> <volume>11</volume>, <fpage>243</fpage>&#x02013;<lpage>251</lpage>. <pub-id pub-id-type="doi">10.1002/smi.2460110140</pub-id><pub-id pub-id-type="pmid">31566806</pub-id></citation></ref>
<ref id="B108">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Vermetten</surname> <given-names>E.</given-names></name> <name><surname>Charney</surname> <given-names>D. S.</given-names></name> <name><surname>Bremner</surname> <given-names>J. D.</given-names></name></person-group> (<year>2002</year>). <article-title>&#x0201C;Anxiety,&#x0201D;</article-title> in <source>Encyclopedia of the Human Brain</source>, ed V. S. Ramachandran (<publisher-loc>New York, NY</publisher-loc>: <publisher-name>Academic Press</publisher-name>), <fpage>159</fpage>&#x02013;<lpage>180</lpage>.</citation>
</ref>
<ref id="B109">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Vlasak</surname> <given-names>M.</given-names></name></person-group> (<year>1969</year>). <article-title>Effect of startle stimuli on performance</article-title>. <source>Aerosp. Med.</source> <volume>40</volume>, <fpage>124</fpage>&#x02013;<lpage>128</lpage>. <pub-id pub-id-type="doi">10.1001/archinte.1969.00300170130051</pub-id><pub-id pub-id-type="pmid">25996397</pub-id></citation></ref>
<ref id="B110">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Vuilleumier</surname> <given-names>P.</given-names></name> <name><surname>Richardson</surname> <given-names>M. P.</given-names></name> <name><surname>Armony</surname> <given-names>J. L.</given-names></name> <name><surname>Driver</surname> <given-names>J.</given-names></name> <name><surname>Dolan</surname> <given-names>R. J.</given-names></name></person-group> (<year>2004</year>). <article-title>Distant influences of amygdala lesion on visual cortical activation during emotional face processing</article-title>. <source>Nat. Neurosci.</source> <volume>7</volume>, <fpage>1271</fpage>&#x02013;<lpage>1278</lpage>. <pub-id pub-id-type="doi">10.1038/nn1341</pub-id><pub-id pub-id-type="pmid">15494727</pub-id></citation></ref>
<ref id="B111">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wang</surname> <given-names>F.</given-names></name> <name><surname>Yang</surname> <given-names>J.</given-names></name> <name><surname>Pan</surname> <given-names>F.</given-names></name> <name><surname>Ho</surname> <given-names>R. C.</given-names></name> <name><surname>Huang</surname> <given-names>J. H.</given-names></name></person-group> (<year>2020</year>). <article-title>Editorial: neurotransmitters and emotions</article-title>. <source>Front. Psychol.</source> <volume>11</volume>, <fpage>21</fpage>. <pub-id pub-id-type="doi">10.3389/fpsyg.2020.00021</pub-id><pub-id pub-id-type="pmid">32116891</pub-id></citation></ref>
<ref id="B112">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Weigmann</surname> <given-names>D. A.</given-names></name> <name><surname>Shappell</surname> <given-names>S. A.</given-names></name></person-group> (<year>1997</year>). <article-title>Human factors analysis of postaccident data: applying theoretical taxonomies of human error</article-title>. <source>Int. J. Aviat. Psychol.</source> <volume>7</volume>, <fpage>67</fpage>&#x02013;<lpage>81</lpage>. <pub-id pub-id-type="doi">10.1207/s15327108ijap0701_4</pub-id></citation>
</ref>
<ref id="B113">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Woodhead</surname> <given-names>M. M.</given-names></name></person-group> (<year>1969</year>). <article-title>Performing a visual task in the vicinity of reproduced sonic bangs</article-title>. <source>J. Sound Vib.</source> <volume>9</volume>, <fpage>121</fpage>&#x02013;<lpage>125</lpage>. <pub-id pub-id-type="doi">10.1016/0022-460X(69)90269-7</pub-id></citation>
</ref>
<ref id="B114">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Xie</surname> <given-names>Y.</given-names></name> <name><surname>Zhou</surname> <given-names>R.</given-names></name> <name><surname>Qu</surname> <given-names>J.</given-names></name></person-group> (<year>2022</year>). <article-title>Fitts&#x00027; law on the flight deck: evaluating touchscreens for aircraft tasks in actual flight scenarios</article-title>. <source>Ergonomics</source> 1&#x02013;18. <pub-id pub-id-type="doi">10.1080/00140139.2022.2097318</pub-id><pub-id pub-id-type="pmid">35786415</pub-id></citation></ref>
<ref id="B115">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Yeomans</surname> <given-names>J. S.</given-names></name> <name><surname>Frankland</surname> <given-names>P. W.</given-names></name></person-group> (<year>1995</year>). <article-title>The acoustic startle reflex: neurons and connections</article-title>. <source>Brain Res. Rev.</source> <volume>21</volume>, <fpage>301</fpage>&#x02013;<lpage>314</lpage>. <pub-id pub-id-type="doi">10.1016/0165-0173(96)00004-5</pub-id><pub-id pub-id-type="pmid">8806018</pub-id></citation></ref>
<ref id="B116">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Young</surname> <given-names>M. S.</given-names></name> <name><surname>Stanton</surname> <given-names>N. A.</given-names></name></person-group> (<year>2002</year>). <article-title>Malleable attentional resources theory: a new explanation for the effects of mental underload on performance</article-title>. <source>Hum. Fact.</source> <volume>44</volume>, <fpage>365</fpage>&#x02013;<lpage>375</lpage>. <pub-id pub-id-type="doi">10.1518/0018720024497709</pub-id><pub-id pub-id-type="pmid">12502155</pub-id></citation></ref>
<ref id="B117">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ziperman</surname> <given-names>H. H.</given-names></name> <name><surname>Smith</surname> <given-names>G. R.</given-names></name></person-group> (<year>1975</year>). <article-title>Startle reaction to air-bag restraints</article-title>. <source>JAMA</source> <volume>233</volume>, <fpage>436</fpage>&#x02013;<lpage>440</lpage>.</citation>
</ref>
</ref-list> 
</back>
</article> 