AUTHOR=Ebato Yuki , Saki Tomita , Wakita Isshu , Ueno Ayumu , Ishibashi Tomoaki , Takahashi Tetsuya , Nobukawa Sou 

TITLE=Evaluating multimodal physiological signals for fear detection: relative utility of pupillometry, heart rate, and EEG

JOURNAL=Frontiers in Human Neuroscience

VOLUME=Volume 19 - 2025

YEAR=2025

URL=https://www.frontiersin.org/journals/human-neuroscience/articles/10.3389/fnhum.2025.1605577

DOI=10.3389/fnhum.2025.1605577

ISSN=1662-5161

ABSTRACT=IntroductionFear is a fundamental emotion essential for survival; however, excessive fear can lead to anxiety disorders and other adverse consequences. Monitoring fear states is crucial for timely intervention and improved mental well-being. Although functional magnetic resonance imaging (fMRI) has provided valuable insights into the neural networks associated with fear, its high cost and environmental constraints limit its practical application in daily life. Electroencephalography (EEG) offers a more accessible alternative but struggles to capture deep brain activity. Physiological measures such as pupil dynamics and heart rate can provide indirect insights into these deeper processes, yet they are often studied in isolation. In this context, we aimed to evaluate the practical effectiveness and limitations of a multimodal approach that combines pupil dynamics and heart rate—indirect indicators of deep brain activity—with EEG, a temporally precise but spatially limited measure of cortical responses.MethodsWe simultaneously recorded EEG, pupillometry, and heart rate in 40 healthy male participants exposed to fear-inducing and neutral visual stimuli, while also assessing their psychological states.ResultsFear-inducing stimuli elicited distinct physiological responses, including increased occipital theta power, pupil dilation, and decreased heart rate. Notably, pupil size was the most sensitive discriminator of emotional state, though the integration of modalities yielded only limited improvement in classification accuracy.DiscussionThese findings provide empirical support for the feasibility of multimodal physiological monitoring of fear and underscore the need for further refinement for real-world applications.