Your new experience awaits. Try the new design now and help us make it even better

ORIGINAL RESEARCH article

Front. Virtual Real.

Sec. Haptics

Volume 6 - 2025 | doi: 10.3389/frvir.2025.1616442

Neuroadaptive Haptics: A Proof-of-concept Comparing Reinforcement Learning from Explicit Ratings and Neural Signals for Adaptive XR Systems

Provisionally accepted
  • 1Technical University of Berlin, Berlin, Germany
  • 2Brandenburg University of Technology Cottbus-Senftenberg, Senftenberg, Brandenburg, Germany

The final, formatted version of the article will be published soon.

Neuroadaptive haptics offers a promising path to immersive extended reality (XR) by dynamically tuning multisensory feedback to user preferences. We present a system that adapts XR haptic rendering through reinforcement learning (RL), using either explicit user ratings or implicit signals decoded from Electroencephalography (EEG). In a user study, participants interacted with virtual objects in VR while EEG data were recorded and decoded to infer user experience. Our neural decoder achieved a mean F1 score of 0.8, supporting informative but noisy classification. In two RL conditions, haptic parameters were adapted based on either explicit or implicit rewards, with exploratory findings indicating unstable agent behavior. A limited number of interaction steps likely constrained exploration and contributed to convergence instability. Revisiting interaction design to support more frequent sampling may improve robustness to EEG noise and rating drift. By demonstrating RL-based adaptation from implicit neural signals, our proof-of-concept is a step towards seamless, low-friction personalization in XR.

Keywords: human-computer interaction, reinforcement learning, RLHF, Brain-computer interface, EEG

Received: 22 Apr 2025; Accepted: 24 Jul 2025.

Copyright: © 2025 Gehrke, Koselevs, Klug and Gramann. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

* Correspondence: Lukas Gehrke, Technical University of Berlin, Berlin, Germany

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.