ORIGINAL RESEARCH article
Front. Comput. Sci.
Sec. Human-Media Interaction
Next-Gen Orientation: Supporting International Students with Generative AI NPCs in VR
Santiago Berrezueta-Guzman
Stefan Wagner
Technical University of Munich, Munich, Germany
Select one of your emails
You have multiple emails registered with Frontiers:
Notify me on publication
Please enter your email address:
If you already have an account, please login
You don't have a Frontiers account ? You can register here
Abstract
Educational Virtual Reality (VR) provides immersive learning environments, yet most contemporary applications rely on pre-scripted Non-Player Characters (NPCs) that offer limited personalization and rigid interaction paths. This study presents the technical implementation and evaluation of TUMSphere, a VR orientation platform designed to facilitate the academic and cultural transition of international students. We propose a modular architecture that integrates Large Language Models (LLMs) with Unreal Engine via the Conversational AI (Convai) platform, enabling embodied NPCs to provide real-time speech recognition, context-aware dialogue, and autonomous spatial navigation. To validate this approach, a mixed-methods user study (N=24) was conducted with international students to assess system latency, usability, and pedagogical efficacy. Results demonstrate a high System Usability Scale (SUS) score of 76.4 (SD=12.5) and robust task completion rates, reaching 100% for spatial navigation and 96% for information retrieval. While technical benchmarking revealed an average end-to-end latency of 2.90s for complex, retrieval-heavy queries, qualitative findings indicate that users find this "latency-presence trade-off'' acceptable in exchange for the pedagogical benefits. Crucially, participants reported a significant reduction in social anxiety when practicing language and administrative queries with AI agents compared to human interlocutors. These findings suggest that embodied, generative AI NPCs can serve as a scalable, low-pressure "social sandbox'' that effectively redefines student support systems and orientation strategies in higher education.
Summary
Keywords
Convai, educational games, Intelligent NPC Interactions, Lip-sync, LLMS, NPCs, speech recognition, Speech-to-text
Received
29 January 2026
Accepted
20 February 2026
Copyright
© 2026 Berrezueta-Guzman and Wagner. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Santiago Berrezueta-Guzman
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.