ORIGINAL RESEARCH article
Front. Neurorobot.
Volume 19 - 2025 | doi: 10.3389/fnbot.2025.1630728
A Robust and Effective Framework for 3D Scene Reconstruction and High-Quality Rendering in Nasal Endoscopy Surgery
Provisionally accepted
- 1Department of Ultrasound, Peking University First Hospital Ningxia Women and Children’s Hospital, Yinchuan, China
- 2The Third School of Clinical Medicine, Ningxia Medical University, Yinchuan, China
- 3Fudan University, Shanghai, China
- 4Shanghai Key Laboratory of Medical Imaging Computing and Computer Assisted Intervention, Shanghai, China
- 5Department of Hepatobiliary Surgery, General Hospital of Ningxia Medical University, Yinchuan, China
Select one of your emails
You have multiple emails registered with Frontiers:
Notify me on publication
Please enter your email address:
If you already have an account, please login
You don't have a Frontiers account ? You can register here
In nasal endoscopic surgery, the narrow nasal cavity restricts the surgical field of view and the manipulation of surgical instruments. Therefore, precise real-time intraoperative navigation, which can provide precise 3D information, plays a crucial role in avoiding critical areas with dense blood vessels and nerves. Although significant progress has been made in endoscopic 3D reconstruction methods, their application in nasal scenarios still faces numerous challenges. On the one hand, there is a lack of high-quality, annotated nasal endoscopy datasets. On the other hand, issues such as motion blur and soft tissue deformations complicate the nasal endoscopy reconstruction process. To tackle these challenges, a seriesof nasal endoscopy examination videos are collected, and the pose information for each frame is recorded. Additionally, a novel model named Mip-EndoGS is proposed, which integrates 3D Gaussian Splatting for reconstruction and rendering and a diffusion module to reduce image blurring in endoscopic data. Meanwhile, by incorporating an adaptive low-pass filter into the rendering pipeline, the aliasing artifacts (jagged edges) are mitigated, which occur during the rendering process.Extensive quantitative and visual experiments show that the proposed model is capable of reconstructing 3D scenes within the nasal cavity in real-time, thereby offering surgeons more detailed and precise information about the surgical scene.
Keywords: Nasal endoscopy, 3D Reconstruction, 3D Gaussian Splatting, diffusion model, Anti-aliasing
Received: 18 May 2025; Accepted: 29 May 2025.
Copyright: © 2025 Ji, Zhao, Liu, Wang and Chen. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
* Correspondence:
Feng Wang, Department of Hepatobiliary Surgery, General Hospital of Ningxia Medical University, Yinchuan, China
Xinrong Chen, Fudan University, Shanghai, China
Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.