EVALUATING THE ACCURACY OF GENERATIVE ARTIFICIAL INTELLIGENCE MODELS IN DENTAL AGE ESTIMATION BASED ON THE DEMIRJIAN'S METHOD

Allan Abuabara¹Thais Vilalba Paniagua Machado do Nascimento²Seandra Maria Trentini¹Angela Mairane Costa Gonçalves¹Maria Angélica Hueb De Menezes Oliveira³Isabela Madalena³Svenja Beisel-Memmert⁴Christian Kirschneck⁴Livia Antunes⁵Cristiano Miranda de Araujo²Flares Baratto-Filho²Erika Kuchler^6*

• ¹Universidade da Regiao de Joinville, Palhoa, Brazil
• ²Universidade Tuiuti do Parana, Curitiba, Brazil
• ³Universidade de Uberaba, Uberaba, Brazil
• ⁴Universitatsklinikum Bonn, Bonn, Germany
• ⁵Universidade Federal Fluminense, Niteri, Brazil
• ⁶University of Bonn, Bonn, Germany

Dental age estimation plays a key role in forensic identification, clinical diagnosis, treatment planning, and prognosis in fields such as pediatric dentistry and orthodontics. Large language models (LLM) are increasingly being recognized for their potential applications in Dentistry.This study aimed to compare the performance of currently available generative artificial intelligence LLM technologies in estimating dental age using the Demirjian's scores.Panoramic radiographs were analyzed using Demirjian's method (1973), with each left permanent mandibular tooth classified from stage A to H. Untrained LLM, ChatGPT (GPT-4turbo), Gemini 2.0 Flash, and DeepSeek-V3 were tasked with estimating dental age based on the patient's Demirjian score for each tooth. Due to the probabilistic nature of ChatGPT, Gemini, and DeepSeek, which can produce varying responses to the same question, three responses were collected per case per day (three different computers) from each model on three separate days. The age estimates obtained from LLM were compared to the individuals' chronological ages. Intra-and inter-examiner reliability was assessed using the Intraclass Correlation Coefficient (ICC). Model performance was evaluated using Mean Absolute Error (MAE), Root Mean Squared Error (RMSE), Coefficient of Determination (R²), and Bias. Thirty panoramic radiographs (40% female, 60% male; mean age 10.4 ± 2.32 years) were included. Both intra-and inter-examiner ICC values exceeded 0.85. ChatGPT and DeepSeek exhibited comparable but suboptimal performance, with higher errors (MAE: 1.98-2.05 years; RMSE: 2.33-2.35 years), negative R² values (-0.069 to -0.049), and substantial overestimation biases (1.90-1.91 years), indicating poor model fit and systematic flaws. Gemini demonstrated intermediate results, with a moderate MAE (1.57 years) and RMSE (1.81 years), a positive R² (0.367), and a lower bias (1.32 years).In conclusion, this study demonstrated that, although LLM like ChatGPT, Gemini, and DeepSeek can estimate dental age using Demirjian's scores, their performance remains inferior to the traditional method. Among them, DeepSeek-V3 showed the best results, but all models require task-specific training and validation before clinical application.