A Lightweight Triple-Modal Fusion Network for Progressive Mild Cognitive Impairment Prediction in Alzheimer's Disease

Xiangyu Shen¹Xiangyang Hu¹Renfeng Zhang²Yunzhan Fu¹Jiamin Xu¹Degang Lyu³Hongbiao Xie^1,4Deen Shi⁵Changsheng Shi⁶Lisi Li^7*Yuantong Gao^5*

• ¹Hangzhou Dianzi University, Hangzhou, China
• ²Department of Laboratory Medicine, Shandong Provincial Hospital Affiliated to Shandong First Medical University, Jinan, China
• ³Department of Radiation Oncology, Shenzhen People's Hospital (the Second Clinical Medical College, Ji'nan University; the First Affiliated Hospital of Southern University of Science and Technology), Shenzhen, China
• ⁴School of Information Technology, Zhejiang Institute of Economics and Trade, Hangzhou, China
• ⁵Department of Radiology, The Third Affiliated Hospital of Wenzhou Medical University, Wenzhou, China
• ⁶Department of Interventional Vascular Surgery, the Third Affiliated Hospital of Wenzhou Medical University, Wenzhou, China
• ⁷Shenzhen Hospital of Southern Medical University, Shenzhen, China

As a progressive neurodegeneration, Alzheimer's disease (AD) represents the primary etiology of dementia among the elderly. Early identification of individuals with mild cognitive impairment (MCI) who are likely to convert to AD is essential for timely diagnosis and therapeutic intervention.Although multimodal neuroimaging and clinical data provide complementary information, existing fusion models often face challenges such as high computational complexity and limited interpretability. To address these limitations, we introduce TriLightNet, an innovative lightweight triple-modal fusion network designed to integrate structural MRI, functional PET, and clinical tabular data for predicting MCI-to-AD conversion. TriLightNet incorporates a hybrid backbone that combines Kolmogorov-Arnold Networks with PoolFormer for efficient feature extraction. Additionally, it introduces a Hybrid Block Attention Module to capture subtle interactions between image and clinical features and employs a MultiModal Cascaded Attention mechanism to enable progressive and efficient fusion across the modalities. These components work together to streamline multimodal data integration while preserving meaningful insights. Extensive experiments conducted on the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset demonstrate the effectiveness of TriLightNet, showcasing superior performance compared to stateof-the-art methods. Specifically, the model achieves an accuracy of 81.25%, an AUROC of 0.8146, 1 Sample et al.and an F1-score of 69.39%, all while maintaining reduced computational costs. Furthermore, its interpretability was validated using the Integrated Gradients method, which revealed clinically relevant brain regions contributing to the predictions, enhancing its potential for meaningful clinical application. Our code is available at https://github.com/sunyzhi55/TriLightNet.