AUTHOR=Guo Weizhou , Liang Wenbin , Deng Qingchun , Zou Xianchun 

TITLE=A Multimodal Affinity Fusion Network for Predicting the Survival of Breast Cancer Patients

JOURNAL=Frontiers in Genetics

VOLUME=Volume 12 - 2021

YEAR=2021

URL=https://www.frontiersin.org/journals/genetics/articles/10.3389/fgene.2021.709027

DOI=10.3389/fgene.2021.709027

ISSN=1664-8021

ABSTRACT=Accurate survival prediction of breast cancer holds significant meaning for improving patient care. Approaches using multiple heterogeneous modalities such as gene expression, copy number alteration and clinical data have showed significant advantages to those with only one modality for patient survival prediction. However, existing survival prediction methods tend to ignore the structured information between patients and multimodal data. We propose a multimodal data fusion model based on a novel affinity fusion network (MAFN). Firstly, a stack-based shallow self-attention network is utilized to guide the amplification of tiny lesion regions on the original data, which locates and enhances the survival-related features. Then, we devise and insert affinity fusion module into the network to map the structured information between patients and multimodal data. The module endows the network with a stronger fusion feature representation and discrimination capability. Finally, the fusion feature embedding and the specific feature embedding from a triple modal network are fused to make the classification of long-term survival or short-term survival for each patient. As expected, the evaluation results on comprehensive performance indicate that MAFN achieves better predictive performance than existing methods. Additionally, our method can be extended to the survival prediction of other cancer diseases, providing a new strategy for other diseases prognosis.