AUTHOR=Cheng Dapeng , Qiu Nuan , Zhao Feng , Mao Yanyan , Li Chengnuo 

TITLE=Research on the Modality Transfer Method of Brain Imaging Based on Generative Adversarial Network

JOURNAL=Frontiers in Neuroscience

VOLUME=Volume 15 - 2021

YEAR=2021

URL=https://www.frontiersin.org/journals/neuroscience/articles/10.3389/fnins.2021.655019

DOI=10.3389/fnins.2021.655019

ISSN=1662-453X

ABSTRACT=Brain imaging technology is an important means to study brain diseases. The commanly used brain imaging technologies are fMRI and EEG. Clinical practice has shown that although fMRI is superior to EEG in observing the anatomical details of some diseases that are difficult to diagnose, its costs is prohibitive. In particular, more and more patients who use metal implants cannot use this technology. In contrast, EEG technology is easier to implement. Therefore, in order to break through the limitations of fMRI technology, we propose a brain imaging modality transfer framework, namely BMT-GAN, based on generative adversarial network. The framework introduces a new non-adversarial loss to reduce the perception and style difference between input and output images. It also realizes the conversion from EEG modality data to fMRI modality data, and provides comprehensive reference information of EEG and fMRI for radiologists. Finally, a qualitative and quantitative comparison with the existing GAN-based brain imaging modality transfer approachs demonstrates the superiority of our framework.