Abstract
Magnetic Resonance Imaging (MRI) is an indispensable tool in the diagnosis of brain diseases due to painlessness and safety. Nevertheless, Rician noise is inevitably injected during the image acquisition process, which leads to poor observation and interferes with the treatment. Owing to the complexity of Rician noise, using the elimination method of Gaussian to remove it does not perform well. Therefore, the feature fusion and attention network (FFA-DMRI) is proposed to separate noise from observed MRI. Inspired by the attention-guided CNN network (ADNet) and Convolutional block attention module (CBAM), a spatial attention mechanism has been specially designed to obtain the area of interest in MRI. Furthermore, the feature fusion block concatenates local with global information, which makes full use of the multilevel structure and boosts the expressive ability of network. The comprehensive experiments on Alzheimer’s disease neuroimaging initiative dataset (ADNI) have demonstrated high effectiveness of FFA-DMRI with maintaining the crucial brain details. Moreover, in terms of visual inspections, the denoising results are also consistent with human perception.
Introduction
Magnetic Resonance Imaging (MRI) of brains, with the superior features of non-radiation, non-invasiveness, and high resolution, is notable for diagnosis and treatment (; ; ; ). In clinical practice, high-quality MRI can provide clear structural and functional information on brain tissues. However, noise is introduced into the raw image due to the circulation of magnetic fields and the interaction of magnets in MRI machines, which may hide the details of brain tissues and hinder the auto-computerized analysis (). Therefore, noise removal is a vital task to recover the clean MRI before the images are applied to diagnosis.
Previous research has established that the noise in MRI is governed by the Rician distribution, in which both real and imaginary parts are corrupted by Gaussian noise with equal variance (; ). The Rician distribution is signal-dependent as distinct from additive Gaussian noise. In other words, Rician noise is related to the image, and utilizing Gaussian denoising methods directly to remove it usually yields poor results. Thus, the right way to separate noise from the raw MRI without losing critical details is a huge challenge ().
With the increasing demand for image quality, a number of methods have been proposed for denoising. Existing methods can be mainly classified into two categories: transform domain methods and filtering methods (). The purpose of the transform domain method is to convert the original signal into a pattern that can remove noise more easily. For instance, a bilateral filtering scheme was proposed based on wavelets, in which the noise coefficient is expressed effectively by an undecimated wavelet transform (UDWT). There is a nice trade-off between the effect of noise removal and feature retention (; ). Based on wavelet shrinkage, the iterative scheme estimates the signal wavelet coefficients from the noisy images (). For signal high-dimensional singularities, wavelet transform does not perform well. Curvelet transform makes up for the shortcomings (). In this transform, edge directions are reproduced using the directivity and anisotropy of the curve (). However, the wavelet transform fails to resolve the curve with smooth edges. To overcome the drawback, a geometrical image transform was proposed, which greatly captures contours and details in MRI.
The filter methods, generally grouped into linear and non-linear parts, are adapted to remove noise in MRI. For linear filters, spatial filters and temporal filters are commonly employed (; ). Relatively, a spatial filter decreases the variance in MRI; however, it faces shortcomings in that it introduces the blurring of edges, which results in part of the required information that cannot be restored correctly (). Temporal filters are utilized only to spin-echo images. Furthermore, to prevent the aliasing artifacts, it is essential to select the appropriate filter to match filter sampling intervals. If the filters are too broad or too narrow, the performance is not satisfactory. For non-linear spatial filters, using a linear approach directly is not allowed. There are some typical examples in non-linear filters such as anisotropic diffusion filter (ADF) () and non-local means (NLM) (). The ADF approach obtains the denoising images efficiently with sharp edges. The filter of NLM employs redundant information to restore noise-free images. On the basis of the filter, unbiased NLM () is exploited to improve the SNR in MRI; meanwhile, it does not influence the obvious structures. Nevertheless, the method has the shortcoming of high computational complexity.
Recently, methodologies based on deep learning are used to alleviate the above problem, such as deep plug-and-play super-resolution (DPSR) (), fast and flexible denoising convolutional neural network (FFDNet) (), and variance-stabilizing transformation inspired networks (VST-net) (). VST-net inherits the structures of traditional variance-stabilizing transformation and optimizes non-linear transformation through the design of a deep learning network. That shows the great potential of deep learning for denoising tasks. It is noted that the denoising convolutional neural network (DnCNN) () utilizes batch normalization and residual learning, which exhibits high effectiveness in JPEG image deblocking, single image super-resolution, and Gaussian denoising. Numerous deep learning methods for denoising have achieved outstanding performance. However, most research up to now has focused on the reduction of Gaussian noise, real noise, and blind noise. To our best knowledge, far too little attention has been paid to removing the Rician noise in MRI.
In this work, we propose a feature fusion and attention network (FFA-DMRI) for removing Rician noise in magnetic resonance (MR) images. Inspired by the structure of attention-guided CNN network (ADNet) (), we have designed the FFA-DMRI network to restore noise-free images while maintaining critical brain tissues to the maximum extent possible. The main contributions of this paper are as follows:
- (1)
The proposed FFA-DMRI is dedicated to removing Rician noise in MR images. In contrast to other deep leaning methods for denoising, we specifically develop a spatial attention mechanism to focus on the area-of-interest of the brain.
- (2)
FFA-DMRI network is constructed with three blocks, including the feature extraction block, the feature fusion block, and the attention block. The feature extraction block utilizes the common convolution and the dilated convolution, which expands the receptive field and gains the details effectively. The feature fusion block is designed to combine the local and global features. Consequently, this block obtains more contextual information and promotes the reconstruction of pixels in MR images.
- (3)
The FFA-DMRI network is very superior for denoising on the ADNI dataset. In comparative experiments, it is competitive in quantitative metrics in terms of SSIM and PSNR. From the visual inspection, the denoising results are also in line with the human sense.
Materials and Methods
Rician Noise in MRI
The raw image generated by magnetic resonance equipment is K-space, including the real channel Prand the imaginary channelPi. Both channels are governed by Gaussian noise with equal variance σ2 and a mean value of zero (), which can be given by
where R is the amplitude and α is the phase of raw signal. In addition, ℜ and ℑ denote the independent Gaussian noise which is injected into the real and the imaginary channel, respectively. An inverse discrete Fourier transform () and the modular operation are exploited to reconstruct the MR images, which satisfies the human visual sense. The modular operation can be expressed as follows:
After the non-linear transformation, the noise distribution is converted from Gaussian to Rician (). The probability distribution function (PDF) of Rician noise can be estimated as
where I0 stands for the zeroth-order modified Bessel function () when the discrete grid is utilized to define MRI. From the PDF, it can be inferred that Rician noise is associated with images. For images with different signal-to-noise ratios (SNR), the distributions of Rician noise are disparate. If the value of SNR is relatively high, Rician distribution degenerates into a Gaussian distribution. Conversely, it tends to the Rayleigh distribution in low SNR. Therefore, compared with Gaussian noise, Rician noise is more complicated.
Proposed Method
Network Architecture of FFA-DMRI
Inspired by ADNet (), the FFA-DMRI is proposed to eliminate noise in MRI. Figure 1 illustrates the overall architecture of FFA-DMRI. The network constructed by three sub-networks is as follows: a feature extraction block, a feature fusion block, and an attention block. These blocks correspond to the stages of denoising. Firstly, it employs common convolutions and dilated convolutions to expand the receptive field and acquires the features adequately. Furthermore, the operation of concatenation between global and local information enhances the expressive ability of network. Finally, the attention mechanism guides the network to extract useful information by assigning weights to different spatial positions and channels. The output of the network is the residual MR image and the potential clean image is obtained by subtracting the residual image from the input noisy image.
FIGURE 1
According to the structure of FFA-DMRI, the input of the network is noisy observed MRI, which is defined asS. The FFA-DMRI aims to learn the residual image N as an output rather than the potential clean imageC. Every block is assumed to be a function; hence the execution process of network is defined as
where gex, gfu, and gat denote the functions of the feature extraction, feature fusion, and attention block, respectively. The output N is the mapping of noise in MRI and the potential clean image can be reconstructed by subtracting N from S. The implementations can be expressed as
Feature Extraction Block
It is known that the crucial structural information in complex images is easily hidden, which leads to poor performance in practice. Therefore, extracting the representative features is notoriously hard but vital in deep learning. To overcome this problem, during the course of training, the network of FFA-DMRI is supposed to focus on the interest area of the brain and suppress the insignificant region. Motivated by that, we have designed the spatial attention mechanism inspired by CBAM (), which is suitable for MR images specifically. Figure 2 depicts the spatial attention module with an additional layer of maximum pooling.
FIGURE 2
The attention module simulates the prioritization of visual information in human perception. In order to make the network pay more attention to the extraction of brain structure, an additional layer of maximum pooling is concatenated on the original architecture of CBAM. In this work, we consider another situation in which a spatial attention module is added with a layer of average pooling, as shown in Figure 3.
FIGURE 3
In terms of MR images, the pixels in the background are mostly black, and thus the values are zero. With respect to the brain regions, the pixel values are mostly greater than zero. For average pooling, the operation preserves background information and is suitable for the images where all pixels contribute to the prediction. Thus, average pooling is less applicable to MRI denoising. Relatively, maximum pooling is utilized to extract textures and assists the network in focusing on the brain regions, hence maximum pooling is selected in the module. To sum up, we take advantage of spatial attention to enhance the ability to extract brain features, which results in spending a lower amount of computing resources and achieving outstanding effects.
The batch normalization (BN) operation normalizes the input data; hence, it will destroy the original contrast of MR images. Besides, it has been pointed out that BN is more suitable to map data with regular distribution (). From the generation of Rician noise, it can be determined that the noise is non-linear. Thus, we do not employ the BN operation in the first two convolutions. Furthermore, the extraction of the context plays a crucial role in computer vision applications. For the denoising task, the construction of pixels is closely related to the context information (). In order to obtain more context, dilated convolution is utilized for the network, which enlarges the receptive field without reducing image resolution and losing details. Numerous works have been reported in the validity of dilated convolution (; ). For example, compared with a common convolution-based 3×3 kernel, a dilated convolution can serve a 5×5 or greater receptive field, but no increase in the number of parameters and computations. In FFA-DMRI, we integrate the common convolution and dilated convolution to take full advantage of information.
Feature Fusion Block
AlexNet (), VGG-Net (), and other deep learning models yield excellent results by increasing network layers. Nevertheless, on the one hand, the deeper network presents the phenomenon of gradient explosion and gradient disappearance. On the other hand, with continuous convolution, the effect of shallow features on a deep layer grows weak gradually. Thus, the way to extract high-quality features is pivotal for denoising tasks. To cope with the problem, we apply a lightweight and efficient feature-fusion module to combine low-level and high-level features. The module concatenates the intermediate feature map with the noisy observed MRI at the same scale, which makes full use of the structural information in the shallow network and boosts the network performance.
At the end of the feature fusion block, the two layers employ convolutions with the Rectified Linear Unit activation function (ReLU) and batch normalization. Compared with the sigmoid function, the ReLU function greatly reduces network computation and avoids the problem of gradient disappearance. Additionally, the ReLU function increases the non-linear relationship between the network layers, and thus it is appropriate to process the non-linear Rician noise. In this block, BN yields the distribution of images more stable, which greatly simplifies parameter adjustment and alleviates the problem of gradient disappearance.
Attention Block
In computer vision, the attention mechanism improves the efficiency and accuracy of network to a certain extent. It adjusts the weight of each channel through training in order to enhance the influence of useful channels and suppress the unnecessary channels. Exploring the relationship between channels is beneficial to extract more vital content for the results and improve the denoising performance. In this paper, we exploit the maximum pooling and average pooling to the input feature map first. Furthermore, the two pooling layers are convolved separately. Then a sum of the convolutional layers yields the channel weights (). The structure of channel attention is shown in Figure 4.
FIGURE 4
Loss Function
The loss function guides the further training of the network, and thus the selection of a loss function is directly related to the effect of execution. Different from the existing denoising networks that predict potential clean images directly, FFA-DMRI is able to estimate the residual images. Then subtracting the residual image from the input original image can obtain the clean images. Therefore, we use the mean square error (MSE) () to calculate the gap between the residual images generated by FFA-DMRI and the desired residual images. The desired residual image is obtained by subtracting noise-free image from noisy observed image. The loss function is described as
Where S represents the noisy observed image and G stands for the noise-free image. θ denotes the parameter of FFA-DMRI training. M is the number of noisy-clean training image pairs.
Experiments
Data Acquisition and Training Settings
Deep learning is a data-driven technology. In other words, it requires a large amount of data for training to achieve promising performance. The network of FFA-DMRI is evaluated on the public real brain database of the Alzheimer’s disease neuroimaging initiative (ADNI)1. In our experiments, it consists of 199 three-dimensional (3D) images of brain MRI. We slice each 3D image to get the axial plane and select the slices that range from 37 to 86 due to less information in the head and tail regions. Then Rician noise is injected into images with noise levels of 5, 10, 20, and 30 according to formula (2), respectively. All the images have a resolution of 145×121, and they are divided into three parts; the training set contains 7,800 images, the test set includes 975 images, and the validation set consists of 975 images.
The network is trained with the PyTorch framework in Python and employs the NVIDIA GeForce GTX 960. In some scenarios, adaptive moment estimation (Adam) has better performance than the stochastic gradient descent (SGD) (). Thus, the optimizer used in this experiment is Adam (). The initial learning rate is chosen as 0.0001, and it is reduced by 0.5, 0.25, and 0.125 in the following training. The batch size is set to four due to the trade-off between GPU memory and computational speed.
Qualitative Metrics
There are two popular qualitative metrics to evaluate denoising methods, including peak signal-to-noise ratio (PSNR) and structural similarity index measure (SSIM) (; ). PSNR calculates the distortion between recovered images q(x,y) and ground truthp(x,y). It can be defined as
where M×N is the size of MR images and higher PSNR means the less distortion in images.
The metrics of SSIM is based on three comparative measurements, including luminance, contrast, and structure. Itis more consistent with human visual perception (), that can be obtained by
where up, uq is the average of p, q, respectively. And is the variance of p; denotes the variance of q, and σpq represents the covariance of p and q. To avoid instability, SSIM appends two constants including c1 and c2. The value range of SSIM is [0,1].
Performance Comparison
In order to verify the effectiveness of the proposed FFA-DMRI, comparative experiments are conducted under the same dataset and parameters to guarantee fairness. The results of different denoising schemes are evaluated in terms of quantitative and qualitative metrics. Collectively, we compare the proposed network FFA-DMRI with common denoising algorithms, including NLM (), BM3D (), MRF (), Wiener filter (), WNNM (), IRCNN () and DnCNN ().
Quantitative Metrics
Based on the above Settings, the average PNSR results of different denoising methods are presented in Table 1, and the average SSIM results are reported in Table 2.
TABLE 1
| Noise level λ | BM3D | NLM | Wiener filter | MRF | WNNM | IRCNN | DnCNN | FFA-DMRI (ours) |
| 5 | 28.57 | 31.90 | 21.59 | 25.92 | 33.00 | 39.09 | 39.72 | 39.76 |
| 10 | 25.52 | 26.68 | 20.79 | 23.89 | 27.08 | 34.31 | 34.83 | 35.23 |
| 20 | 21.05 | 21.13 | 18.81 | 20.28 | 21.28 | 29.12 | 30.24 | 30.55 |
| 30 | 18.27 | 18.01 | 17.03 | 18.27 | 17.97 | 26.40 | 27.32 | 27.51 |
The average PSNR/dB results of different methods on the ADNI dataset at different noise levels.
The best results at each noise level are highlighted in bold.
TABLE 2
| Noise level λ | BM3D | NLM | Wiener filter | MRF | WNNM | IRCNN | DnCNN | FFA-DMRI (ours) |
| 5 | 0.5261 | 0.5477 | 0.3314 | 0.4897 | 0.5633 | 0.9914 | 0.9935 | 0.9946 |
| 10 | 0.4439 | 0.3850 | 0.2637 | 0.4117 | 0.4768 | 0.9797 | 0.9815 | 0.9850 |
| 20 | 0.3701 | 0.4654 | 0.2125 | 0.3423 | 0.3839 | 0.9320 | 0.9507 | 0.9586 |
| 30 | 0.3084 | 0.3143 | 0.1762 | 0.3084 | 0.2700 | 0.8907 | 0.9064 | 0.9166 |
The average SSIM results of different methods on the ADNI dataset at different noise levels.
The best results at each noise level are highlighted in bold.
It is known that the Rician noise depends on the images, so removing it is more complicated than Gaussian additive noise. From Table 1, the best result of PSNR at each noise level is shown in bold. It can be observed that the proposed FFA-DMRI outperforms other methods tested. For BM3D and NLM methods, it is difficult to match similar regions at higher noise levels. Besides, searching and matching regions consume much time. Therefore, the traditional method does not perform well on the dataset. It is noted that deep learning methods achieve outstanding denoising results. In particular, among the listed deep learning methods, the proposed FFA-DMRI promotes the removing performance at each noise level. On the specifics, FFA-DMRI exceeds IRCNN 1.43 dB at the noise level of 20 and is superior to DnCNN at every noise level. Additionally, we measured the results of the above methods in terms of SSIM.
The metrics of SSIM indicates that the structural similarity between recovered images and ground truth. As described in Table 2, FFA-DMRI achieves the best performance. It brings an improvement of 2.66% than IRCNN at the noise level of 20. Note that when the noise level is 5, our method tends to the highest value (the highest value in SSIM is 1), which shows that recovered images perfectly restore noise-free images. Besides, the value of SSIM is over 90% at each noise level for FFA-DMRI. Consistent with the results of PSNR, the traditional methods are inferior to the deep learning methods in this dataset. In summary, there is a significant improvement in brain MRI denoising, which reconstructs the latent clean image with maintaining the vital structure information. Thus FFA-DMRI is a competitive denoising method in terms of quantitative analysis.
Qualitative Metrics
In practice, it is indispensable to evaluate image quality through the human senses. In some cases, the metrics of SSIM and PSNR are outstanding in computer vision tasks; however, the images that do not satisfy human perception are distorted. In this paper, we list the visual inspections of comparative experiments as illustrated in Figures 5, 6.
FIGURE 5
FIGURE 6
From Figure 5, we illustrate traditional denoising methods for comparison. It is noticeable that the BM3D and NLM methods can remove a part of noise while generating the blurred structure of brain. Meanwhile, some crucial details in original images are lost. When the concentration of noise increases, the removal effect is worse on speediness with poor visual perception. In Figure 6, visual illustrations of deep learning methods are shown. It can be seen that the effect of deep learning methods is superior to traditional methods, which remove background noise and recover most of the complex brain structures.
In comparison with IRCNN, the proposed FFA-DMRI yields clearer brain tissues and sharper edges after noise removal. The method of DnCNN also achieves excellent results in the experiments; however, FFA-DMRI maintains more subtle features of the original image, and the contrast between brain regions and background is stronger than DnCNN. The obvious contrast contributes to enhancing the interpretation and recognition of images and satisfies the needs of clinical analysis. In general, FFA-DMRI we proposed performs well in the quantitative and qualitative analysis.
Conclusion
In this article, we propose a network to remove Rician noise from a brain MRI as well as FFA-DMRI. The network is composed of a feature extraction block, a feature fusion block, and an attention block. The feature extraction block exploits the spatial attention mechanism to obtain the area of interest emphatically. Moreover, we utilize dilated convolutions, which expand the receptive fields, and we fuse local and global information to boost the network performance. Then the channel attention mechanism is employed to enhance the influence of essential elements and suppress the useless channels. After the above steps are carried out, FFA-DMRI is trained on the ADNI dataset. In terms of quantitative evaluation, SSIM and PSNR are adopted. Experimental results show that FFA-DMRI can effectively remove Rician noise and maintain most of the crucial details. For quantitative evaluation, it can be seen from visual inspection that the recovered images are more consistent with human senses with obvious contrast, clear brain tissues, and sharp edges. Therefore, the proposed method FFA-DMRI is competitive in brain MRI denoising, which can assist clinicians in diagnosis and treatment.
Statements
Data availability statement
Publicly available datasets were analyzed in this study. This data can be found here: http://adni.loni.usc.edu/.
Author contributions
DH was responsible for the work of writing the manuscript and doing experiments. CH, CY, JL, and YQ made the experiments. CC modified the English grammar of the article. All authors contributed to the article and approved the submitted version.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Footnotes
References
1
AnandC. S.SahambiJ. S. (2010). Wavelet domain non-linear filtering for MRI denoising.Magn. Reson. Imaging28842–861. 10.1016/j.mri.2010.03.013
2
BhadauriaH.DewalM. L. (2013). Medical image denoising using adaptive fusion of curvelet transform and total variation.Comput. Electr. Eng.391451–1460. 10.1016/j.compeleceng.2012.04.003
3
BriggsW. L.HensonV. E. (1995). The DFT: An Owner’s Manual for the Discrete Fourier Transform.Philadelphia, PA: SIAM. 10.1137/1.9781611971514
4
BuadesA.CollB.MorelJ.-M. (2011). Non-local means denoising.Image Process. On Line1208–212. 10.5201/ipol.2011.bcm_nlm
5
CaiC.HuangC.YangC.LuH.HongX.RenF.et al (2020a). Altered patterns of functional connectivity and causal connectivity in salience subnetwork of subjective cognitive decline and amnestic mild cognitive impairment.Front. Neurosci.14:288. 10.3389/fnins.2020.00288
6
CaiC.HuangC.YangC.ZhangX.PengY.ZhaoW.et al (2020b). Altered patterns of phase position connectivity in default mode subnetwork of subjective cognitive decline and amnestic mild cognitive impairment.Front. Neurosci.14:185. 10.3389/fnins.2020.00185
7
CoupéP.YgerP.BarillotC. (2006). “Fast non local means denoising for 3D MR images,” in Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, (Berlin: Springer). 10.1007/11866763_5
8
DanielyanA.KatkovnikV.EgiazarianK. (2011). BM3D frames and variational image deblurring.IEEE Trans. Image Process.211715–1728. 10.1109/tip.2011.2176954
9
DoM. N.VetterliM. (2005). The contourlet transform: an efficient directional multiresolution image representation.IEEE Trans. Image Process.142091–2106. 10.1109/tip.2005.859376
10
EphraimY.MalahD. (1984). Speech enhancement using a minimum-mean square error short-time spectral amplitude estimator.IEEE Trans. Acoust. Speech Signal Process.321109–1121. 10.1109/tassp.1984.1164453
11
GuS.ZhangL.ZuoW.FengX. (2014). “Weighted nuclear norm minimization with application to image denoising,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, (Piscataway, NJ: IEEE). 10.1109/CVPR.2014.366
12
HeL.GreenshieldsI. R. (2008). A nonlocal maximum likelihood estimation method for Rician noise reduction in MR images.IEEE Trans. Med. Imaging28165–172. 10.1109/tmi.2008.927338
13
IkramS.ShahJ. A.ZubairS.IQureshiM.BilalM. (2019). Improved reconstruction of MR scanned images by using a dictionary learning scheme.Sensors19:1918. 10.3390/s19081918
14
JangI.-H.KimN.-C. (2001). Denoising of images using locally adaptive Wiener filter in wavelet domain.IEICE Trans. Inf. Syst.84495–501.
15
JiQ. (2019). Probabilistic Graphical Models for Computer Vision.Cambridge: Academic Press. 10.1016/B978-0-12-803467-5.00008-3
16
JiangY.WuD.DengZ.QianP.WangJ.WangG.et al (2017). Seizure classification from EEG signals using transfer learning, semi-supervised learning and TSK fuzzy system.IEEE Trans. Neural Syst. Rehabil. Eng.252270–2284. 10.1109/tnsre.2017.2748388
17
JiangY.ZhaoK.XiaK.XueJ.ZhouL.DingY.et al (2019). A novel distributed multitask fuzzy clustering algorithm for automatic MR brain image segmentation.J. Med. Syst.43:118. 10.1007/s10916-019-1245-1
18
KalaR.DeepaP. (2018). Adaptive hexagonal fuzzy hybrid filter for Rician noise removal in MRI images.Neural Comput. Appl.29237–249. 10.1007/s00521-017-2953-4
19
KingmaD. P.BaJ. L. (2014). “Adam: a method for stochastic optimization,” in Proceedings of the ICLR 2015: International Conference on Learning Representations 2015, San Diego, CA.
20
KrizhevskyA.SutskeverI.HintonG. E. (2012). Imagenet classification with deep convolutional neural networks.Adv. Neural Inf. Process. Syst.251097–1105.
21
LiS.ZhouJ.LiangD.LiuQ. (2020). MRI denoising using progressively distribution-based neural network.Magn. Reson. Imaging.7155–68. 10.1016/j.mri.2020.04.006
22
ManjónJ. V.Carbonell-CaballeroJ.LullJ. J.García-MartíG.Martí-BonmatíL.RoblesM. (2008). MRI denoising using non-local means.Med. Image Anal.12514–523. 10.1016/j.media.2008.02.004
23
McVeighE. R.HenkelmanR. M.BronskillM. J. (1985). Noise and filtration in magnetic resonance imaging.Med. Phys.12586–591. 10.1118/1.595679
24
MohanJ.KrishnaveniV.GuoY. (2014). A survey on the magnetic resonance image denoising methods.Biomed. Signal Process. Control956–69. 10.1016/j.bspc.2013.10.007
25
SijbersJ.den DekkerA. J. (2004). Maximum likelihood estimation of signal amplitude and noise variance from MR data.Magn. Reson. Med.51586–594. 10.1002/mrm.10728
26
SijbersJ.den DekkerA. J.Van der LindenA.VerhoyeT. M.Van DyckD. (1999). Adaptive anisotropic noise filtering for magnitude MR data.Magn. Reson. Imaging171533–1539. 10.1016/s0730-725x(99)00088-0
27
SimonyanK.ZissermanA. (2014). “Very deep convolutional networks for large-scale image recognition,” in Proceedings of the ICLR 2015: International Conference on Learning Representations 2015, San Diego, CA.
28
SoomroT. A.GaoJ. (2016). “Neural network based denoised methods for retinal fundus images and MRI brain images,” in Preoceedings of the 2016 International Joint Conference on Neural Networks (IJCNN), (Piscataway, NJ: IEEE). 10.1109/IJCNN.2016.7727327
29
TianC.XuY.LiZ.ZuoW.FeiL.LiuH. (2020). Attention-guided CNN for image denoising.Neural Netw.124117–129. 10.1016/j.neunet.2019.12.024
30
TripathiP. C.BagS. (2020). CNN-DMRI: a convolutional neural network for denoising of magnetic resonance images.Pattern Recogn. Lett.13557–63. 10.1016/j.patrec.2020.03.036
31
WangZ.BovikA. C.SheikhH. R.SimoncelliE. P. (2004). Image quality assessment: from error visibility to structural similarity.IEEE Trans. Image Process.13600–612. 10.1109/tip.2003.819861
32
WeiY.XiaoH.ShiH.JieZ.FengJ.HuangT. S. (2018). “Revisiting dilated convolution: A simple approach for weakly-and semi-supervised semantic segmentation,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, (Piscataway, NJ: IEEE). 10.1109/CVPR.2018.00759
33
WooS.ParkJ.LeeJ.-Y.So KweonI. (2018). “Cbam: convolutional block attention module,” Proceedings of the European Conference on Computer Vision (ECCV).Glasgow: ECCV. 10.1007/978-3-030-01234-2_1
34
YuF.KoltunV. (2016). “Multi-Scale Context Aggregation by Dilated Convolutions,” in Proceedings of the ICLR 2016: International Conference on Learning Representations 2016, San Juan.
35
YuH.DingM.ZhangX. (2019). Laplacian Eigenmaps Network-Based Nonlocal Means Method for MR Image Denoising.Sensors192918. 10.3390/s19132918
36
YuH.ZhaoL. (2008). “An efficient denoising procedure for magnetic resonance imaging,” in Preoceedings of the 2008 2nd International Conference on Bioinformatics and Biomedical Engineering, (Piscataway, NJ: IEEE). 10.1109/ICBBE.2008.990
37
ZhangK.ZuoW.ChenY.MengD.ZhangL. (2017a). Beyond a gaussian denoiser: residual learning of deep cnn for image denoising.IEEE Trans. Image Process.263142–3155. 10.1109/tip.2017.2662206
38
ZhangK.ZuoW.GuS.ZhangL. (2017b). “Learning deep CNN denoiser prior for image restoration,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, (Piscataway, NJ: IEEE). 10.1109/tip.2017.2662206
39
ZhangK.ZuoW.ZhangL. (2018). FFDNet: Toward a fast and flexible solution for CNN-based image denoising.IEEE Trans. Image Process.274608–4622. 10.1109/tip.2018.2839891
40
ZhangK.ZuoW.ZhangL. (2019). “Deep plug-and-play super-resolution for arbitrary blur kernels,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, (Piscataway, NJ: IEEE). 10.1109/CVPR.2019.00177
41
ZhangM.ZhangF.LiuQ.WangS. (2019). VST-net: variance-stabilizing transformation inspired network for Poisson denoising.J. Vis. Commun. Image Represent.6212–22. 10.1016/j.jvcir.2019.04.011
42
ZhangZ. (2018). “Improved adam optimizer for deep neural networks,” in Proceedings of the 2018 IEEE/ACM 26th International Symposium on Quality of Service (IWQoS), (Piscataway, NJ: IEEE). 10.1109/IWQoS.2018.8624183
43
ZhuH.LiY.IbrahimJ. G.ShiX.AnH.ChenY.et al (2009). Regression models for identifying noise sources in magnetic resonance images.J. Am. Stat. Assoc.104623–637. 10.1198/jasa.2009.0029
Summary
Keywords
magnetic resonance imaging, brain, denoising, feature fusion, attention mechanism
Citation
Hong D, Huang C, Yang C, Li J, Qian Y and Cai C (2020) FFA-DMRI: A Network Based on Feature Fusion and Attention Mechanism for Brain MRI Denoising. Front. Neurosci. 14:577937. doi: 10.3389/fnins.2020.577937
Received
30 June 2020
Accepted
13 August 2020
Published
16 September 2020
Volume
14 - 2020
Edited by
Yizhang Jiang, Jiangnan University, China
Reviewed by
Qianyi Zhan, Jiangnan University, China; Juan Yang, Suzhou University, China
Updates
Copyright
© 2020 Hong, Huang, Yang, Li, Qian and Cai.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Chenxi Huang, chyang@xmu.edu.cnChenhui Yang, ych987@126.comJianpeng Li, liwitty@outlook.com
This article was submitted to Neuroprosthetics, a section of the journal Frontiers in Neuroscience
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.