Abstract
Introduction:
Cervical cancer has become one of the most malignant tumors that threatens women's health worldwide. Liquid-based cytology (LBC) examination has become the most common screening method for detecting cervical cancer early and preventing it. Currently, nuclear segmentation technology for cervical clinical LBC images based on convolutional neural networks has become a vital means of assisting in the diagnosis of cervical cancer. However, the existing nuclear segmentation techniques fail to segment the nuclei of severely overlapping nuclei in highly aggregated cell clusters, which will inevitably lead to the misdiagnosis of cervical cancer pathology.
Methods:
Therefore, a novel bending loss and dual-task decoding network (Bloss-DDNet) is proposed for overlapping cell nucleus segmentation of cervical clinical LBC images. First, the network architecture search method is introduced to search and optimize the architecture of the decoding module in the dual-task branch, determining the mask and boundary decoding modules (dual-task decoding modules) of the Bloss-DDNet. Second, two feature maps, separately generated from dual-task decoding branches composed of a shared encoder module and dual-task decoder modules, are fused to enhance the sensitivity to cell nucleus boundaries. Third, a bending loss is introduced to the loss function to focus on the curvature variation characteristics of the intersection of overlapping cell nucleus boundaries, thereby constraining the training process of the dual-task decoding branch and increasing the constraint on the cell nucleus boundary.
Results:
The results show that all evaluation metrics of the proposed Bloss-DDNet achieved the best performance on public datasets.
Discussion:
Therefore, the proposed Bloss-DDNet can effectively address the segmentation problem of overlapping cell clusters and nuclei in clinical LBC images, providing strong support for subsequent clinical auxiliary diagnosis of cervical cancer.
1 Introduction
Cervical cancer is one of the most common malignant tumors threatening global women's health, occupying the first place in the incidence rate and mortality rate of female reproductive system tumors, and seriously threatening the health of female comrades (; ; ; ). The latest statistics, released by the Global Cancer Observatory 2022 (https://gco.iarc.fr/en), which are updated every three years, indicate that there were 662,301 new cases and 348,874 deaths from cervical cancer worldwide, including 150,659 new cases and 55,694 deaths in China. From this, cervical cancer has caused serious harm to female comrades. The leading cause of cervical cancer is human papillomavirus infection, especially persistent infection of high-risk HPV types. However, cervical cancer has a long and reversible precancerous stage, and early diagnosis and treatment are crucial for improving the survival rate of cervical cancer patients.
Clinically, liquid-based cytology (LBC) is a widely used method for cervical cancer screening (). It involves collecting cervical cell samples and examining them under a microscope to detect cancerous lesions with changes in internal structure and morphology, as well as noncancerous lesions such as pathogenic microbial infections and inflammation. However, due to factors such as cervical cell overlap, morphological diversity, and subjectivity in manual interpretation, the accuracy and efficiency of cervical clinical LBC are somewhat limited.
The automatic nucleus segmentation of cervical clinical LBC images is of great significance for automated cervical cancer screening, as it can significantly improve the accuracy and efficiency of diagnosis (; ). However, traditional segmentation algorithms such as level set () and threshold segmentation () poorly deal with complex backgrounds and overlapping cells. In recent years, deep learning techniques, especially convolutional neural networks (CNNs) and Transformers, have made significant progress in medical image processing (; Zeng et al., 2023; Zaman et al., 2024; ; ; ; ; ). In most cases, the performance of cell nucleus segmentation in cervical clinical LBC images using deep learning networks is superior to that of traditional algorithms ().
Specifically, U-Net and its improved network have been introduced as a backbone for cell segmentation in various cellular images due to their outstanding performance (; , ; Zeng et al., 2023; Zaman et al., 2024; ; Zhou et al., 2018). Meanwhile, proposed the CE Net, which utilizes an enhanced network architecture with DAC and RMP blocks to extend the U-Net. Although the CE Net can handle overlapping cell nuclei effectively, it exhibits high computational complexity and encounters memory limitations when processing large-scale datasets. In addition, proposed Joint segmentation, which can simultaneously predict cell nucleus segmentation and better capture the overall structure of cells. However, when dealing with overlapping cell nuclei, the computational complexity of the Joint segmentation is high. Subsequently, proposed the NucleiSegNet, a network specifically designed for cell nucleus segmentation, which introduces new robust residual blocks and attention mechanisms to extract and learn deep features. Although the NucleiSegNet performs well in handling overlapping cell nuclei and accurately detecting nuclei of different shapes, there is still room for improvement in its performance when dealing with highly overlapping cell nuclei.
Furthermore, for cell nucleus segmentation of cervical clinical LBC images, Zhao et al. (2021) proposed that AL-net adjusts its network parameters through an adaptive learning mechanism to improve its adaptability to nuclei with varying degrees of overlap. Although the AL-net method has certain advantages in handling overlapping cell nuclei, its training process is relatively complex and requires a large amount of labeled data. In addition, we proposed the GCP-Net to improve the quality of feature learning through multi-scale context gating and global context attention (). It has achieved a better performance than the above networks. Meanwhile, the fusion of CNNs and Transformers is a highly active and important research direction in the field of computer vision. The combination of the two can complement each other's strengths and weaknesses: CNN can efficiently extract local features of edges and textures, while the Transformer excels in modeling global contextual dependencies (), such as those found in TransUNet (). Specifically, TransUNet introduces a Transformer-centered encoder-decoder framework that combines self-attention and cross-attention in a sequence-to-sequence prediction context for medical image segmentation, thereby addressing the limitations of convolution-based methods, such as U-Net, in modeling long-range dependencies (). In addition to TransUNet, the new semantic segmentation network, SegFormer, has attracted widespread attention due to its efficient, concise, and robust performance (; ). However, there is still a problem with connected nuclei, indicated by red arrows, in the cell segmentation results of cervical clinical LBC images shown in Figure 1. Therefore, it is necessary to propose a novel bending loss and dual-task decoding network (Bloss-DDNet) for overlapping cell nucleus segmentation of cervical clinical LBC images to eliminate the connectivity problem. Our contributions in this paper are briefly described as follows:
Figure 1
(1) Dual-task decoding branches composed of a shared encoder module and dual-task decoder modules are designed for decoding the mask and boundary of the overlapping cell nucleus segmentation of cervical clinical LBC images. In addition, two feature maps separately generated from dual-task decoding branches are fused to enhance the sensitivity of cell nucleus boundaries.
(2) The neural architecture search (NAS) framework is introduced for determining 1# and 2# decoder modules, obtaining the optimal combination and hyperparameter configuration of NAS-mask and NAS-boundary in the dual-task decoding branches.
(3) A bending loss, which focuses on the curvature variation characteristics of the intersection of overlapping cell nucleus boundaries, is introduced to the loss function to constrain the training process of the dual-task decoding branch and increase the constraint on the cell nucleus boundary.
(4) The proposed Bloss-DDNet can effectively solve the segmentation problem of overlapping cell clusters and nuclei in cervical clinical LBC images and may strongly support subsequent clinical auxiliary cervical cancer diagnosis.
2 Materials and methods
This paper proposes a BLoss-DDNet to solve the nuclear boundary connectivity problem in overlapping cell nucleus segmentation of cervical clinical LBC images. Based on the above, materials and methods are described in Sections 2.1 and 2.2, respectively.
2.1 Materials
Most existing public datasets of cervical clinical LBC images contain only a cervical cell in each image, making them unsuitable for the entire diagnostic process of real-world clinical case data. Therefore, this study selected CNSeg and MoNuSeg, which share overlapping cell nuclei, as the primary datasets among numerous publicly available datasets (Zhao et al., 2023). Subsequently, two Datasets (Dataset 1 and Dataset 2) are generated separately from two public datasets of cervical clinical LBC images.
Table 1 reports the characteristics of Datasets 1 and 2. Specifically, the original dataset CNSeg includes 265 × 2048 × 2048 cervical clinical LBC images, provided by the 2nd Affiliated Hospital of Harbin Medical University, which is a set of clinical cervical cell images for LBC detection. First, Figure 2 shows that 2,363 × (150–500) × (150–500) cell cluster images (Dataset 1), marked by a yellow box, are generated by YOLO-V4 (). Then, 568 × (150–500) × (150–500) cell cluster images are randomly selected as the Test set (Test Set 1), and the remaining 1795 × (150–500) × (150–500) images are used as the training set. Furthermore, the training set of Dataset 1 includes 200 simple, 1500 normal, and 95 difficult cell cluster images. Meanwhile, to crop out more cervical clinical LBC images, a size of 224 × 224 is used to crop the 30 × 1,000 × 1,000 H&E-stained histological images obtained from different hospitals across multiple patients and organs of the original dataset MoNuSeg, resulting in 8,576 × 224 × 224 cropped H&E-stained histological images (Dataset 2). Then, 896 × 224 × 224 cropping of H&E-stained histological images is randomly selected as the Test set (Test set 2), and the remaining 7,680 × 224 × 224 images comprise the training set.
Table 1
| Dataset | Name | Number × cropped size | Train set | Test set |
|---|---|---|---|---|
| Datasets 1 | CNSeg (265 × 2,048 × 2,048) | 2,363 × (150–500) × (150–500) | 1,795 × (150–500) × (150–500) | 568 × (150–500) × (150–500) |
| Datasets 2 | MoNuSeg (30 × 1,000 × 1,000) | 8,576 × 224 × 224 | 7,680 × 224 × 224 | 896 × 224 × 224 |
Characteristics of Datasets 1 and 2.
Figure 2
2.2 Methods
Figure 3 shows the detailed network architecture of the proposed Bloss-DDNet. Specifically, due to Unet's outstanding performance in medical image segmentation (; Zeng et al., 2023; Zaman et al., 2024; ; ; ,, ; ), the proposed Bloss-DDNet follows Unet's skip connection architecture to introduce low-level semantic information, helping to update gradients during backpropagation. Meanwhile, the proposed Bloss-DDNet considers the nuclear boundaries corresponding to high-level semantic information, avoiding the loss of boundary information as the network depth increases.
Figure 3
The overall network architecture of the proposed Bloss-DDNet is introduced as follows. Figure 3a further discloses the overall network architecture of the proposed Bloss-DDNet, which adds a boundary decoder branch for the cell nucleus boundary segmentation task. During the training stage of the proposed Bloss-DDNet, the added boundary decoder branch calculates the boundary loss to separate overlapping cell nuclei of cervical clinical LBC images. Specifically, the proposed Bloss-DDNet comprises a shared encoder module and two parallel dual-task decoder modules (1# and 2# decoder modules), which are connected to the output of the shared encoder module, thereby forming dual-task branches. The 1# decoder module in the dual-task branches executes the cell nucleus mask segmentation task (1# task). Meanwhile, the 2# decoder module in the dual-task branches executes the cell nucleus boundary segmentation task (2# task). Additionally, two feature maps, separately generated from each block of dual-task decoding branches, are fused through matrix multiplication (dual-task feature map fusion) to enhance the sensitivity to cell nucleus boundaries.
The network architecture of the shared encoder module, the 1# and 2# decoder modules, and their connections are introduced as follows. The shared encoder module consists of four sequentially connected encoder blocks, each with a blue color. Meanwhile, the 1# and 2# decoder modules in the dual-task branches also separately include four sequentially connected decoder blocks with orange and green colors. Specifically, the first three encoder blocks are separately connected to the last three decoder blocks of the 1# and 2# decoder modules via the skip connection. Meanwhile, the encoding feature map generated by the last encoder block of the shared encoder module separately connects the first decoder block of the 1# and 2# decoder modules after transposition convolution processing. Besides, to fuse the two decoding feature maps separately generated from each decoder block (1# task decoder block with orange color and 2# task decoder block with green color) of dual-task decoding branches, a 1 × 1 convolutional layer with a sigmoid function (a block with yellow color) is set behind each 2# task decoder block. Before fusing the two decoding feature maps by matrix multiplication, the first three 1# task decoder blocks are separately processed by a transposition convolution operation. Note that the decoding feature map generated by the last 1# task decoder block is directly fused with the last decoding feature map generated by the last 2# task decoder block after a 1 × 1 convolutional layer with a sigmoid function, via matrix multiplication, to obtain the last 1# task fused feature map. Lastly, the 1# and 2# last fused feature maps of the 1# and 2# decoder modules are separately processed by a 1 × 1 convolutional layer with a sigmoid function, generating the cell nucleus mask and the cell nucleus boundary segmentation images.
2.2.1 Shared encoder module
As the encoder module's network depth increases, its performance will reach a specific limit even if the network gradient is effectively calculated (). When the encoder module's network reaches a certain depth, the gradient may become zero or reach a maximum value, causing it to disappear or explode (). Whether its gradient vanishes or explodes will affect the proposed Bloss-DDNet's performance. The problem of gradient vanishing or exploding can be solved by introducing skip connections in the residual blocks ().
Figure 3b shows the detailed network architecture of each encoder block in the shared encoder module. Specifically, the shared encoder module comprises four sequentially connected encoder blocks, denoted by blue color. Each encoder block includes two sequentially connected residual sub-blocks and a 2D MaxPool layer with a 2 × 2 convolutional kernel (Stride = 2). Additionally, the main branch of each residual sub-block sequentially includes a 3 × 3 convolutional layer, a batch normalization (BN) layer with a ReLU activation function, a 3 × 3 convolutional layer, a BN layer, and an SE-Attention sub-block. Meanwhile, the side branch of each residual sub-block includes sequentially a 3 × 3 convolutional layer and a BN layer. Then, the attention feature map generated by the SE-Attention sub-block is fused with the BN feature map generated by the BN layer by element-wise addition. Introduced SE-Attention sub-block weights the BN feature maps of each channel in the main branch, creating more accurate encoding feature maps. This enhances the encoder module.
2.2.2 1# and 2# decoder modules based on the NAS framework
Besides the encoder module, the decoder module is also crucial for the proposed Bloss-DDNet, as it directly affects the overlapping cell nucleus segmentation of cervical clinical LBC images. After fixing the encoder module, the neural architecture search (NAS) strategy is introduced to determine the network architecture of 1# and 2# decoder modules. Specifically, the NAS is initially used for classification tasks (). Howard et al. created a network for semantic segmentation in MobileNet V3 by modifying the classification network generated by NAS to shift the target to semantic segmentation operations for low-resolution images. Subsequently, Albert Shaw et al. proposed the SqueezeNAS method (), a search encoding framework for dense semantic segmentation network search, achieving good results. Inspired by its ideas, this article utilizes the NAS to search for 1# and 2# decoder modules, aiming to achieve high performance in cell nucleus segmentation.
Figure 4 shows the detailed network architecture of NAS for separately determining 1# and 2# decoder modules (NAS-mask and NAS-boundary). Specifically, these decoder modules are separately determined based on the shared encoder module. Besides, the 1# and 2# NAS frameworks include the same sub-blocks. Therefore, only the specific search space of the 1# NAS framework is given in Figure 4.
Figure 4
To fully utilize the advantages of dilated convolution, depthwise separable convolution, and SE Attention sub-blocks (; ; ), the specific search space includes sequentially connected dilated convolution sub-blocks, depthwise separable convolution sub-blocks, SE Attention sub-blocks, and 2D MaxPool layers. The connections of these sub-blocks and layers are detailed in Figure 4. The convolutional kernel sizes of the dilated convolution, depthwise separable convolution, and 2D MaxPool layers are set to 3 × 3 and 5 × 5, respectively. The stride of the depthwise separable convolution and 2D MaxPool layer is set to 1 and 2, and the dilated convolution's dilation rate (d) is set to 1, 2, and 3. Lastly, following the above settings and connection relationships of the 1# NAS framework, various possible decoding networks are trained and tested on Dataset 1, and the optimal decoding network with the maximum Dice score is selected as the NAS-mask shown in Figure 3c. Similarly, following the above settings and connection relationships of the 2# NAS framework, various possible decoding networks are also trained and tested on Dataset 1. The optimal decoding network is the one with the maximum Dice score, selected as the NAS-boundary, as shown in Figure 3d. Ultimately, the dilated convolution with a 3 × 3 kernel (d = 2 and Stride = 1), depthwise separable convolution with a 3 × 3 kernel (Stride = 1), and SE Attention sub-blocks are specified in the NAS-mask. In addition, the dilated convolution with 3 × 3 (d = 2 and Stride = 1), depthwise separable convolution with 3 × 3 (Stride = 1), and 2D MaxPool layer with 3 × 3 (Stride = 1) sub-blocks are determined in the NAS–boundary.
Specifically, 200 simple, 1,500 normal, and 95 difficult cell cluster images (224 × 224) in the training set of Dataset 1 are used to separately train various possible decoding networks of the 1# and 2# NAS frameworks based on the curriculum learning strategy (). Subsequently, 568 cell cluster images (448 × 448) in Test set 1 of Dataset 1 are used to separately test the trained decoding networks of the 1# and 2# NAS frameworks. Additionally, when various possible decoding networks are trained to obtain the NAS-mask, the loss functions are configured as the NAS-mask loss function LNAS-mask, which includes the binary cross-entropy loss LBCE and Dice loss LDSC (Zeng et al., 2023; Zaman et al., 2024; ,). The weight coefficients of the binary cross-entropy loss LBCE and Dice loss LDSC are set to 0.3 and 0.7, respectively. The binary cross-entropy loss LBCE and the Dice loss LDSC are shown in Equations 1, 2. When various possible decoding networks are trained to obtain the NAS-boundary, the loss functions are configured as the NAS-boundary loss function (bending loss, as shown in Equation 5).
here, yi and pi represents pixel value in the i-th ground truth image Y and the pixel value in the i-th cervical clinical LBC image P being classified as the cell nucleus, respectively.
2.2.3 Bending loss
This study's loss function design introduced the concept of curvature to describe overlapping nucleus boundaries. Curvature is a physical quantity used to indicate the degree of curvature of a curve at a certain point (). Meanwhile, the curvature of a curve is directly proportional to its bending degree. Specifically, the larger the curvature of a curve, the greater its bending degree, and vice versa.
Figure 5 shows the edge vector representation of the intersections of the overlapping nucleus. In cervical clinical LBC images, the curvature of a nucleus boundary changes smoothly. However, if two or more nuclei (such as a 1# nucleus and a 2# nucleus) have overlapping boundaries, the intersections Ai(xi, yi) on the boundaries of these nuclei will exhibit noticeable changes in curvature. Inspired by this observation, the curvature changes of the nucleus boundaries can comprehensively reflect the boundary position of the overlapping nuclei. Furthermore, the detailed construction process of this bending loss is as follows.
Figure 5
First, the adjacent pixel points Ai−1(xi−1, yi−1) and Ai+1(xi+1, yi+1) at both sides of this intersection Ai(xi, yi) on each nucleus boundary are determined. Second, the first side vector, denoted by a purple arrowv(i−1, i) = Ai(xi, yi)−Ai−1(xi−1, yi−1), is constructed from the pixel point Ai−1(xi−1, yi−1) to the intersection Ai(xi, yi). Meanwhile, the second side vector, denoted by a red arrow v(i, i+1) = Ai+1(xi+1, yi+1)−Ai(xi, yi), is constructed from the intersection Ai(xi, yi) to the pixel pointAi+1(xi+1, yi+1). Third, the curvature ki at the intersection Ai(xi, yi) can be calculated based on the first side vector v(i−1, i) and the second side vector v(i, i+1). Then, the discrete bending loss BE(i) of the intersection Ai(xi, yi) is determined based on the curvature ki. Lastly, the bending loss LBend is introduced based on the discrete bending loss BE(i).
Based on the above, the specific implementation details are represented by mathematical Equations 3–5:
where symbol |*| represents the length of a vector; symbol × represents the vector multiplication operation; symbol · represents the vector dot multiplication operation;v(i−1, i) represents the first side vector from the pixel point Ai−1(xi−1, yi−1) to the intersection Ai(xi, yi); v(i, i+1) represents the second side vector from the intersection Ai(xi, yi) to the pixel pointAi+1(xi+1, yi+1); ki represents the curvature at the intersection Ai(xi, yi);BE(i) represents the discrete bending loss of the intersection Ai(xi, yi); LBend represents the bending loss of the discrete bending lossBE(i); m represents the number of pixel points on the nucleus boundary.
3 Experiments and results
This section comprehensively implements the ablation study and comparative experiment. Then, the overlapping cell nucleus segmentation results based on the cervical clinical LBC images are presented.
3.1 Experiments
This section includes the ablation study, comparative experiment, and their evaluation metrics. Additionally, the experimental configuration of all experiments and the operation of the NAS framework for determining the 1# and 2# decoder modules in this study are consistent. First, all network architectures uniformly adopt the PyTorch 1.8 framework. Second, the resolution of Train sets 1 and 2 is resized to 448 × 448 before training these networks. Third, the NVIDIA V100 Tensor Core 40G GPU and Intel(R) Xeon(R) Gold 5218 2.30 GHz CPU were used during the training process for these networks. Additionally, during network training, the batch size is set to 8, and the Adam optimizer is used with a preset learning rate of 1e−4. Lastly, Test sets 1 and 2 of Dataset 1 and Dataset 2, respectively, include 568 × (150–500) × (150–500) cell cluster images and 896 × 224 × 224 cropping of H&E-stained histological images. Additionally, the size of the Test sets should be uniformly resized to 448 × 448 to ensure consistency with the Training sets.
3.1.1 Ablation study
To reasonably verify the performance of the network structure of the proposed BLoss-DDNet (Backbone + Encoder + NAS-mask + NAS-boundary +LBend), an ablation study on Dataset 1 is conducted in this paper. Figure 6, Table 2 report the specific design of the ablation study.
Figure 6
Table 2
| Network | Shared encoder | NAS-mask | NAS-boundary | LBCE | LDSC | LBend |
|---|---|---|---|---|---|---|
| Backbone | √ | |||||
| Backbone + Encoder | √ | √ | ||||
| Backbone + NAS-mask | √ | √ | ||||
| Backbone + NAS-boundary | √ | √ | ||||
| Backbone +LBCE | √ | √ | ||||
| Backbone + NAS-mask + NAS-boundary | √ | √ | √ | √ | ||
| Backbone + Encoder + NAS-mask + NAS-boundary | √ | √ | √ | √ | √ | |
| Backbone + Encoder + NAS-mask + NAS-boundary +LBend | √ | √ | √ | √ | √ | √ |
The specific design of the ablation study.
Specifically, based on the basic architecture of U-Net, the encoder module and two decoder modules (the 1# and 2# decoder modules) in Figure 3a of this Backbone network adopt Unet's original modules. Meanwhile, the original loss function LDSCis used during training of the Backbone network.
Compared to the Backbone architecture, the Backbone + Encoder replaces Unet's original encoder module with the shared encoder module to encode the cervical clinical LBC images. Besides, the Backbone + NAS-mask and Backbone + NAS-boundary separately replace Unet's original decoder module with the NAS-mask and NAS-boundary to decode the decoding feature map generated by Unet's original encoder module. Meanwhile, the Backbone + NAS-mask + NAS-boundary replaces Unet's original decoder module with the NAS-mask and NAS-boundary. The Backbone + Encoder + NAS-mask + NAS-boundary replaces Unet's original encoder and decoder module with the shared encoder module, NAS-mask, and NAS-boundary.
Compared to the loss function, the dual-task branches of the Backbone, Backbone + Encoder, Backbone + NAS-mask, and Backbone + NAS-boundary all utilize the same loss function LDSC. Additionally, the dual-task branches of Backbone +LBCE, Backbone + NAS-mask + NAS-boundary, and Backbone + Encoder + NAS-mask + NAS-boundary utilize the same loss function LDSC+ LBCE. The weight coefficients of the binary cross-entropy loss LBCE and Dice lossLDSC are set to 0.3 and 0.7, respectively. Lastly, the dual-task branches of the Backbone + Encoder + NAS-mask + NAS-boundary +LBend separately configure the loss function LDSC+ LBCE and LBend. Specifically, the loss function of the Backbone + Encoder + NAS-mask + NAS-boundary +LBend is shown in Equation 6.
where α = 0.4, β = 0.3, and γ = 0.3.
3.1.2 Comparative experiment
Figure 7 shows the specific design of the comparative experiment. Specifically, this section separately evaluates the proposed Bloss-DDNet on Dataset 1 and Dataset 2, comparing the classic U-Net () and Unet++ (Zhou et al., 2018) models for medical image segmentation, Joint segmentation () model for kernel segmentation, NucleiSegNet (), CE Net () network, HoVer Net () network for tissue cytology segmentation, TransUNet (), GCP-Net (), AL Net (Zhao et al., 2021), and SegFormer (). Meanwhile, the same framework, training set, and training strategy are used for all networks, along with the same Test set, to ensure fairness in the comparison.
Figure 7
3.1.3 Evaluation metrics
To assess the performance differences in the ablation study and the comparative experiment, three standard evaluation metrics are used in this study: the Aggregated Jaccard Index (AJI) (), the Dice coefficient (Dice) (), and the Panoptic Quality (PQ) (). The specific evaluation metrics are represented by mathematical Equations 7, 9:
where Gi is the i-th nucleus in a ground truth with a total of N nuclei. Pk means the k-th connected component in prediction, which has the largest Jaccard Index with Gi, and each k can only be used once. U is the connected component that does not correspond to the ground truth in the prediction. FP represents the over-segmented region, TP represents the accurately segmented region, FN represents the under-segmented region, and TN represents the region accurately segmented into the background. Each (p,g) indicates a pair of mask-accurate positive detections and their corresponding ground truth. Note that a mask prediction can only be regarded as the true positive when IOU(p,g) > 0.5.
3.2 Results
This section presents the results of the ablation study and comparative experiment, highlighting the performance of the proposed BLoss-DDNet.
3.2.1 Ablation results
Figure 8 shows the ablation study results of the proposed BLoss-DDNet (Backbone + Encoder + NAS-mask + NAS-boundary +LBend) on Test set 1 of Dataset 1. Overall, our proposed BLoss-DDNet performs the best in all evaluation metrics, achieving a mean AJI of 73.6%, a mean Dice of 88.7%, and a mean PQ of 71.5%. Meanwhile, Figure 9 shows the typical visualized ablation study results of the proposed BLoss-DDNet on Test set 1.
Figure 8
Figure 9
First, the effectiveness of the shared encoder module is compared. Compared to the Backbone, the mean AJI, the mean Dice, and the mean PQ of the Backbone + Encoder have improved by 2.1%, 2.8%, and 1.4%, respectively. In addition, compared to Figures 9b, c shows that cell nucleus segmentation with the red box has been improved. Similarly, compared to the Backbone + NAS-mask + NAS-boundary, the mean AJI, the mean Dice, and the mean PQ of the Backbone + Encoder + NAS-mask + NAS-boundary have improved by 2.8%, 0.6%, and 0.8%, respectively.
Second, the effectiveness of the NAS mask and the NAS boundary is compared. Compared to the Backbone, the mean AJI, the mean Dice, and the mean PQ of the Backbone + NAS-mask have improved by 7.1%, 5.0%, and 2.8%, respectively. Besides, compared to the Backbone, the mean AJI, the mean Dice, and the mean PQ of the Backbone + NAS-boundary have improved by 7.2%, 7.1%, and 2.1%, respectively. Meanwhile, compared to the Backbone + NAS-mask, the mean AJI, the mean Dice, and the mean PQ of the Backbone + NAS-mask + NAS-boundary have improved by 2.7%, 2.7%, and 4.4%, respectively. Besides, compared to the Backbone + NAS-boundary, the mean AJI, the mean Dice, and the mean PQ of the Backbone + NAS-mask + NAS-boundary have improved by 2.6%, 0.6%, and 5.1%, respectively. Especially compared to the Backbone, the mean AJI, the mean Dice, and the mean PQ of the Backbone + NAS-mask + NAS-boundary have improved by 9.8%, 7.7%, and 7.2%, respectively. In addition, compared to Figures 9b, d, e, g show that cell nucleus segmentation with the pink boxes has been improved. Compared to Figures 9g, h shows that cell nucleus segmentation with the pink boxes has been further improved. Besides, the segmenting performance of the cell nucleus with the yellow boxes in Figure 9d is better than that in Figure 9e.
Lastly, the effectiveness of the loss function is compared. Compared to the Backbone (with LDSC), the mean AJI, the mean Dice, and the mean PQ of the Backbone (with LDSC) + LBCE have improved by 4.2%, 2.6%, and 0.9%, respectively. Besides, compared to the Backbone + Encoder + NAS-mask + NAS-boundary (with LDSC + LBCE), the mean AJI, the mean Dice, and the mean PQ of the Backbone + Encoder + NAS-mask + NAS-boundary (with LDSC + LBCE) + LBend have improved by 4.4%, 1.9%, and 2.0%, respectively. In addition, Figure 9e shows the loss curves of the training process of the Backbone (with LDSC), the Backbone (with LDSC) + LBCE, and the Backbone + Encoder + NAS-mask + NAS-boundary (with LDSC + LBCE) + LBend. The Backbone (with LDSC)'s loss curve, marked in blue, initially decreases significantly and then gradually decreases after about the 8th epoch. Compared to the Backbone (with LDSC)'s loss curve, the Backbone (with LDSC) + LBCE‘s loss curve, marked in red, more quickly decreases at the beginning of the training, gradually decreases after about the 5th epoch, and converges to a smaller loss. Compared to the Backbone (with LDSC) + LBCE‘s loss curve, the Backbone + Encoder + NAS-mask + NAS-boundary (with LDSC + LBCE) + LBend‘s loss curve, marked in green, initially decreases. Then, it gradually decreases after about the 12th epoch and converges to a smaller loss. Meanwhile, the segmenting performance of the cell nucleus with the red box in Figure 9f is better than that in Figure 9b. Further, the segmenting performance of the cell nucleus with the blue boxes in Figure 9i is also better than that in Figure 9h.
3.2.2 Comparative results
Table 3, Figure 10 present the comparative experimental results of the proposed BLoss-DDNet and other existing medical image segmentation networks on Test sets 1 and 2 of their respective Datasets 1 and 2.
Table 3
| Network | Test set 1 | Test set 2 | ||||
|---|---|---|---|---|---|---|
| Mean AJI ↑ | Mean Dice ↑ | Mean PQ ↑ | Mean AJI ↑ | Mean Dice ↑ | Mean PQ ↑ | |
| U-Net [29] | 0.645 | 0.842 | 0.634 | 0.579 | 0.833 | 0.562 |
| Unet++ [18] | 0.672 | 0.867 | 0.658 | 0.607 | 0.810 | 0.587 |
| Joint segmentation [20] | 0.689 | 0.872 | 0.683 | 0.641 | 0.837 | 0.592 |
| NucleiSegNet [21] | 0.663 | 0.867 | 0.654 | 0.621 | 0.815 | 0.596 |
| CE-Net [19] | 0.683 | 0.873 | 0.682 | 0.626 | 0.837 | 0.601 |
| HoVer-Net [43] | 0.691 | 0.855 | 0.676 | 0.612 | 0.814 | 0.564 |
| TransUNet [24] | 0.683 | 0.865 | 0.668 | 0.628 | 0.826 | 0.597 |
| GCP-Net [4] | 0.684 | 0.880 | 0.688 | 0.651 | 0.830 | 0.601 |
| AL-net [22] | 0.721 | 0.873 | 0.712 | 0.649 | 0.823 | 0.610 |
| SegFormer [25] | 0.709 | 0.869 | 0.699 | 0.612 | 0.826 | 0.561 |
| BLoss-DDNet (proposed) | 0.736 | 0.887 | 0.715 | 0.658 | 0.847 | 0.635 |
The comparative experiment results of Test sets 1 and 2.
Figure 10
Overall, our proposed BLoss-DDNet performs the best in all evaluation metrics on Test set 1, achieving a mean AJI of 73.6%, a mean Dice of 88.7%, and a mean PQ of 71.5%. Additionally, our proposed BLoss-DDNet performs the best in all evaluation metrics on Test set 2, achieving a mean AJI of 65.8%, a mean Dice of 84.7%, and a mean PQ of 63.5%. Meanwhile, Figure 11 shows the typical visualized ablation study results of the proposed BLoss-DDNet on Test sets 1 and 2.
Figure 11
Compared to the U-Net, Unet++, Joint segmentation, NucleiSegNet, CE Net, HoVer Net, TransUNet, GCP-Net, AL Net, and SegFormer, the mean AJI of the proposed BLoss-DDNet on Test set 1 has improved by 9.1%, 6.4%, 4.7%, 7.3%, 5.3%, 4.5%, 5.3%, 5.2%, 1.5%, and 2.7%, respectively. Additionally, compared to the networks mentioned above, the mean Dice of the proposed BLoss-DDNet on Test set 1 has shown improvements of 4.5%, 2.0%, 1.5%, 2.0%, 1.4%, 3.2%, 2.2%, 0.7%, 1.4%, and 1.8%, respectively. Lastly, compared to these networks above, the mean PQ of the proposed BLoss-DDNet on Test set 1 has improved by 8.1%, 5.7%, 3.2%, 6.1%, 3.3%, 3.9%, 4.7%, 2.7%, 0.3%, and 1.6%, respectively. Meanwhile, compared to the U-Net, Unet++, Joint segmentation, NucleiSegNet, CE Net, HoVer Net, TransUNet, GCP-Net, AL Net, and SegFormer, the mean AJI of the proposed BLoss-DDNet on Test set 2 has also improved by 7.9%, 5.1%, 1.7%, 3.7%, 3.2%, 4.6%, 3.0%, 0.7%, 0.9%, and 4.6%, respectively. Besides, compared to the networks above, the mean Dice of the proposed BLoss-DDNet on Test set 2 has also improved by 1.4%, 3.7%, 1.0%, 3.2%, 1.0%, 3.3%, 2.1%, 1.7%, 2.4%, and 2.1%, respectively. Finally, compared to these networks above, the mean PQ of the proposed BLoss-DDNet on Test set 2 has also improved by 7.3%, 4.8%, 4.3%, 3.9%, 3.4%, 7.1%, 3.8%, 3.4%, 2.5%, and 7.4%, respectively.
3.2.3 Computation time and space requirements
Table 4 reports the computation time and space requirements of the proposed BLoss-DDNet and other existing medical image segmentation networks. Specifically, four standard indicators were used to evaluate the computational time and space requirements of the proposed BLoss-DDNet and other existing medical image segmentation networks, including Floating-Point Operations Per Second (FLOPS), parameters, training time, and test time. In addition, when calculating all standard indicators of computation time and space requirements, all networks use the same hardware configuration and hyperparameters. The computation time and space requirements of the proposed BLoss-DDNet are as follows: FLOPS of 119.88 G, parameters of 46.01 M, training time of 2.4 seconds per iteration (s/iteration), and test time of 11.3 seconds per image (s/image).
Table 4
| Network | FLOPS (G) | Parameters (M) | Training time (s/iteration) | Test time (s/image) |
|---|---|---|---|---|
| U-Net [29] | 449.91 | 37.66 | 2.5 | 15.8 |
| Unet++ [18] | 225.22 | 44.01 | 2.8 | 11.1 |
| Joint segmentation [20] | 49.28 | 24.40 | 1.9 | 13.9 |
| NucleiSegNet [21] | 86.89 | 5.89 | 2.1 | 21.8 |
| CE-Net [19] | 53.24 | 29.00 | 2.3 | 14.4 |
| HoVer-Net [43] | 96.62 | 48.72 | 2.5 | 12.7 |
| TransUNet [24] | 66.24 | 10.63 | 2.6 | 9.1 |
| GCP-Net [4] | 117.16 | 52.37 | 1.7 | 8.9 |
| AL-net [22] | 102.22 | 27.44 | 2.8 | 11.6 |
| SegFormer [25] | 17.16 | 22.27 | 2.6 | 13.5 |
| BLoss-DDNet (proposed) | 119.88 | 46.01 | 2.4 | 11.3 |
The computation time and space requirements.
4 Discussion
This section conducts the following discussions based on the experimental results. Additionally, this section highlights the study's limitations and outlines its future direction.
4.1 Dual-task decoding branches
One of the reasons why our proposed Bloss-DDNet is effective is attributed to the dual-task decoding branches. The dual-task decoding branches, which incorporate fast remote dependency relationships and global context connections, are constructed using the NAS-mask and NAS-boundary decoders in the backbone network, along with a shared encoder. Specifically, based on the skip connections in residual and SE-Attention sub-blocks to alleviate the problems of gradient vanishing or exploding (; ), the NAS-mask and NAS-boundary focus on the cell nucleus segmentation of masks and boundaries, respectively, forming a dual-task strategy. Therefore, this dual task strategy adopts two effective dimensions, mask and boundary dimensions, to segment the masks and boundaries of the cell nucleus separately.
Furthermore, the NAS-mask and NAS-boundary decoders are complementary to each other. On the one hand, the mask segmentation of the cell nucleus requires the boundary to be restricted. On the other hand, the boundary segmentation of the cell nucleus requires the mask as a supplement. Therefore, the collaborative work of the cell nucleus mask and boundary segmentation of the cell nucleus is the key to solving the problem of connected nuclei in overlapping cell nuclei. Based on the above discussions, the two feature maps, separately generated from the NAS-mask and NAS-boundary, are fused to perform the collaborative work of cell nucleus mask and boundary segmentation, thereby enhancing the sensitivity of cell nucleus boundaries.
4.2 NAS framework
One of the other reasons why our proposed Bloss-DDNet is effective is attributed to the application of the NAS framework (; ). Unlike other segmentation networks, this study introduces the NAS strategy in segmentation tasks to separately determine the dual-task decoding branches' 1# and 2# decoder modules.
Specifically, there are significant differences in semantic information between the mask and the boundary of the cell nucleus. Therefore, based on the above reasons, it is necessary to determine the corresponding decoding for the mask and boundary of the cell nucleus separately to parse the different semantic information corresponding to the decoding feature map generated from the same shared encoder. However, determining which kinds of convolution to use, the connection method between convolutions, and selecting the hyperparameters of the 1# and 2# decoder modules is a technical issue to achieve optimal segmentation of overlapping cell nuclei. When facing the above technical problems, inspired by the NAS strategy in the classification network (), we introduce this NAS strategy to the overlapping cell nucleus segmentation of cervical clinical LBC images. It is precisely because the optimal types of convolution kernels to use, the connection method between convolutions, and hyperparameters of the 1# and 2# decoder modules are effectively determined that the segmentation performance of our proposed Bloss-DDNet is further improved.
4.3 Bending loss
One of the last reasons our proposed Bloss-DDNet is attributed to the proposed bending loss. The core cause of this problem is the lack of a practical calculation for overlapping boundary loss in the training process, which directly affects the recognition of overlapping boundaries by the subsequently trained network.
Specifically, whether it's binary cross-entropy loss LBCE, Dice lossLDSC, or their combination (LDSC+ LBCE), they all pay more attention to the mask of cell nucleus segmentation. Therefore, they are adequate for the mask of cell nucleus segmentation, especially when combined (LDSC+ LBCE). However, this is also the main reason for the problem of nuclear boundary connectivity. Therefore, based on the above reasons, the proposed bending loss LBend is applied to the NAS-boundary. It is sensitive to the curvature changes of the nuclear boundary in the overlapping cell nucleus, thereby solving the nuclear boundary connectivity problem. Meanwhile, the effective and collaborative work between LDSC+ LBCE and LBend in the training process of the network further enhances the segmentation performance of the cell nucleus segmentation mask, supplementing the boundary of the cell nucleus mask.
4.4 The generalization of the overlapping cell nucleus segmentation model based on the proposed Bloss-DDNet
The generalization of the overlapping cell nucleus segmentation models is a core requirement for clinical applications, directly affecting the practicality and value of medical artificial intelligence, and serving as a key bridge connecting technology and clinical practice (; ).
The generalization of the model is directly reflected in the performance on the multi-center LBC dataset. According to the comparative experimental results on the performance of overlapping cell nucleus segmentation models, our proposed overlapping cell nucleus segmentation model based on the proposed Bloss-DDNet exhibits good generalization performance on the public datasets of CNSeg and MoNuSeg. The good generalization performance on the public datasets of CNSeg and MoNuSeg demonstrates that the proposed model can adapt to these changes in cervical clinical LBC images, providing a solid foundation for clinical use of this proposed model for overlapping cell nucleus segmentation.
4.5 Limitations
Although we propose a novel bending loss and dual-task decoding network (Bloss-DDNet) for overlapping cell nucleus segmentation of cervical clinical LBC images, our study still has certain limitations. First, the encoder is shared by 1# and 2# decoder modules, and the NAS strategy is only applied to separately determine the 1# and 2# decoder modules of the dual-task decoding branches. Second, we restricted the types and hyperparameters of sub-modules in the NAS framework to include only the dilated convolution, depthwise separable convolution, 2D MaxPool layer, and SE Attention. Third, although the proposed network has made significant progress in overlapping cell nucleus segmentation of cervical clinical LBC images, the hyperparameters of the proposed network still require further optimization. Lastly, the most representative clinical cases also require further evaluation in practical settings.
4.6 Perspectives and future work
Based on the limitations of this study, we outline the perspective and future work. First, the two decoder modules, along with their respective decoder modules for dual-task decoding branches, can be attempted based on the NAS strategy to achieve better segmentation of the overlapping cell nucleus in cervical clinical LBC images. Second, other types and hyperparameters of sub-modules in the NAS framework can also be added to determine more optimized 1# and 2# decoder modules of the dual-task decoding branches.
5 Conclusion
This study proposed a novel Bloss-DDNet for overlapping cell nucleus segmentation of cervical clinical LBC images. Specifically, dual-task decoding branches composed of a shared encoder module and dual-task optimal decoder modules, determined by the NAS framework, are designed to decode the mask and boundary. Additionally, two feature maps, separately generated from the dual-task decoding branches, are fused to enhance the sensitivity to cell nucleus boundaries. In addition, a bending loss, which focuses on the curvature variation characteristics of the intersection of overlapping cell nucleus boundaries, is introduced to the loss function to constrain the training process of the dual-task decoding branch and increase the constraint on the cell nucleus boundary. The results show that all evaluation metrics of the proposed Bloss-DDNet achieved the best performance on the public data sets. Therefore, the proposed Bloss-DDNet can effectively solve the segmentation problem of overlapping cell clusters and nuclei in clinical LBC images, providing strong support for subsequent clinical auxiliary diagnosis of cervical cancer.
Statements
Data availability statement
Publicly available datasets were analyzed in this study. This data can be found here: https://github.com/jingzhaohlj/AL-Net.
Ethics statement
The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.
Author contributions
GY: Funding acquisition, Resources, Formal analysis, Writing – original draft, Methodology, Software. ZC: Visualization, Writing – original draft, Formal analysis, Software. PG: Methodology, Writing – original draft, Software, Formal analysis. JM: Validation, Formal analysis, Software, Writing – original draft. JH: Project administration, Data curation, Investigation, Conceptualization, Writing – review & editing, Supervision. CJ: Validation, Writing – original draft, Software. XY: Software, Writing – original draft, Formal analysis. KZ: Validation, Writing – original draft, Visualization. YW: Validation, Investigation, Writing – original draft, Visualization. QG: Software, Writing – original draft, Formal analysis. CL: Writing – original draft, Visualization. TW: Formal analysis, Writing – original draft, Software. YL: Writing – original draft, Visualization. YG: Writing – review & editing, Conceptualization, Investigation, Funding acquisition. JZ: Conceptualization, Formal analysis, Resources, Writing – original draft. XC: Conceptualization, Funding acquisition, Writing – original draft, Data curation, Resources. YY: Supervision, Conceptualization, Methodology, Writing – review & editing, Funding acquisition, Investigation, Writing – original draft, Software, Formal analysis, Visualization.
Funding
The author(s) declare that financial support was received for the research and/or publication of this article. This study was supported in part by the Heilongjiang Province Natural Science Foundation Joint Guidance Project (Grant Number: LH2024F044), the Guiding Science and Technology Program Project of Daqing City (Grant Number: zd-2023-23), the Project of 2024 Fundamental Research Funds of Daqing Normal University (Excellent Research and Innovation Team for Information Processing and Intelligent Measurement and Control, 2024-KYYWF-1240), the China post-doctoral Foundation project (Grant Number: 2024M750398), the Science and Technology Projects in Guangzhou (Grant Number: 2023A03J0612), and the National Natural Science Foundation of China (Grant Number: 82572349).
Conflict of interest
ZC, PG, TW, YL, JZ, and YY were employed by Shenzhen Lanmage Medical Technology Co., Ltd. QG was employed by Neusoft Medical System Co., Ltd.
The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Generative AI statement
The author(s) declare that no Gen AI was used in the creation of this manuscript.
Any alternative text (alt text) provided alongside figures in this article has been generated by Frontiers with the support of artificial intelligence and reasonable efforts have been made to ensure accuracy, including review by the authors wherever possible. If you identify any issues, please contact us.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
1
BalakrishnanT.SengarS. S. (2024). RepVGG-GELAN: Enhanced GELAN with VGG-STYLE ConvNets for Brain Tumour Detection. arxiv [preprint]. arxiv:2405.03541. doi: 10.48550/arXiv.2405.03541
2
BengioY.LouradourJ.CollobertR.WestonJ. (2009). “Curriculum learning,” in Proceedings of the 26th Annual International Conference on Machine Learning (New York, NY: Association for Computing Machinery), 41–48.
3
BorawarL.KaurR. (2023). “ResNet: solving vanishing gradient in deep networks,” in Proceedings of International Conference on Recent Trends in Computing: ICRTC 2022 (Singapore: Springer Nature Singapore), 235–247.
4
BrayF.FerlayJ.SoerjomataramI.SiegelR. L.TorreL. A.JemalA. (2020). Erratum: Global Cancer Statistics 2018. GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J. Clin. 70, 313. doi: 10.3322/caac.21609
5
ChenJ.LuY.YuQ.LuoX.AdeliE.WangY.et al. (2102). Transunet: Transformers make strong encoders for medical image segmentation. arxiv [preprint]. arxiv:04306, 2021. Available online at: https://arxiv.org/abs/2102.04306
6
ChenP.LiuF.ZhangJ.WangB. (2024). MFEM-CIN: a lightweight architecture combining CNN and transformer for the classification of Pre-cancerous lesions of the cervix. IEEE Open J. Eng. Med. Biol.5, 216–225. doi: 10.1109/OJEMB.2024.3367243
7
DasA.NandiA.DebI. (2024). “Recent advances in object detection based on YOLO-V4 and faster RCNN: a review,” in Mathematical Modeling for Computer Applications (Beverly, MA: Wiley-Scrivener), 405–417.
8
DengJ.MaY.LiD.ZhaoJ.LiuY.ZhangH. (2020). Classification of breast density categories based on SE-Attention neural networks. Comput. Methods Prog. Biomed.193:105489. doi: 10.1016/j.cmpb.2020.105489
9
DiceL. R. (1945). Measures of the amount of ecologic association between species. Ecology26, 297–302. doi: 10.2307/1932409
10
ElskenT.MetzenJ. H.HutterF. (2019). Neural architecture search: a survey. J. Mach. Learn. Res.20, 1–21. doi: 10.1007/978-3-030-05318-5_11
11
EskandariS.LumppJ.Sanchez GiraldoL. (2023). “Skin lesion segmentation improved by transformer-based networks with inter-scale dependency modeling,” in International Workshop on Machine Learning in Medical Imaging (Cham: Springer Nature Switzerland), 351–360.
12
FedererH. (1959). Curvature measures. Transac. Am. Math. Soc.93, 418–491. doi: 10.1090/S0002-9947-1959-0110078-1
13
GhosalP.PurkayasthaK.RoyA.AgarwalR.SharmaA. L.KumarA. (2025). Compound attention embedded dual channel encoder-decoder for ms lesion segmentation from brain MRI. Multimedia Tools Appl.84, 31139–31171. doi: 10.1007/s11042-024-20416-3
14
GrahamS.VuQ. D.RazaS. E. A.AzamA.TsangY. W.KwakJ. T.et al. (2019). Hover-net: simultaneous segmentation and classification of nuclei in multi-tissue histology images. Med. Image Analysis58:101563. doi: 10.1016/j.media.2019.101563
15
GuZ.ChengJ.FuH.ZhouK.HaoH.ZhaoY.et al. (2019). Ce-net: context encoder network for 2d medical image segmentation. IEEE Transac. Med. Imag.38, 2281–2292. doi: 10.1109/TMI.2019.2903562
16
HaninB. (2018). Which neural net architectures give rise to exploding and vanishing gradients?Adv. Neural Inf. Process. Syst.31, 582–591. doi: 10.48550/arXiv.1801.03744
17
HuangJ.YangG.HeY.LiB.LiangY. (2021). Segmentation of cervical cell images based on generative adversarial networks. IEEE Access9, 115415–115428. doi: 10.1109/ACCESS.2021.3104609
18
HussainE.MahantaL. B.DasC. R.ChoudhuryM.ChowdhuryM. (2020). A shape context fully convolutional neural network for segmentation and classification of cervical nuclei in Pap smear images. Artif. Intell. Med.107:101897. doi: 10.1016/j.artmed.2020.101897
19
KaiserL.GomezA. N.CholletF. (2017). Depthwise separable convolutions for neural machine translation. arXiv [preprint]. arXiv:1706.03059. Available online at: https://arxiv.org/abs/1706.03059
20
KhanF.KatsagannisG.SengarS. S. (2025). “RepSE-CBAMNet: a hybrid attention-enhanced CNN for brain tumor detection,” in Intelligent Health Systems–From Technology to Data and Knowledge (Amsterdam: IOS Press), 567–571.
21
KirillovA.HeK.GirshickR.RotherC.DollárP. (2019). “Panoptic segmentation,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (Long Beach, CA: IEEE), 9404–9413.
22
KumarN.VermaR.SharmaS.BhargavaS.VahadaneA.SethiA. (2017). A dataset and a technique for generalized nuclear segmentation for computational pathology. IEEE Transac. Med. Imag.36, 1550–1560. doi: 10.1109/TMI.2017.2677499
23
LalS.DasD.AlabhyaK.KanfadeA.KumarA.KiniJ. (2021). NucleiSegNet: robust deep learning architecture for the nuclei segmentation of liver cancer histopathology images. Comput. Biol. Med.128:104075. doi: 10.1016/j.compbiomed.2020.104075
24
LiuY.ZhangP.SongQ.LiA.ZhangP.GuiZ. (2018). Automatic segmentation of cervical nuclei based on deep learning and a conditional random field. IEEE Access6, 53709–53721. doi: 10.1109/ACCESS.2018.2871153
25
LuZ.CarneiroG.BradleyA. P. (2015). An improved joint optimization of multiple level set functions for the segmentation of overlapping cervical cells. IEEE Transac. Image Process.24, 1261–1272. doi: 10.1109/TIP.2015.2389619
26
PhouladyH. A.GoldgofD. B.HallL. O.MoutonP. R. (2016). “A new approach to detect and segment overlapping cells in multi-layer cervical cell volume images,” in 2016 IEEE 13th international symposium on biomedical imaging (ISBI) (New York, NY: IEEE), 201–204.
27
QuH.WuP.HuangQ.YiJ.DeS.MetaxasD.et al. (2019). “Joint segmentation and fine-grained classification of nuclei in histopathology images, “ in 2019 IEEE 16th international symposium on biomedical imaging (ISBI 2019) (New York, NY: IEEE), 900–904. doi: 10.1109/ISBI.2019.8759457
28
RodríguezM.CórdovaC.MartínS. S.BenjumedaI. (2024). Automated cervical cancer screening using single-cell segmentation and deep learning: enhanced performance with liquid-based cytology. Computation12:232. doi: 10.3390/computation12120232
29
RonnebergerO.FischerP.BroxT. (2015). “U-net: Convolutional networks for biomedical image segmentation,” in Medical image computing and computer-assisted intervention–MICCAI 2015: proceedings of the 18th international conference, Munich, Germany, October 5-9, 2015, part III (Berlin: Springer International Publishing), 234–241.
30
SchreierJ.AttanasiF.LaaksonenH. (2020). Generalization vs. specificity: in which cases should a clinic train its own segmentation models?Front Oncol.10:675. doi: 10.3389/fonc.2020.00675
31
SengarS. S.PerslevM.DamE. B.MeulengrachtC.BoesenM. P.OvergaardA. F.et al. (2023). Multi-planar 3D knee MRI segmentation via UNet inspired architectures. Int. J. Imaging Syst. Technol.33, 985–998. doi: 10.1002/ima.22836
32
SharmaA. L.SharmaK.GhosalP. (2025). Skin lesion segmentation: a systematic review of computational techniques, tools, and future directions. Comput. Biol. Med.196:110842. doi: 10.1016/j.compbiomed.2025.110842
33
ShawA.HunterD.LandolaF.SidhuS. (2019). “Squeezenas: Fast neural architecture search for faster semantic segmentation,: in Proceedings of the IEEE/CVF International Conference on Computer Vision workshops (New York, NY: IEEE).
34
ShiP.QiuJ.AbaxiS. M. D.ZhangY.LiuY. (2023). Generalist vision foundation models for medical imaging: a case study of segment anything model on zero-shot medical segmentation. Diagnostics13:1947. doi: 10.3390/diagnostics13111947
35
SikarwarS. S.RanaA. K.SengarS. S. (2025). Entropy-driven deep learning framework for epilepsy detection using electro encephalogram signals. Neuroscience577, 12–24. doi: 10.1016/j.neuroscience.2025.05.003
36
WuT.LucasE.ZhaoF.BasuP.QiaoY. (2024). Artificial intelligence strengthenes cervical cancer screening–present and future. Cancer Biol. Med.21:864. doi: 10.20892/j.issn.2095-3941.2024.0198
37
YangG.HuangJ.HeY.ChenY.WangT.JinC.et al. (2022). GCP-Net: a gating context-aware pooling network for cervical cell nuclei segmentation. Mobile Inf. Syst.2022:7511905. doi: 10.1155/2022/7511905
38
YangY.LiQ.GuoY.LiuY.LiX.GuoJ.et al. (2021). Lung parenchyma parameters measure of rats from pulmonary window computed tomography images based on ResU-Net model for medical respiratory researches. Math. Biosci. Eng.18, 4193–4211. doi: 10.3934/mbe.2021210
39
YangY.ZhengJ.GuoP.et al. (2024a). Hemi-diaphragm detection of chest X-ray images based on convolutional neural network and graphics. J. X-Ray Sci. Technol.32, 1273–1295. doi: 10.3233/XST-240108
40
YangY.ZhengJ.GuoP.GaoQ.GuoY.ChenZ.et al. (2024b). Automatic cardiothoracic ratio calculation based on lung fields abstracted from chest X-ray images without heart segmentation. Front. Physiol.15:1416912. doi: 10.3389/fphys.2024.1416912
41
YangY.ZhengJ.GuoP.GaoQ.GuoY.ChenZ.et al. (2025). Three-stage registration pipeline for dynamic lung field of chest X-ray images based on convolutional neural networks. Front. Artif. Intell.8:1466643. doi: 10.3389/frai.2025.1466643
42
YingjianY.ZhangH.LiM.ChenY.WangJ.LiuZ.et al. (2025). An optimization method for hemi-diaphragm measurement of dynamic chest X-ray radiography during respiration based on graphics and diaphragm motion consistency criterion. Front. Physiol.16:1528067. doi: 10.3389/fphys.2025.1528067
43
YuF. (2015). Multi-scale context aggregation by dilated convolutions. arXiv [preprint] arXiv:1577.07122. Available online at: https://arxiv.org/abs/1511.07122
44
ZamanA.HassanH.ZengX.KhanR.LuJ.YangH.et al. (2024). Adaptive feature medical segmentation network: an adaptable deep learning paradigm for high-performance 3D brain lesion segmentation in medical imaging. Front. Neurosci.18:1363930. doi: 10.3389/fnins.2024.1363930
45
ZengX.GuoY.ZamanA.HassanH.LuJ.XuJ.et al. (2023). Tubular structure segmentation via multi-scale reverse attention sparse convolution. Diagnostics13:2161. doi: 10.3390/diagnostics13132161
46
ZhaoJ.HeY.ZhouS. H.QinJ.XieY. (2023). CNSeg: a dataset for cervical nuclear segmentation. Comput. Methods Prog. Biomed.241:107732. doi: 10.1016/j.cmpb.2023.107732
47
ZhaoJ.HeY. J.ZhaoS. Q.HuangJ. J.ZuoW. M. (2021). Al-net: attention learning network based on multi-task learning for cervical nucleus segmentation. IEEE J. Biomed. Health Inform.26, 2693–2702. doi: 10.1109/JBHI.2021.3136568
48
ZhouZ.SiddiqueeM. M. R.TajbakhshN.LiangJ. (2018). “Unet++: A nested u-net architecture for medical image segmentation,” in Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support: Proceedings of the 4th International Workshop, DLMIA 2018, and 8th International Workshop, ML-CDS 2018, Held in Conjunction with MICCAI 2018, Granada, Spain, September 20 (Berlin: Springer International Publishing), 3–11.
Summary
Keywords
cervical cancer, cervical clinical LBC images, cell nucleus segmentation, bending loss, dual decoding network, convolutional neural network
Citation
Yang G, Chen Z, Guo P, Ma J, Huang J, Jin C, Yang X, Zhao K, Wang Y, Gao Q, Liu C, Wu T, Li Y, Guo Y, Zheng J, Cai X and Yang Y (2025) BLoss-DDNet: bending loss and dual-task decoding network for overlapping cell nucleus segmentation of cervical clinical LBC images. Front. Artif. Intell. 8:1649452. doi: 10.3389/frai.2025.1649452
Received
20 June 2025
Revised
29 September 2025
Accepted
07 November 2025
Published
26 November 2025
Volume
8 - 2025
Edited by
Diego Oliva, University of Guadalajara, Mexico
Reviewed by
Sandeep Singh Sengar, Cardiff Metropolitan University, United Kingdom
Palash Ghosal, Sikkim Manipal University, India
Updates
Copyright
© 2025 Yang, Chen, Guo, Ma, Huang, Jin, Yang, Zhao, Wang, Gao, Liu, Wu, Li, Guo, Zheng, Cai and Yang.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Jinjie Huang, huangjinjie163@163.com; Yingwei Guo, guoyingwei@nepu.edu.cn; Jie Zheng, zhengj@lanmage.com; Xiangran Cai, caixran@jnu.edu.cn; Yingjian Yang, yingjian.yang@lanmage.com
† These authors have contributed equally to this work
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.