Skip to main content

ORIGINAL RESEARCH article

Front. Oncol., 09 November 2021
Sec. Radiation Oncology
This article is part of the Research Topic Automation and Artificial Intelligence in Radiation Oncology View all 22 articles

Geometric and Dosimetric Evaluation of Deep Learning-Based Automatic Delineation on CBCT-Synthesized CT and Planning CT for Breast Cancer Adaptive Radiotherapy: A Multi-Institutional Study

  • 1Department of Radiation Therapy, The Second Affiliated Hospital, Guangzhou University of Chinese Medicine, Guangzhou, China
  • 2School of Biomedical Engineering, Southern Medical University, Guangzhou, China
  • 3Department of Oncology, The Fourth Affiliated Hospital, Guangxi Medical University, Liuzhou, China

Purpose: We developed a deep learning model to achieve automatic multitarget delineation on planning CT (pCT) and synthetic CT (sCT) images generated from cone-beam CT (CBCT) images. The geometric and dosimetric impact of the model was evaluated for breast cancer adaptive radiation therapy.

Methods: We retrospectively analyzed 1,127 patients treated with radiotherapy after breast-conserving surgery from two medical institutions. The CBCT images for patient setup acquired utilizing breath-hold guided by optical surface monitoring system were used to generate sCT with a generative adversarial network. Organs at risk (OARs), clinical target volume (CTV), and tumor bed (TB) were delineated automatically with a 3D U-Net model on pCT and sCT images. The geometric accuracy of the model was evaluated with metrics, including Dice similarity coefficient (DSC) and 95% Hausdorff distance (HD95). Dosimetric evaluation was performed by quick dose recalculation on sCT images relying on gamma analysis and dose-volume histogram (DVH) parameters. The relationship between ΔD95, ΔV95 and DSC-CTV was assessed to quantify the clinical impact of the geometric changes of CTV.

Results: The ranges of DSC and HD95 were 0.73–0.97 and 2.22–9.36 mm for pCT, 0.63–0.95 and 2.30–19.57 mm for sCT from institution A, 0.70–0.97 and 2.10–11.43 mm for pCT from institution B, respectively. The quality of sCT was excellent with an average mean absolute error (MAE) of 71.58 ± 8.78 HU. The mean gamma pass rate (3%/3 mm criterion) was 91.46 ± 4.63%. DSC-CTV down to 0.65 accounted for a variation of more than 6% of V95 and 3 Gy of D95. DSC-CTV up to 0.80 accounted for a variation of less than 4% of V95 and 2 Gy of D95. The mean ΔD90/ΔD95 of CTV and TB were less than 2Gy/4Gy, 4Gy/5Gy for all the patients. The cardiac dose difference in left breast cancer cases was larger than that in right breast cancer cases.

Conclusions: The accurate multitarget delineation is achievable on pCT and sCT via deep learning. The results show that dose distribution needs to be considered to evaluate the clinical impact of geometric variations during breast cancer radiotherapy.

Introduction

Intensity-modulated radiotherapy (IMRT) after breast-conserving surgery significantly improves the survival of breast cancer patients (1). However, there are the patient setup error and anatomical structure changes during the interfractional radiotherapy (2). The variation range of mean central lung distance is 0.59–2.94 cm (3). The mean 3D displacement of patient setup is 7.3 and 7.6 mm by laser and port film setup, respectively (4). The deviation could lead to inconsistencies between the actual delivery dose and the planning dose (5). Large interfraction variation is observed, motivating the need for adaptive radiotherapy. Adaptive radiotherapy can automatically adjust the plan according to changes in the target volume (6, 7). When the patient is lying on the couch waiting for treatment, plan evaluation and adaptation need to be completed as quickly as possible. Online adaptation, which requires real-time delineation of the contours of the target volumes and organs at risk (OARs) for re-planning, is a promising technique (8). Some studies have been conducted for online adaptation, especially for prostate cancer as well as for head and neck cancer (913). Cone-beam CT (CBCT) is a common tool for location verification in radiotherapy and can be used for plan adaptation (14, 15). However, imaging artifacts caused by respiratory movement make CBCT-based adaptive radiotherapy for breast cancer infeasible. CBCT images cannot be directly used for dose calculation due to inaccurate HU values and needs to be converted into synthetic CT for dosimetric evaluation (1619).

The delineation of target volumes and OARs is a prerequisite for adaptive radiotherapy. However, manual delineation is time-consuming and labor-intensive and cannot meet the requirements of real-time adaptive radiotherapy (20). It is necessary to build an automatic delineation model (21, 22). Some researchers used atlas-based segmentation software for delineation of target volumes on computed tomography (CT) images for radiotherapy. Dice score of segmentations with these commercial software is not high enough (2326). CBCT-based delineation can be achieved by deformable image registration and direct delineation on CBCT images. Deformable image registration could transfer the contours to CBCT images from planning CT images (27). However, deformable registration relying on the image quality and algorithm cannot perform well for patients with large variations, leading to uncertainty in propagating contours (28). Direct CBCT-based delineation can reduce uncertainty from registration errors. Schreier et al. (29) investigated segmentation for the male pelvis using CBCT and CT images. Peroni et al. (11) developed an automatic strategy to generate online virtual CT and automatically segmented structures using CBCT and virtual CT images for head and neck cancer adaptive radiation therapy. Inter-observer variability is high in the delineation of target volumes and OARs on CT and CBCT scans of the chest. At present, most of the studies on the automatic segmentation of chest medical images do not perform well, and it is necessary to develop a model with better performance to delineate all the target volumes and OARs accurately at one time. Additionally, the geometric metrics do not fully indicate clinical quality. Therefore, it is necessary to evaluate the performance of the automatic delineation model in terms of clinical applicability (30). The geometric and dosimetric changes between planning CT (pCT) and synthetic CT (sCT) needs to evaluated due to high clinical significance for adaptive therapy.

In our study, we investigated the feasibility of automatically delineating multiple contours based on deep learning for breast cancer radiation therapy. The synthetic CT image was first generated from CBCT images with a cycle generative adversarial network (cycleGAN). Second, we developed an automatic delineation model using 3D U-net based on pCT and the radiotherapy structure of breast cancer patients to delineate the target volumes and OARs on planning CT and synthetic CT images, respectively. Third, the treatment plan was transferred to the synthetic CT image from the planning CT image. It could be verified quantitatively by quick dose recalculation for dosimetric evaluation. The Flowchart of the proposed method is shown as Supplementary Figure 1 in the Supplementary Material. The clinical impact of geometric variations in target volumes and OARs was evaluated to provide the feasibility for breast cancer adaptive radiotherapy.

Materials and Methods

Patient Datasets

Datasets obtained from two medical institutions in China between January 2014 and December 2020 were analyzed retrospectively. A total of 1,127 patients (institution A: 1,074/institution B: 53) who received radiotherapy after breast-conserving surgery were included. The data of 75 patients from institution A including pCT and CBCT images with BH were split into 52 samples for training and 23 samples for testing on CBCT-to-CT synthesis. The pCT images and structures of 1,052 patients were randomly divided into a training set (700 patients), validation set (100 patients), and test set (252 patients) for automatic delineation model training and evaluation. Among the test set, 199 patients were from institution A, and 53 patients were from institution B. The patient characteristics are summarized in Table 1.

TABLE 1
www.frontiersin.org

Table 1 Summary of patient characteristics.

Patients were immobilized on the breast bracket before obtaining a CT scan with 5 mm slices (SOMATOM Sensation Open, Siemens). The dimensions of the images were 512 × 512 voxels for each slice. CBCT is widely used for target position verification and setup error correction during breast patient radiation therapy. In this study, CBCT images were captured by a Varian Edge treatment machine (Varian Medical Systems, Palo Alto) in half-fan mode utilizing breath-hold (BH) guided by AlignRT (Vision RT Ltd, London, UK). The images with 512 × 512 voxels for each slice were reconstructed with a 1.99 mm slice thickness. The quality of CBCT with the BH technique is much higher than that with conventional scan. CBCT could be used to generate accurate synthetic CT for dose recalculation.

Clinical target volumes (CTV), tumor bed (TB), and organs at risk (OARs) were delineated by two radiation oncologists according to the ESTRO consensus guideline. The director with 20 years’ experience of the radiation oncology department of the corresponding institution was consulted in cases of disagreement. Manually delineated contours were used as ground truth for training and testing. The radiotherapy plans were designed with the Pinnacle3 treatment planning system (Philips Radiation Oncology Systems, Philips Healthcare) by combining 3D conformal radiation therapy (CRT) and intensity modulated radiation therapy (IMRT). The prescribed dose was 52.2 Gy given to CTV and 63.8 Gy given to TB in 29 fractions. CRT achieved 80% of the total dose, and IMRT achieved 20% of the total dose. One hundred percent of the prescribed dose covered 95% of the volume of the target area. The physicist first designed the plan, and then the radiation oncologist and the physicist jointly evaluated the plan before implementation to ensure the quality of the plan.

Automatic Delineation of Target Volumes and Organs at Risk

Our automatic delineation model is applied to 3D volume. Patch-based training makes the model cannot judge left and right lungs and target volumes. Therefore, through a series of preprocessing steps, as shown in Figure 1A, we feed the human body volume as completely as possible into the network, so that the network has a larger receptive field. First, the Hough transform line detection, the threshold method, and the morphological method were used to remove the bed and obtain a human body mask. Then, the minimum circumscribed cube is cropped from the body mask, which is the region of interest (ROI) of each subject. Finally, the spatial resolution of all ROIs is converted to 2 × 2 × 5 mm3, and the intensity is normalized by z-score for training.

FIGURE 1
www.frontiersin.org

Figure 1 The workflow of the automatic delineation model. (A) automatic preprocessing, (B) training phase, (C) testing phase.

We use Res-SE-U-Net (31) as the automatic delineation network, which is a modified 3D U-Net (32). Res-SE-U-Net includes the down-sampling path, up-sampling path, and skip-connection layer, which can extract the multiscale features of images. In addition, the addition of Res-block and SE-block leads to its stronger feature extraction ability than the original U-Net. The workflow of the automatic delineation model is shown in Figure 1. Training of a network took about 48 h, whereas all the target volumes and OARs for one patient were predicted in 5 s.

CBCT-to-CT Synthesis

We use a 2D cycleGAN (33), which is an unsupervised image-to-image translation deep learning framework, to generate sCT. The cycleGAN contains two generators (GCBCTCT and GCT–CBCT) and two discriminators (DCT and DCBCT). The generator GCBCTCT takes CBCT as input and generates the sCT; in contrast, GCT–CBCT takes CT as input and generates the synthetic CBCT. The discriminator DCT and DCBCT discriminates whether the CT or CBCT images are real or synthesized, respectively. The sCT of one patient could be generated in 3–4 s by the trained model. The schematic flow is shown as Supplementary Figure 2 in the Supplementary Material.

The optimization of the cycleGAN includes two objective functions: adversarial loss and cycle consistency loss. The antagonistic objectives of generators and discriminators are reflected in adversarial loss. We denote the data distribution as ICT ~ pdata(ICT) and ICBCT ~ pdata(ICBCT). The adversarial loss is expressed as:

GAN(GCBCTCT,DCT,ICT,ICBCT)=EICT~pdata (ICT)[logDCT(ICT)]+EICBCT~pdata (ICBCT)[log(1DCT(GCBCTCT(ICBCT)))](1)

where ICBCT is the real CBCT and GCBCT–CT (ICBCT) is the synthetic CT generated by GCBCT–CT.

Geometric Evaluation

Automatic Delineation Performance Evaluation

The performance of the automatic delineation model was evaluated on pCT and sCT, respectively. To quantitatively assess the delineation accuracy, we used two metrics: Dice similarity coefficient (DSC) and 95% Hausdorff distance (HD95). DSC describes the spatial overlap between the automated delineation and the ground-truth. The metrics HD95 was used to evaluate the shape difference in the study. The equations are defined as Supplementary Equations (1, 2) in the Supplementary Material.

CBCT-Synthesized sCT Quality Evaluation

Mean error (ME), mean absolute error (MAE), peak signal to noise ratio (PSNR), structural similarity index (SSIM), and spatial non-uniformity (SNU) were used to evaluate the image quality of sCT and CBCT, respectively. The formulas for these metrics are defined as Supplementary Equations (4–8) in the Supplementary Material. We selected five regions of interest (ROIs) to calculate the SNU, as shown in Supplementary Figure 3 of the Supplementary Material. ME and MAE are the magnitudes of the difference between the pCT and the sCT. The lower these values are, the better the image quality is. High PSNR and SSIM mean high image quality. In this study, deformable registration was performed on the sCT to align it with pCT, and the metrics were calculated within the body mask of the sCT.

Dosimetric Evaluation

Dosimetric accuracy was evaluated based on the sCT images using clinical breast cancer treatment plans. A quick dose recalculation on the sCT images was performed to verify the treatment plan. The treatment plan that was transferred to the sCT from the pCT kept the same parameters as the original pCT-based plan. The difference in dose distribution between pCT and sCT was evaluated with gamma analysis and dose-volume histogram (DVH) parameters. The difference in DVH metrics of target volumes and OARs between pCT and sCT were also assessed for quantitative dosimetric evaluation. The DVH metrics of the target volumes, including D90, D95, and V95, were analyzed. Target coverage was defined as the dose received by 90 and 95% of the target volume (D90, D95) and the percent volume receiving 95% of the prescribed dose (V95) for the TB and CTV. If the dose difference in the target volumes and OARs on the sCT exceeds the threshold, it needs to rescan the pCT for re-planning. ΔD90, ΔD95, and ΔV95 are defined as:

ΔD90=|D90(pCT)D90(sCT)|(2)
ΔD95=|D95(pCT)D95(sCT)|(3)
ΔV95=|V95(pCT)V95(sCT)|(4)

We investigated the relationship between the DSC and the dose difference to evaluate the effect of anatomical changes on dose during radiotherapy. sCT images were rigidly registered to pCT by reference to the bony landmarks. DSC-CTV for automatically delineating CTV on sCT images compared with manually delineating target volumes on pCT images was correlated with dosimetric metrics.

Clinical Evaluation

The reproducibility and robustness of the automatic delineation model were evaluated using DSC and HD95 in a multi-institution study. The training set was from institution A. Of the 252 patients in the test set, 199 were from institution A and 53 were from institution B. The robustness of the model was validated by multi-institutional testing.

Clinical evaluation of the automatic delineation model was performed on an independent test set of 199 pCT scans and 23 sCT from institution A. The automatically delineating contours were checked by three groups a, b, and c in institution A based on their clinical experience. Each group consisted of two radiation oncologists. Three groups who were blinded to the ground truth contours reviewed the automatic delineating contours. The evaluation results were acceptable with no corrections, acceptable with minor corrections, and unacceptable respectively. Finally, the acceptable ratio of all the targets and OARs was analyzed.

Statistical Analysis

MATLAB (version 2018b, The MathWorks Inc, Natick, MA, USA) was used for statistical analysis. A t test was used to test the statistical significance of the absolute difference of the dosimetric metrics for both plans, and a Spearman’s rank correlation test was used for correlation testing between DSC and ΔV95 or ΔD95 of CTV. Two-sided p-values were provided, and p-values <0.05 were considered significant.

Results

Geometric Evaluation

The ME, MAE, PSNR, and SSIM comparisons between the CBCT, synthetic CT (sCT), and planning CT (pCT) images are shown in Table 2. The average ME and MAE between CBCT and pCT images within the body was −37.71 ± 15.49 and 86.42 ± 10.12 HU, whereas the average ME and MAE between sCT and pCT images was 8.46 ± 11.88 and 71.58 ± 8.78 HU. The mean SNUs for CBCT, sCT, and pCT were 9.22 ± 3.89, 4.95 ± 4.13, 2.12 ± 0.85%, respectively. The HU value of sCT image is much closer to that of pCT image than that of CBCT image. The similarity increased obviously between sCT and pCT images with lower ME, MAE and higher PSNR, SSIM compared to CBCT and pCT images. The detailed comparison between pCT and sCT is shown as Supplementary Figure 3 in the Supplementary Material.

TABLE 2
www.frontiersin.org

Table 2 Similarity analysis between CBCT and pCT images, sCT and pCT images with all the testing patient datasets.

Figure 2 shows examples of the ground truth and the contours of automatic delineation on pCT and sCT images. There is good consistency for CTV and OARs between automatic delineation and manual delineation from human experts on pCT. The concordance can be found to decrease at the upper and lower bounds of the CTV from 2D sagittal sCT images. The automatically drawn tumor bed (TB) on sCT is obviously larger than the manually drawn TB.

FIGURE 2
www.frontiersin.org

Figure 2 Comparison between the ground truth (GT) and automatic delineation (AD) at axial plane, coronal plane, sagittal plane, P1:A indicates GT on pCT for patient 1, P1:B indicates AD on pCT for patient 1; P2:A indicates GT on pCT for patient 2, P2:B indicates AD on pCT for patient 2; P3:A indicates GT on sCT for patient 3, P3:B indicates AD on sCT for patient 3.

The testing results of automatic delineation of multiple institutions are shown in Table 3. The results of pCT were calculated among 199 patients from institution A and 53 patients from institution B, respectively. The results of sCT were calculated among 23 patients from institution A for CBCT-to-CT synthesis testing cohorts. Good DSC and HD95 scores were found for the most contours on pCT (DSC: 0.73–0.97, HD95: 2.22–9.36 mm). The performance was slightly lower for the contours on sCT from institution A (DSC: 0.63–0.95, HD95: 2.30–19.57 mm). The mean DSC of CTV was 0.88 ± 0.03 for pCT, and 0.83 ± 0.03 for sCT, respectively. The segmentation model was also effective for pCT from institution B (DSC: 0.70–0.97, HD95: 2.10–11.43 mm). The mean DSC of CTV on pCT from institution B was 0.80 ± 0.06. The accuracy of automatic delineation for the datasets from institution B was lower than that from institution A.

TABLE 3
www.frontiersin.org

Table 3 Quantitative results (Mean ± SD) of automatic delineation performance in multiple institutions.

The clinical evaluation showed that the acceptable ratios of OARs, CTV, and TB were 76.38–100, 70.35–83.92, and 53.27–57.79% on pCT images and 73.91–82.61, 69.57–78.26, and 43.48–52.17% on sCT images, respectively, as shown in Table 4. Overall, the automatic delineation of CTV and OARs was clinically acceptable after minor corrections by the evaluation of medical group a, b, and c.

TABLE 4
www.frontiersin.org

Table 4 Acceptable ratio for automatic delineation among different groups.

Dosimetric Evaluation

The dose distribution and dose-volume histogram (DVH) of the plan on synthetic CT (sCT) and planning CT (pCT) are shown in Figure 3. P1:A and P2:A indicate the dose distribution on pCT, and P1:B and P2:B indicate the dose distribution on sCT. The red line represents TB, and the blue shaded area represents the dose of 63.8 Gy. The wathet line represents CTV, and the yellow shaded area represents the dose of 52.2 Gy. P1:C and P2:C indicate the DVH of the two plans. The solid line represents the DVH on pCT, and the dotted line represents the DVH on sCT.

FIGURE 3
www.frontiersin.org

Figure 3 Dose distribution and DVH of the plans on pCT and sCT.

Within the body, the mean ± standard deviation with 2%/2 mm and 3%/3 mm pass rates for the sCT images were 85.09 ± 6.28 and 91.46 ± 4.63% respectively. There was a negative correlation between DSC and ΔV95 or ΔD95 (r= −0.52, p= 2.4075E-11 and r= −0.51, p= 4.5815E-11, respectively). DSC of CTV down to 0.65 accounted for a variation of more than 6% of V95 and 3 Gy of D95 for CTV. DSC of CTV up to 0.80 accounted for a variation of less than 4% of V95 and 2 Gy of D95 for CTV, as shown in Figure 4.

FIGURE 4
www.frontiersin.org

Figure 4 (A) The relationship between DSC and ΔV95 of CTV; (B) the relationship between DSC and ΔD95 of CTV.

Dosimetry evaluation of the plans on sCT versus original plans for 29 fractions is summarized in Table 5. The mean ΔV95 of CTV is less than 6%. The mean ΔD90/ΔD95 of CTV is less than 2 Gy/4 Gy. The mean ΔD90/ΔD95 of tumor bed was less than 4 Gy/5 Gy for all patients. We observed an absolute difference of more than 8% of the ΔV95 of TB. The poor delineation accuracy of TB leads to large dosimetry errors. The mean ΔD95 of CTV and ΔV10 of the heart are 4.20 ± 1.45 Gy and 3.92 ± 3.29% in the left-sided patients, 2.84 ± 0.84 Gy and 1.60 ± 1.96% in the right-sided patients, respectively. The dosimetric difference of target volume and heart in left-sided patients is greater than that in right-sided patients. P-values of the dosimetric difference of the TB and CTV were below 0.05, and p-values of the dosimetric difference of the OAR were over 0.05.

TABLE 5
www.frontiersin.org

Table 5 Absolute difference of the dosimetric metrics for both plans of 23 patients.

Discussion

Adaptive radiotherapy based on CBCT for patient setup is a promising approach for improving treatment accuracy (34). Liu et al. (35) developed a deep learning approach to generate CBCT-based synthetic CT images and validated the dose calculation accuracy for clinical use in CBCT-guided pancreatic adaptive radiotherapy. However, sCT-based segmentation was not involved, which was also the key factor in adaptive radiotherapy. In our study, the synthetic CT image quality analysis of the thorax yielded an ME/MAE of 8.46/71.58 HU, and our results were better than those reported by Eckl et al. (36), with 29.6/94.2 HU. The SNU in synthetic CT was close to the SNU in planning CT. It demonstrated that synthetic CT had enough quality for contour delineation and dose calculation. The automatic delineation model that was developed by 3D Res-SE-U-Net based on the planning CT and RT structures made full use of the 3D correlative information between image slices. The automatic delineation model performs well enough with 0.88 DSC for CTV on planning CT. The performance of the model was lower for synthetic CT because of the inaccurate HU and image artifacts caused by respiratory in synthetic CT. The clinically meaningful evaluation of the performance of the model should include not only geometric difference but also dosimetric assessment (37, 38). In this study, the geometric and dosimetric differences between the contours on planning CT and the contours on synthetic CT were analyzed to assess the clinical impact of the changes in target volumes and OARs during radiotherapy. The interobserver variability is large for the contours of breast cancer, resulting in difficulty delineating exactly (39). We improved the robustness of the model by enlarging the datasets to over 1,000. The automatic delineation of CTV and OARs was more consistent with the manual delineation due to their regular shapes and locations. Tumor bed was significantly different between automatic and manual contours because the position of the tumor bed varied greatly for each patient. The results of the multi-institutional test showed that the model is robust and accurate. The performance of the model on the datasets from institution B was worse than that from institution A. Our approach was effective in dosimetric verification based on synthetic CT from CBCT, and ΔV95 and ΔD95 of CTV could be used as dosimetric metrics for rescanning pCT. There was a correlation between DSC and ΔD95 and ΔV95 for CTV; however, it was not an inversely proportional relationship. Poor DSC scores do not necessarily lead to inferior CTV dosimetry. The dose variation between the automatic delineation CTV on sCT images and the manual delineation CTV on planning CT images was not large if the DSC value was low due to the automatic delineation being too small. We evaluated the absolute difference of the dosimetric metrics for both plans. Geometric changes on synthetic CT have a greater impact on the cardiac dose difference in left breast cancer, and special attention needs to be paid to assess the cardiac dose for left breast cancer. ΔV95, ΔD95, and ΔD90 could be used as evaluation indicators for whether to re-plan.

Additional limitations include the following: (1) Deformable registration from planning CT to CBCT was performed because of the different slice thicknesses and scanned areas between the two images. Although deformable registration was used, it was difficult to align the anatomical structure in CBCT with the same structure in planning CT. The image quality of synthetic CT could be degraded due to the registration errors, which affect the delineation accuracy of the model to a certain extent. (2) DSC-CTV was computed by rigid registration between synthetic CT and planning CT. However, the limited registration accuracy could cause certain dosimetric uncertainties in CTV. (3) The synthetic CT was generated from any day’s CBCT, not entire treatment course. The anatomical changes and dosimetric difference were not evaluated during entire treatment delivery course.

The ranges of clinically acceptable ratio for CTV delineation are between 70% and 83% among the different groups, showing no common objective evaluation of the delineation. Variability exists between observer groups, demonstrating that the difference between automatic and manual delineation depends not only on contouring routines and guidelines, but also on personal preference. In the future, we hope to develop a universal model that can not only meet the quality requirements of multiple clinical institutions, but also adapt to the personal preferences of each observer. The automatically generated contours could be carefully reviewed by the radiation oncologist and used for treatment planning.

Conclusion

This study demonstrated that the developed approaches are capable of reliably generating target and OAR contours on pCT and daily sCT images from CBCT images, which could greatly accelerate the re-planning process and meet the requirements of online plan adaptation. The automatic delineation model performed sufficiently well for most patients. The geometric and dosimetric differences between pCT and sCT images in fractional radiotherapy need to be evaluated due to the high clinical significance for breast cancer adaptive radiotherapy.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics Statement

The studies involving human participants were reviewed and approved by the medical ethics committee of the Second Affiliated Hospital of Guangzhou University of Chinese Medicine. Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements.

Author Contributions

ZD and YZ: design of methodology, development and implement of models, original drafting. LZ: data curation and preprocessing. GY, BZ, CC, and WJ: experimental results analysis, draft reviewing. JT, HJ, HM, and XT: data collection. WY and XW: design of methodology, review and editing. All authors contributed to the article and approved the submitted version.

Funding

This work is supported in part by the National Natural Science Foundation of China (81771916) and Guangzhou Science and Technology Plan (202102010264).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Acknowledgments

The authors sincerely thank Dr. Jing Cai of the Hong Kong Polytechnic University for his draft reviewing.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fonc.2021.725507/full#supplementary-material

References

1. Macchia G, Cilla S, Buwenge M, Zamagni A, Ammendolia I, Zamagni C, et al. Intensity-Modulated Radiotherapy With Concomitant Boost After Breast Conserving Surgery: A Phase I–II Trial. Breast Cancer: Targets Ther (2020) 12:243–9. doi: 10.2147/BCTT.S261587

CrossRef Full Text | Google Scholar

2. Saliou MG, Giraud P, Simon L, Fournier-Bidoz N, Fourquet A, Dendale R, et al. Radiotherapy for Breast Cancer: Respiratory and Set-Up Uncertainties. Cancer Radiother (2005) 9:414–21. doi: 10.1016/j.canrad.2005.09.003

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Smith RP, Bloch P, Harris EE, McDonough J, Sarkar A, Kassaee A, et al. Analysis of Interfraction and Intrafraction Variation During Tangential Breast Irradiation With an Electronic Portal Imaging Device. Int J Radiat Oncol Biol Phys (2005) 62(2):373–8. doi: 10.1016/j.ijrobp.2004.10.022

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Bert C, Metheany KG, Doppke KP, Taghian AG, Powell SN, Chen GT. Clinical Experience With a 3D Surface Patient Setup System for Alignment of Partial-Breast Irradiation Patients. Int J Radiat Oncol Biol Phys (2006) 64(4):1265–74. doi: 10.1016/j.ijrobp.2005.11.008

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Baroni G, Garibaldi C, Scabini M, Riboldi M, Catalano G, Tosi G, et al. Dosimetric Effects Within Target and Organs at Risk of Interfractional Patient Mispositioning in Left Breast Cancer Radiotherapy. Int J Radiat Oncol Biol Phys (2004) 59(3):861–71. doi: 10.1016/j.ijrobp.2004.02.043

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Zegers CML, Baeza JA, van Elmpt W, Murrer LHP, Verhoeven K, Boersma L, et al. Three-Dimensional Dose Evaluation in Breast Cancer Patients to Define Decision Criteria for Adaptive Radiotherapy. Acta Oncol (2017) 56(11):1487–94. doi: 10.1080/0284186X.2017.1349334

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Hurkmans CW, Dijckmans I, Reijnen M, van der Leer J, van Vliet-Vroegindeweij C, van der Sangen M. Adaptive Radiation Therapy for Breast IMRT Simultaneously Integrated Boost: Three-Year Clinical Experience. Radiother Oncol (2012) 103:183–7. doi: 10.1016/j.radonc.2011.12.014

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Lim-Reinders S, Keller BM, Al-Ward S, Sahgal A, Kim A. Online Adaptive Radiation Therapy. Int J Radiat Oncol Biol Phys (2017) 99(4):994–1003. doi: 10.1016/j.ijrobp.2017.04.023

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Zhang J, Ahunbay E, Li XA. Technical NoteAcceleration of Online Adaptive Replanning With Automation and Parallel Operations. Med Phys (2018) 45(10):4370–6. doi: 10.1002/mp.13106

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Liang X, Zhao W, Hristov D, Buyyounouski MK, Hancock SL, Bagshaw H, et al. A Deep Learning Framework for Prostate Localization in Cone Beam CT Guided Radiotherapy. Med Phys (2020) 47(9):4233–40. doi: 10.1002/mp.14355

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Peroni M, Ciardo D, Spadea MF, Riboldi M, Comi S, Alterio D, et al. Automatic Segmentation and Online virtual CT in Head-And-Neck Adaptive Radiation Therapy. Int J Radiat Oncol Biol Phys (2012) 84(3):427–33. doi: 10.1016/j.ijrobp.2012.04.003

CrossRef Full Text | Google Scholar

12. Peng Y, Chen S, Qin A, Chen M, Gao X, Liu Y, et al. Magnetic Resonance-Based Synthetic Computed Tomography Images Generated Using Generative Adversarial Networks for Nasopharyngeal Carcinoma Radiotherapy Treatment Planning. Radiother Oncol (2020) 150:217–24. doi: 10.1016/j.radonc.2020.06.049

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Dai X, Lei Y, Wang T, Dhabaan AH, McDonald M, Beitler JJ, et al. Head-And-Neck Organs-at-Risk Auto-Delineation Using Dual Pyramid Networks for CBCT-Guided Adaptive Radiotherapy. Phys Med Biol (2021) 66(4):045021. doi: 10.1088/1361-6560/abd953

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Stankiewicz M, Li W, Rosewall T, Tadic T, Dickie C, Velec M. A Patterns of Practice of Adaptive Re-Planning for Anatomic Variances During Cone-Beam CT Guided Radiotherapy. Tech Innovations Patient Support Radiat Oncol (2019) 12:50–5. doi: 10.1016/j.tipsro.2019.10.003

CrossRef Full Text | Google Scholar

15. Qin Y, Zhang F, Yoo DS, Kelsey CR, Yin FF, Cai J, et al. Adaptive Stereotactic Body Radiation Therapy Planning for Lung Cancer. Int J Radiat Oncol Biol Phys (2013) 87(1):209–15. doi: 10.1016/j.ijrobp.2013.05.008

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Almatani T, Hugtenburg RP, Lewis RD, Barley SE, Edwards MA. Automated Algorithm for CBCT-Based Dose Calculations of Prostate Radiotherapy With Bilateral Hip Prostheses. Br J Radiol (2016) 89:20160443. doi: 10.1259/bjr.20160443

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Li Y, Zhu J, Liu Z, Teng J, Xie Q, Zhang L, et al. A Preliminary Study of Using a Deep Convolution Neural Network to Generate Synthesized CT Images Based on CBCT for Adaptive Radiotherapy of Nasopharyngeal Carcinoma. Phys Med Biol (2019) 64:145010. doi: 10.1088/1361-6560/ab2770

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Maspero M, Houweling AC, Savenije MHF, van Heijst TCF, Verhoeff JJC, Kotte ANTJ, et al. A Single Neural Network for Cone-Beam Computed Tomography-Based Radiotherapy of Head-and-Neck, Lung and Breast Cancer. Phys Imaging Radiat Oncol (2020) 14:24–31. doi: 10.1016/j.phro.2020.04.002

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Sun H, Fan R, Li C, Lu Z, Xie K, Ni X, et al. Imaging Study of Pseudo-CT Synthesized From Cone-Beam CT Based on 3D CycleGAN in Radiotherapy. Front Oncol (2021) 11:603844. doi: 10.3389/fonc.2021.603844

PubMed Abstract | CrossRef Full Text | Google Scholar

20. van Dijk LV, Van den Bosch L, Aljabar P, Peressutti D, Both S, Steenbakkers JHM, et al. Improving Automatic Delineation for Head and Neck Organs at Risk by Deep Learning Contouring. Radiother Oncol (2020) 142:115–23. doi: 10.1016/j.radonc.2019.09.022

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Eldesoky AR, Francolini G, Thomsen MS, Yates ES, Nyeng TB, Kirkove C, et al. Dosimetric Assessment of an Atlas Based Automated Segmentation for Loco-Regional Radiation Therapy of Early Breast Cancer in the Skagen Trial 1: A Multi-Institutional Study. Clin Trans Radiat Oncol (2017) 2:36–40. doi: 10.1016/j.ctro.2017.01.004

CrossRef Full Text | Google Scholar

22. Simões R, Wortel G, Wiersma TG, Janssen TM, van der Heide UA, Remeijer P. Geometrical and Dosimetric Evaluation of Breast Target Volume Autocontouring. Phys Imaging Radiat Oncol (2019) 12:38–43. doi: 10.1016/j.phro.2019.11.003

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Anders LC, Stieler F, Siebenlist K, Schäfer J, Lohr F, Wenz F. Performance of an Atlas-Based Autosegmentation Software for Delineation of Target Volumes for Radiotherapy of Breast and Anorectal Cancer. Radiother Oncol (2012) 102:68–73. doi: 10.1016/j.radonc.2011.08.043

PubMed Abstract | CrossRef Full Text | Google Scholar

24. La Macchia M, Fellin F, Amichetti M, Cianchetti M, Gianolini S, Paola V, et al. Systematic Evaluation of Three Different Commercial Software Solutions for Automatic Segmentation for Adaptive Therapy in Head-and-Neck, Prostate and Pleural Cancer. Radiat Oncol (2012) 7:160. doi: 10.1186/1748-717X-7-160

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Kaderka R, Gillespie EF, Mundt RC, Bryant AK, Sanudo-Thomas CB, Harrison AL, et al. Geometric and Dosimetric Evaluation of Atlas Based Auto-Segmentation of Cardiac Structures in Breast Cancer Patients. Radiother Oncol (2019) 131:215–20. doi: 10.1016/j.radonc.2018.07.013

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Frederick A, Roumeliotis M, Grendarova P, Craighead P, Abedin T, Watt E, et al. A Framework for Clinical Validation of Automatic Contour Propagation: Standardizing Geometric and Dosimetric Evaluation. Pract Radiat Oncol (2019) 9:448–55. doi: 10.1016/j.prro.2019.06.017

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Hou J, Guerrero M, Chen W, D'Souza WD. Deformable Planning Ct to Cone-Beam Ct Image Registration in Head-and-Neck Cancer. Med Phys (2011) 38(4):2088–94. doi: 10.1118/1.3554647

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Wu RY, Liu AY, Williamson TD, Yang J, Wisdom PG, Zhu XR, et al. Quantifying the Accuracy of Deformable Image Registration for Cone-Beam Computed Tomography With a Physical Phantom. J Appl Clin Med Phys (2019) 20(10):92–100. doi: 10.1002/acm2.12717

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Schreier J, Genghi A, Laaksonen H, Morgas T, Haas B. Clinical Evaluation of a Full-Image Deep Segmentation Algorithm for the Male Pelvis on Cone-Beam CT and CT. Radiother Oncol (2020) 145:1–6. doi: 10.1016/j.radonc.2019.11.021

PubMed Abstract | CrossRef Full Text | Google Scholar

30. van Rooij W, Dahele M, Ribeiro Brandao H, Delaney AR, Slotman BJ, Verbakel WF. Deep Learning-Based Delineation of Head and Neck Organs at Risk: Geometric and Dosimetric Evaluation. Int J Radiat Oncol Biol Phys (2019) 104(3):677–84. MBChB. doi: 10.1016/j.ijrobp.2019.02.040

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Wang X, Yang G, Zhang Y, Zhu L, Xue X, Zhang B, et al. Automated Delineation of Nasopharynx Gross Tumor Volume for Nasopharyngeal Carcinoma by Plain CT Combining Contrast-Enhanced CT Using Deep Learning. J Radiat Res Appl Sci (2020) 13(1):568–77. doi: 10.1080/16878507.2020.1795565

CrossRef Full Text | Google Scholar

32. Ronneberger O, Fischer P, Brox T. U-Net: Convolutional Networks for Biomedical Image Segmentation. In: Presented at the Int Conf Munich, Germany: Medical Image Computing and Computer-Assisted Intervention (2015). p. 234–41.

Google Scholar

33. Zhu J-Y, Park T, Isola P, Efros A. Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks. Venice, Italy: IEEE International Conference on Computer Vision (ICCV) (2017).

Google Scholar

34. Kurz C, Nijhuis R, Reiner M, Ganswindt U, Thieke C, Belka C, et al. Feasibility of Automated Proton Therapy Plan Adaptation for Head and Neck Tumors Using Cone Beam Ct Images. Radiat Oncol (2016) 11:64. doi: 10.1186/s13014-016-0641-7

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Liu Y, Lei Y, Wang T, Fu Y, Tang X, Curran WJ, et al. CBCT-Based Synthetic CT Generation Using Deep-Attention cycleGAN for Pancreatic Adaptive Radiotherapy. Med Phys (2020) 47(6):2472–83. doi: 10.1002/mp.14121

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Eckl M, Hoppen L, Sarria GR, Boda-Heggemann J, Simeonova-Chergou A, Steil V, et al. Evaluation of a Cycle-Generative Adversarial Network-Based Cone-Beam CT to Synthetic CT Conversion Algorithm for Adaptive Radiation Therapy. Physica Med (2020) 80:308–16. doi: 10.1016/j.ejmp.2020.11.007

CrossRef Full Text | Google Scholar

37. Tsuji SY, Hwang A, Weinberg V, Yom SS, Quivey JM, Xia P. Dosimetric Evaluation of Automatic Segmentation for Adaptive IMRT for Head-and-Neck Cancer. Int J Radiat Oncol Biol Phys (2010) 77(3):707–14. doi: 10.1016/j.ijrobp.2009.06.012

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Cao M, Stiehl B, Yu V, Sheng K, Kishan AU, Chin RK, et al. Analysis of Geometric Performance and Dosimetric Impact of Using Automatic Contour Segmentation for Radiotherapy Planning. Front Oncol (2020) 10:1762. doi: 10.3389/fonc.2020.01762

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Men K, Zhang T, Chen X, Chen B, Tang Y, Wang S, et al. Fully Automatic and Robust Segmentation of the Clinical Target Volume for Radiotherapy of Breast Cancer Using Big Data and Deep Learning. Physica Med (2018) 50:13–9. doi: 10.1016/j.ejmp.2018.05.006

CrossRef Full Text | Google Scholar

Keywords: deep learning, automatic delineation, synthetic CT, dosimetric evaluation, adaptive radiotherapy

Citation: Dai Z, Zhang Y, Zhu L, Tan J, Yang G, Zhang B, Cai C, Jin H, Meng H, Tan X, Jian W, Yang W and Wang X (2021) Geometric and Dosimetric Evaluation of Deep Learning-Based Automatic Delineation on CBCT-Synthesized CT and Planning CT for Breast Cancer Adaptive Radiotherapy: A Multi-Institutional Study. Front. Oncol. 11:725507. doi: 10.3389/fonc.2021.725507

Received: 15 June 2021; Accepted: 12 October 2021;
Published: 09 November 2021.

Edited by:

Jose Eduardo Villarreal Barajas, Royal Devon and Exeter Hospital, United Kingdom

Reviewed by:

Sarah Quirk, University of Calgary, Canada
Xudong Xue, Hubei Cancer Hospital, China

Copyright © 2021 Dai, Zhang, Zhu, Tan, Yang, Zhang, Cai, Jin, Meng, Tan, Jian, Yang and Wang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Wei Yang, weiyanggm@gmail.com; Xuetao Wang, wangxuetao0625@126.com

These authors have contributed equally to this work and share first authorship

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.