Application of artificial intelligence in predicting lymph node metastasis in breast cancer
Gabrielle O. Windsor1 
Zhicheng Jiao- 1Department of Diagnostic Imaging, Brown University, Providence, RI, United States
- 2Department of Radiology and Radiological Sciences, Johns Hopkins University, Baltimore, MD, United States
Breast cancer is a leading cause of death for women globally. A characteristic of breast cancer includes its ability to metastasize to distant regions of the body, and the disease achieves this through first spreading to the axillary lymph nodes. Traditional diagnosis of axillary lymph node metastasis includes an invasive technique that leads to potential clinical complications for breast cancer patients. The rise of artificial intelligence in the medical imaging field has led to the creation of innovative deep learning models that can predict the metastatic status of axillary lymph nodes noninvasively, which would result in no unnecessary biopsies and dissections for patients. In this review, we discuss the success of various deep learning artificial intelligence models across multiple imaging modalities in their performance of predicting axillary lymph node metastasis.
Introduction
Breast cancer remains a prevalent disease both globally and within the U.S., with approximately 1 in 8 U.S. women estimated to develop invasive breast cancer during their lifetime (1). One of the hallmarks of cancer includes its propensity to metastasize to distant regions of the body, leading to a worse prognosis for the patient. When breast cancer metastasizes, it generally spreads first to the axillary lymph nodes, due to their proximity in the underarm region. Therefore, axillary lymph nodes aid in determining breast cancer stage through the TNM Classification of Malignant Tumors as well as provide a helpful guide for treatment (1, 2). Additionally, the extent of axillary lymph node metastasis remains the most reliable predictor of prognosis for the patient (3–5). Axillary lymph nodes therefore are clinically important in the treatment of breast cancer patients.
The current gold standard of determining the involvement of axillary lymph nodes in a patient with breast cancer includes a pathological examination of aspiration cytology, a sentinel lymph node biopsy to detect metastasis from the primary tumor, and, in some cases, an axillary lymph node dissection. Both sentinel lymph node biopsy and axillary dissection are invasive procedures conducted under general anesthesia, with associated risks and clinical complications, including infection, edema, changes in sensation, chronic pain, and axillary web syndrome (6, 7). Additionally, some patients undergo unnecessary axillary lymph node dissection. According to some studies, an estimated 43%–65% of patients with sentinel lymph node metastasis also undergoing axillary lymph node dissection had no additional metastatic lymph nodes (6). Multiple studies have shown that, for many patients, sentinel lymph node biopsy results in similar patient outcomes (Z11 and NSABP B-32 studies) while minimizing patient morbidity, thereby leading to fewer axillary lymph node dissections. Creating and standardizing a non-invasive method of evaluating both sentinel and axillary lymph node metastatic status would be beneficial for breast cancer patients.
Artificial Intelligence (AI), especially deep learning algorithms that utilize convolutional neural networks (CNN), has grown in popularity within the medical community for revolutionizing image-based disease diagnosis (8–12). Imaging modalities used to visualize axillary lymph nodes in breast cancer patients on their own have a wide range of sensitivity and specificity, and some are dependent on operator performance (13). For example, Ultrasound and PET/CT demonstrate a sensitivity of 33%–86.2% and 20%–80%, respectively, and a specificity of 40.5%–96.2% and 88.6%–97%, respectively (13). AI algorithms have the potential to enhance the diagnostic capability of such imaging modalities and shift clinical standards to a non-invasive, preoperative staging of lymph node involvement. In this review, we examine recent studies demonstrating the success of deep learning (DL) AI systems in the detection of axillary lymph node metastasis in breast cancer patients.
The role of traditional machine learning and deep learning in mammography
In recent years, the combination of screening programs and increased incidence of breast cancer together has resulted in an enlarged workload for radiologists. Computer-aided detection/diagnosis (CAD) systems, mostly in form of traditional machine learning (ML) AI methods, were created in part to assist radiologists with such high volumes of breast imaging. They have been used to detect lesions of interest in breast imaging as well as to differentiate between benign and malignant breast tissue (14, 15). Following traditional ML strategies, CAD systems rely on pre-defined/hand-crafted features inputted into the algorithm. These systems will learn from the tasks that they complete and subsequently improve their accuracy. Additionally, CAD systems are versatile in their ability to function with a wide range of imaging modalities (i.e.,: ultrasound, mammography, computed tomography, magnetic resonance imaging, etc.). Initial evidence suggested that CAD systems helped to improve accuracy in both detection and diagnosis of malignant breast lesions, however, largescale retrospective studies now demonstrate that CAD systems do not improve diagnostic accuracy, instead offering no benefit or, in some cases, reducing radiologist accuracy (14–16). DL-based CAD systems, in contrast, vastly outperform traditional ML-based ones on radiology tasks (16).
DL is a subset of ML in which raw data is given to a program and the algorithm itself is responsible for determining and defining the features, without any human interference. Its ability to learn from the given data (in this case, medical imaging) necessitates a large amount of data for the system to have higher levels of accuracy (16). CNNs are a specific type of DL algorithm that determine features in images and are popular in analyzing breast cancer images. To assess the performance of the DL algorithms discussed throughout this review, we will examine the Area Under the Curve of Receiver Characteristic Operator (AUROC) (14).
Deep learning in ultrasound, computed tomography, and magnetic resonance imaging
Recent studies investigating the prediction of axillary lymph node metastasis on ultrasound through DL systems have shown great success. Ultrasound is the primary imaging tool when examining axillary lymph nodes, due in part to the imaging modality offering a non-invasive, low cost, non-ionizing radiation method of visualizing a patient's lymph nodes in real time (14, 17). Additionally, ultrasound offers the option of immediate image guided intervention. Despite the many advantages associated with utilizing ultrasound to visualize axillary lymph nodes preoperatively, the medical community has yet to reach an official consensus on creating criteria that classifies axillary lymph nodes as either benign or malignant (17). A recent study by Tahmasebi et al. examines an AI system through Google Cloud AutoML Vision that classifies preoperative axillary lymph nodes of breast cancer patients as either benign or malignant and compares the results against blind readings from three experienced radiologists. The study reports the AI performed comparably to the trained radiologists, with less sensitivity (AI was 74.0% ± 0.14% compared to radiologist at 89.9% ± 0.06%) and more specificity (AI was 64.4% ± 0.11% compared to radiologist at 50.1% ± 0.20%) in external validation—though the differences between the AI and radiologist group were not statistically significant—and concludes that utilizing a combination of AI system and radiologist in practice may optimize results. Additionally, the study was retrospective in nature, and resulted in the limitation of ultrasound images lacking standardization in image axis, plane, and view (17). Another study by Sun et al. investigates a custom CNN with a total of 12 convolutional layers in the model for the prediction of axillary lymph node metastasis using ultrasound images (18). The training set was composed of 248 ultrasound images from 124 patients while the testing set had 90 ultrasound images from 45 patients (for a total of 338 ultrasound images from 169 primary breast cancer patients) and achieved a sensitivity of 65.5%, a specificity of 78.9%, and an AUC of 0.72 (18).
Other retrospective studies investigating the prediction of lymph node metastasis in breast cancer patients using ultrasound images and AI algorithms to evaluate the images prove more robust in their methodologies through enrolling larger numbers of patients into their training and validation sets. A study by Ashokkumar et al. evaluated three different deep Artificial Neural Networks (ANNs)—one based on feed forward, one on radial basis function, and one on Kohonen self-organizing models—for use in predicting metastasis in pre-operative breast cancer patients and compared their performance against experienced radiologists (19). The study involved a total of 908 images from 750 patients for training the sets. The Kohonen self-organizing model outperformed the others based on the sensitivity of 98%, specificity of 99%, and an AUC of 0.97. For comparison, the feed forward and radial basis function model had a sensitivity of 92% and 90%, specificity of 89% and 95%, and an AUC of 0.95 and 0.94, respectively (19). An additional study by Guo et al. identified 937 breast cancer patients with prior ultrasound images to train and test two different DL radiomics models for evaluating sentinel lymph node and non-sentinel lymph node metastasis, respectively (20). The performance of the DL radiomics model in predicting risk of metastasis with sentinel lymph nodes had a sensitivity of 87.8% and an AUC of 0.86 during training and a sensitivity of 89.7% and an AUC of 0.81 in testing; in non-sentinel lymph nodes the model had a sensitivity of 100% and an AUC of 0.91 during training and a sensitivity of 98.4% and an AUC of 0.81 in testing. This study was notable for its aim to identify the non-sentinel lymph node metastasis via DL radiomics obtained from ultrasound images in comparison to previous studies that focus on pathological indicators of sentinel lymph nodes for prediction of the metastatic status of non-sentinel lymph nodes (20). The study by Zhou et al. involves investigating three different CNNs—Inception V3, Inception-ResNet V2, and ResNet-101 architectures—in their performance of predicting negative axillary lymph node metastasis from primary breast cancer ultrasound images (7). The retrospective study involves a total of 1,055 ultrasound images from 834 patients and two different clinical sites. The results were then compared with readings from five experienced radiologists and metastatic status for all patients was confirmed with pathology. The CNN model Inception V3 performed best with an 85% sensitivity, 73% specificity and an AUC of 0.89. For comparison, radiologists performed with an average sensitivity and specificity of 73% and 63%, respectively (7). These larger scale studies indicate that DL models evaluating ultrasound images show promise as an early diagnostic tool when gauging lymph node status in primary breast cancer patients.
AI models can be further enhanced through integrating multiple ultrasound modalities. A study by Zheng et al. combines DL radiomics of conventional ultrasound and shear wave elastography to predict axillary lymph node metastasis pre-operatively. Shear wave elastography provides information about the elasticity of the tissue, in this case the stiffness of the tumor, that it visualizes (6).. A higher shear wave velocity has been correlated with a higher probability of metastasis. This study demonstrated that clinical parameter combined DL radiomics was able to accurately predict the metastatic status of axillary lymph nodes with an AUC of 0.902 and can even differentiate between axillary lymph nodes of low burden of metastasis from those with a high burden of metastasis with an AUC of 0.905 (6). These performance metrics are noticeably higher than either ultrasound alone (AUC of 0.585–0.719) and shear wave elastography alone (AUC of 0.759) in determining axillary lymph node status (6). This indicates that clinical parameter combined DL radiomics on multi-modalities might be the preferred avenue to investigate in future studies for the optimization of a pre-operative clinical diagnosis.
Though ultrasound is the primary imaging tool for examining axillary lymph nodes in breast cancer patients, research extends into DL algorithms for imaging modalities beyond ultrasound. Computed tomography (CT), though it exposes patients to ionizing radiation, has the advantage of acquiring more detail and range than ultrasound while requiring both less time and cost than magnetic resonance imaging (MRI). The study by Liu et al. represents the first attempt to predict axillary lymph node metastasis with a contrast enhanced CT (CECT) through deep learning architecture, and the study compared the results to the performance of traditional machine learning algorithms (21). 401 breast cancer patients were included in the study for a total of 800 axillary lymph node CECT images; the images were divided into 480 training, 160 validation, and 160 test sets. The novel deformable attention VGG19 (DA-VGG19) algorithm used in this study displayed an accuracy of 0.9088, a sensitivity of 0.9500, a specificity of 0.8675, and an AUC of 0.9694, outperforming other traditional models (including Random Forest, DenseNet, ResNet, VGG16, and VGG19, to name a few). In future studies, the authors mention the goal of multi-center studies to further validate their algorithm (21). The study by Yang et al. applied a CNN fast (CNN-F) to determine both the presence and extent of metastasis within sentinel lymph nodes based on CECT (22). The DL model predicting metastasis performed with an AUC 0.817 during validation. Additionally, the study attempted to distinguish metastatic lesions from each other to determine the number of metastatic lesions in sentinel lymph nodes, which had moderate success with an AUC of 0.770 (22). A retrospective study by Li et al. examined breast cancer patients that had undergone 2-deoxy-2-(18F)fluoro-D-glucose positron emission tomography/computed tomography [2-(18F)FDG-PET/CT] preoperatively and designed a CNN that differentiated between lymph node metastasis and primary breast cancer within the scans (3). The AI model (with an AUC of 0.868) alone did not outcompete the two clinicians, however, when the clinicians worked toward a diagnosis collaboratively with the AI model their sensitivities improved from 59.8% and 57.4% to 68.6% and 64.2%, respectively (3). Clinician specificity remained at 99.0% and 99.5%, respectively regardless of working with the AI model (3). This study demonstrates how the endpoint in developing AI models is not to replace clinicians as the primary diagnostician, but to instead enhance clinicians' performance through AI-assisted diagnoses.
MRI is another imaging modality that has been used in the diagnosis of axillary lymph node metastasis for breast cancer patients, however, unlike the other modalities discussed previously, MRI has low inter-observer variability, no ionizing radiation, and improved diagnostic contrast (13). The study by Ren et al. develops a CNN approach to identify axillary lymph node metastasis on breast MRI images with a specificity of 79.3% ± 5.1%, a sensitivity of 92.1% ± 2.9%, and an AUC of 0.91 ± 0.02 (23). They compare these metrics to those of an experienced radiologist and radiologist resident reading the same MRI images: a specificity of 75% and 54%, respectively, a sensitivity of 81% and 78%, respectively, and an AUC of 0.80 and 0.73, respectively (23). The CNN outperformed both physicians within this study. Yu et al. examines radiomic signatures in dynamic contrast-enhanced MRI (DCE-MRI) that can detect axillary lymph node metastasis in early breast cancer patients within their study (24). This study operated on a larger scale in comparison to the other articles discussed throughout the review, as it involved 1,214 patients from 4 different medical facilities, thus increasing the statistical power. The authors combined radiomic and clinical signatures to create a novel clinical-radiomic nomogram that identified axillary lymph node metastasis with an AUC of 0.90 during validation, as opposed to using radiomic signatures or clinical signatures alone which performed with an AUC of 0.85 and 0.71, respectively (24). Furthermore, this study also examined disease free survival, and developed a clinical-radiomic nomogram that predicted disease free survival 3 years following a breast cancer diagnosis that performed with an AUC of 0.90 during validation (24). Similarly, a study by Song et al. combined radiomics features from DCE-MRI with various clinical factors to identify metastasis in axillary lymph nodes (25). The dataset was smaller than the previous mentioned study, with a total of 432 patients, 296 used for training and 136 used for testing, and the combined clinical model and radiomic signature created a multivariable model that performed with an AUC of 0.874 (25). The success of these studies illustrates the power of multi-omics analysis in predicting both the presence and the course of a disease.
The included table (Table 1) gives a summary of the recent literature presented throughout this review.
Table 1. Summary table of recent literature discussed in review comparing different AI methods and AUC for identifying axillary lymph node metastasis.
The included figure (Figure 1) illustrates an example of the workflow in AI analysis in identifying axillary lymph node metastasis.
Figure 1. Example workflow illustrating AI analysis in identifying axillary lymph node metastasis.
Potential future developments
Many of the articles presented throughout this review were retrospective studies, leading to heterogeneity within different images of the same modality within a given study. Not everything was completely standardized, and this likely presented confounding variables within the studies. A potential future project would work to eliminate the variability. Moreover, the datasets used to train AI models should exhibit more inclusivity. The patient population with breast cancer includes people of varying backgrounds, which often means significant differences in characteristics like types of breast cancer, breast density, and age groups, to name a few. Future studies would expand the dataset to include a larger and more diverse patient population and multiple sites to increase the generalizability and the power of the study.
The studies examined that found the greatest success in their purpose tended to involve multiple imagining modalities, multi-omics analyses, or significant collaboration between clinician and AI model in the work up to a diagnosis, indicating that involving multiple perspectives or viewpoints leads to a superior performance. Future developments in AI models that predict axillary lymph node metastatic status should work to incorporate multiple modalities or signatures for a better predictive power.
Conclusion
The growing popularity of AI in the medical imaging field is driving innovation toward creating DL models that can predict the metastasis of breast cancer to the axillary lymph nodes preoperatively, reducing the number of patients that undergo unnecessary and invasive procedures. Some preliminary models demonstrate early success, achieving a greater sensitivity and specificity when compared to experienced radiologists. However, more work is necessary to repeat such studies on larger scales with more standardized variables and interpretability before they can be clinically useful. Besides, considering the heterogeneity, e.g., vendors, demographic information, and scanning protocols, multi-cohort studies with data harmonization strategies will further improve the generalization of AI solutions for deployment in clinical settings.
Author contributions
GOW: conducted literature research and wrote the manuscript as first author. All authors contributed to the article and approved the submitted version.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
1. Tao Z, Shi A, Lu C, Song T, Zhang Z, Zhao J. Breast cancer: epidemiology and etiology. Cell Biochem Biophys. (2015) 72:333–8. doi: 10.1007/s12013-014-0459-6
2. Marino MA, Avendano D, Zapata P, Riedl CC, Pinker K. Lymph node imaging in patients with primary breast cancer: concurrent diagnostic tools. Oncologist. (2020) 25:e231–42. doi: 10.1634/theoncologist.2019-0427
3. Li Z, Kitajima K, Hirata K, Togo R, Takenaka J, Miyoshi Y, et al. Preliminary study of AI-assisted diagnosis using FDG-PET/CT for axillary lymph node metastasis in patients with breast cancer. EJNMMI Res. (2021) 11:10. doi: 10.1186/s13550-021-00751-4
4. Recht A, Houlihan MJ. Axillary lymph nodes and breast cancer: a review. Cancer. (1995) 76:1491–512. doi: 10.1002/1097-0142(19951101)76:9%3C1491::aid-cncr2820760902%3E3.0.co;2-8
5. Chung HL, Le-Petross HT, Leung JWT. Leung, imaging updates to breast cancer lymph node management. Radiographics. (2021) 41:1283–99. doi: 10.1148/rg.2021210053
6. Zheng X, Yao Z, Huang Y, Yu Y, Wang Y, Liu Y, et al. Deep learning radiomics can predict axillary lymph node status in early-stage breast cancer. Nat Commun. (2020) 11:1236. doi: 10.1038/s41467-020-15027-z
7. Zhou LQ, Wu XL, Huang SY, Wu GG, Ye HR, Wei Q, et al. Lymph node metastasis prediction from primary breast cancer US images using deep learning. Radiology. (2020) 294:19–28. doi: 10.1148/radiol.2019190372
8. Ting DSW, Liu Y, Burlina P, Xu X, Bressler NM, Wong TY. AI for medical imaging goes deep. Nat Med. (2018) 24:539–40. doi: 10.1038/s41591-018-0029-3
9. Fazal MI, Patel ME, Tye J, Gupta Y. The past, present and future role of artificial intelligence in imaging. Eur J Radiol. (2018) 105:246–50. doi: 10.1016/j.ejrad.2018.06.020
11. Shen D, Wu G, Suk HI. Deep learning in medical image analysis. Annu Rev Biomed Eng. (2017) 19:221–48. doi: 10.1146/annurev-bioeng-071516-044442
12. Litjens G, Kooi T, Bejnordi BE, Setio AAA, Ciompi F, Ghafoorian M, et al. A survey on deep learning in medical image analysis. Med Image Anal. (2017) 42:60–88. doi: 10.1016/j.media.2017.07.005
13. Chen C, Qin Y, Chen H, Zhu D, Gao F, Zhou X. A meta-analysis of the diagnostic performance of machine learning-based MRI in the prediction of axillary lymph node metastasis in breast cancer patients. Insights Imaging. (2021) 11:156. doi: 10.1186/s13244-021-01034-1
14. Balkenende L, Teuwen J, Mann RM. Application of deep learning in breast cancer imaging. Semin Nucl Med. (2022) 52:584–96. doi: 10.1053/j.semnuclmed.2022.02.003
15. Jalalian A, Mashohor SB, Mahmud HR, Saripan MI, Ramli AR, Karasfi B. Computer-aided detection/diagnosis of breast cancer in mammography and ultrasound: a review. Clin Imaging. (2013) 37:420–6. doi: 10.1016/j.clinimag.2012.09.024
16. Oakden-Rayner L. The rebirth of CAD: how is modern AI different from the CAD we know? Radiol Artif Intell. (2019) 1:e180089. doi: 10.1148/ryai.2019180089
17. Tahmasebi A, Qu E, Sevrukov A, Liu JB, Wang S, Lyshchik A, et al. Assessment of axillary lymph nodes for metastasis on ultrasound using artificial intelligence. Ultrason Imaging. (2021) 43:329–36. doi: 10.1177/01617346211035315
18. Sun S, Mutasa S, Liu MZ, Nemer J, Sun M, Siddique M, et al. Deep learning prediction of axillary lymph node status using ultrasound images. Comput Biol Med. (2022) 143:105250. doi: 10.1016/j.compbiomed.2022.105250
19. Ashokkumar N, Meera S, Anandan P, Murthy MYB, Kalaivani KS, Alahmadi TA, et al. Deep learning mechanism for predicting the axillary lymph node metastasis in patients with primary breast cancer. Biomed Res Int. (2022) 2022:8616535. doi: 10.1155/2022/8616535
20. Guo X, Liu Z, Sun C, Zhang L, Wang Y, Li Z, et al. Deep learning radiomics of ultrasonography: identifying the risk of axillary non-sentinel lymph node involvement in primary breast cancer. EBioMedicine. (2020) 60:103018. doi: 10.1016/j.ebiom.2020.103018
21. Liu Z, Ni S, Yang C, Sun W, Huang D, Su H, et al. Axillary lymph node metastasis prediction by contrast-enhanced computed tomography images for breast cancer patients based on deep learning. Comput Biol Med. (2021) 136:104715. doi: 10.1016/j.compbiomed.2021.104715
22. Yang X, Wu L, Ye W, Zhao K, Wang Y, Liu W, et al. Deep learning signature based on staging CT for preoperative prediction of sentinel lymph node metastasis in breast cancer. Acad Radiol. (2020) 27:1226–33. doi: 10.1016/j.acra.2019.11.007
23. Ren T, Cattell R, Duanmu H, Huang P, Li H, Vanguri R, et al. Convolutional neural network detection of axillary lymph node metastasis using standard clinical breast MRI. Clin Breast Cancer. (2020) 20:e301–8. doi: 10.1016/j.clbc.2019.11.009
24. Yu Y, Tan Y, Xie C, Hu Q, Ouyang J, Chen Y, et al. Development and validation of a preoperative magnetic resonance imaging radiomics-based signature to predict axillary lymph node metastasis and disease-free survival in patients with early-stage breast cancer. JAMA Netw Open. (2020) 3:e2028086. doi: 10.1001/jamanetworkopen.2020.28086
Keywords: artificial intelligence, deep learning, radiology, axillary lymph node metastasis, breast cancer
Citation: Windsor GO, Bai H, Lourenco AP and Jiao Z (2023) Application of artificial intelligence in predicting lymph node metastasis in breast cancer. Front. Radiol. 3:928639. doi: 10.3389/fradi.2023.928639
Received: 26 April 2022; Accepted: 31 January 2023;
Published: 20 February 2023.
Edited by:
Tianming Liu, University of Georgia, United StatesReviewed by:
Nizhuan Wang, ShanghaiTech University, China© 2023 Windsor, Bai, Lourenco and Jiao. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Zhicheng Jiao zhicheng_jiao@brown.edu
Specialty Section: This article was submitted to Artificial Intelligence in Radiology, a section of the journal Frontiers in Radiology