Skip to main content

ORIGINAL RESEARCH article

Front. Oncol., 26 April 2022
Sec. Gastrointestinal Cancers: Colorectal Cancer

Real-Time Artificial Intelligence-Based Histologic Classifications of Colorectal Polyps Using Narrow-Band Imaging

Yi Lu,&#x;Yi Lu1,2†Jiachuan Wu&#x;Jiachuan Wu3†Xianhua Zhuo,Xianhua Zhuo1,4Minhui Hu,Minhui Hu1,2Yongpeng Chen,Yongpeng Chen1,2Yuxuan LuoYuxuan Luo5Yue FengYue Feng5Min Zhi,Min Zhi2,6Chujun Li,*Chujun Li1,2*Jiachen Sun,*Jiachen Sun1,2*
  • 1Department of Gastrointestinal Endoscopy, the Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
  • 2Guangdong Provincial Key Laboratory of Colorectal and Pelvic Floor Diseases , the Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
  • 3Digestive Endoscopy Center, Guangdong Second Provincial General Hospital, Guangzhou, China
  • 4Department of Otorhinolaryngology, the Second Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
  • 5Tianjin Economic-Technological Development Area (TEDA) Yujin Digestive Health Industry Research Institute, Tianjin, China
  • 6Department of Gastroenterology, the Sixth Affiliated Hospital, Sun Yat-sen University, Guangzhou, China

Background and Aims: With the development of artificial intelligence (AI), we have become capable of applying real-time computer-aided detection (CAD) in clinical practice. Our aim is to develop an AI-based CAD-N and optimize its diagnostic performance with narrow-band imaging (NBI) images.

Methods: We developed the CAD-N model with ResNeSt using NBI images for real-time assessment of the histopathology of colorectal polyps (type 1, hyperplastic or inflammatory polyps; type 2, adenomatous polyps, intramucosal cancer, or superficial submucosal invasive cancer; type 3, deep submucosal invasive cancer; and type 4, normal mucosa). We also collected 116 consecutive polyp videos to validate the accuracy of the CAD-N.

Results: A total of 10,573 images (7,032 images from 650 polyps and 3,541 normal mucous membrane images) from 478 patients were finally chosen for analysis. The sensitivity, specificity, PPV, NPV, and accuracy for each type of the CAD-N in the test set were 89.86%, 97.88%, 93.13%, 96.79%, and 95.93% for type 1; 93.91%, 95.49%, 91.80%, 96.69%, and 94.94% for type 2; 90.21%, 99.29%, 90.21%, 99.29%, and 98.68% for type 3; and 94.86%, 97.28%, 94.73%, 97.35%, and 96.45% for type 4, respectively. The overall accuracy was 93%. We also built models for polyps ≤5 mm, and the sensitivity, specificity, PPV, NPV, and accuracy for them were 96.81%, 94.08%, 95%, 95.97%, and 95.59%, respectively. Video validation results showed that the sensitivity, specificity, and accuracy of the CAD-N were 84.62%, 86.27%, and 85.34%, respectively.

Conclusions: We have developed real-time AI-based histologic classifications of colorectal polyps using NBI images with good accuracy, which may help in clinical management and documentation of optical histology results.

Introduction

Colorectal cancer ranks as one of the most common cancers and the second leading cause of cancer death worldwide (1). Colonoscopy screening is of vital importance to the prevention of colorectal cancer. In colonoscopy screening, precancerous polyps, such as adenomas and serrated polyps, are resected. In recent years, with the development of convoluted neural networks (CNNs) or artificial intelligence (AI), we have become capable of applying real-time computer-aided detection (CAD) in clinical practice (2, 3), and these AI-based polyp detection systems are reported to increase the rate of polyp detection (4). However, a certain portion of these polyps are hyperplastic polyps, and resection of these polyps can increase medical costs, and sometimes we take a lot of time to search for diminutive polyps that tend out to be hyperplastic polyps. On the one hand, as malignant transformations of these polyps are rare, a pathologic evaluation might be unnecessary. On the other hand, some patients with early colorectal cancer diagnosed after surgical resection might have been cured by less invasive endotherapy if we knew their histopathology result before surgery. Therefore, accurate histologic diagnosis before endoscopic resection has the potential to improve the cost-effectiveness and efficiency of colonoscopy, preventing unnecessary endotherapy and relieving the financial burden (5).

Narrow-band imaging (NBI), a kind of image-enhanced technology, helps us visualize the surface patterns and vessels of polyps, and it has been reported to provide valuable information regarding the histology of polyps (6). The NBI International Colorectal Endoscopic (NICE) classification is a simplified diagnostic criterion for the diagnosis of colorectal polyp histology and is widely used in centers without magnifying endoscopy (7, 8). However, due to its subjective nature, interobserver agreement varies in different situations, especially for non-experts (9, 10). To address this problem, previous studies successfully developed AI-based CADx to differentiate hyperplastic and neoplastic polyps with NBI images (5, 11), but they did not characterize deep submucosal invasive carcinoma (NICE classification type 3). Later, Okamoto et al. developed a CADx-N model to differentiate the 3 types of NICE classification. The overall accuracy was excellent, but the specificity and sensitivity for some types were not that satisfactory, as the specificity for NICE classification type 2 (low-grade dysplasia to submucosal-shallow invasive carcinoma) was 80.6%, and the sensitivity for NICE classification type 3 was 61.1% (12). This CADx was developed in Japan, and its utilization in China has a long way to go. Moreover, the method used for developing their CADx was Residual Network (ResNet), and there is a new variant of it, preserving its structure without introducing additional computational costs and with better performance, which was named ResNeSt (13). Therefore, we used more NBI images to develop an AI-based CAD-N with ResNeSt to make real-time histologic classifications of colorectal polyps with good accuracy and validated its accuracy with videos.

Methods

Clinical Data and Polyp Image Collection

We retrospectively searched for colorectal NBI images at the Sixth Affiliated Hospital, Sun Yat-sen University, and Guangdong Second Provincial Central Hospital. These images were used to train the model and have internal validation tests. The scopes used in this study were PCF-Q260JI, CF-H260AI, PCF-Q260AZI, PCF-Q260A3I, CF-H290I, CF-HQ290I, PCF-H290ZI, and CF-HQ290Z (Olympus Optical Co., Ltd., Tokyo, Japan), and the machines we used were CV-260 and CV-290 (Olympus Medical Systems). The collected images met the following criteria: NBI images; with pathology (if the image was normal mucosa, then pathology was not necessary); the pathology was made by the whole resection specimens rather than biopsy; good quality; and repeated or blurred images were excluded. Additionally, we collected the following information of the patients: age, sex, and information of the polyps: location, size, number, and pathology. The collected images were categorized into 4 types according to their pathology: type 1, hyperplastic or inflammatory polyps; type 2, adenomatous polyps, intramucosal cancer, or superficial submucosal invasive cancer; type 3, deep submucosal invasive cancer; and type 4, normal mucosa.

Development of CAD-N

A kind of deep convolutional neural network (DCNN) classifier named ResNeSt was used to train the model (13). The process was mainly implemented with Python (Version 3.7) and PyTorch (Version 1.7.1). The development of CAD-N was supported by TEDA Yujin Digestive Health Industry Research Institute.

As in the NBI images, the surface patterns and vessels of polyps are important elements to distinguish their pathology, so edge gradient extraction was adopted for each NBI image by using OpenCV (Version 4.2.0). The obtained gray edge gradient image channel and the original RGB three-channel were generated as the four-channel model input (Figure 1). Random image rotation, flipping (horizontal or vertical), image blur, random noise, gamma contrast variation, random translation, random scaling, inclination, and random discard pixels were used for data augmentation (11) (Figure 2).

FIGURE 1
www.frontiersin.org

Figure 1 Simplified schematic diagram of the deep learning methods from an endoscopic image to the final prediction.

FIGURE 2
www.frontiersin.org

Figure 2 Images showing the data argumentation methods used in this study: (A) original image; (B) rotation; (C) horizontal flipping; (D) vertical flipping; (E) image blur; (F) random noise; (G) gamma contrast variation; (H) random translation; (I) random scaling; (J) inclination (left and right); (K) inclination (up and down); (L) random discard pixels.

The images chosen were randomly divided into training sets and test sets at a ratio of 8:2, and 5-fold cross-validation was used. We further developed another CAD-N for differentiating polyps with sizes ≤5 mm, and in building this model, the images chosen were randomly divided into training sets and test sets at a ratio of 9:1, and 10-fold cross-validation was used.

Hyperparameters were chosen through the AdamW optimizer. The model was trained for 300 epochs; the initial learning rate was 1e-4; cosine annealing was adopted as the attenuation method; and the final learning rate was 1e-6. When the training reached the preset loss value (loss <0.005) or 300 epochs, the training stopped. The output vector of the model was the probability (ranging from 0 to 100%) for each pathology type based on the evaluation of NBI images of the polyp/mucosa. The type with the highest probability was interpreted as the final diagnosis of the CAD-N. The CAD-N program was installed in a machine, which was named as “Endo Smart.” The video in the Supplementary Material shows how the CAD-N works.

To further validate the accuracy of the CAD-N, we collected 116 consecutive polyp videos (collected from the Sixth Affiliated Hospital, Sun Yat-sen University) that were recorded in the NBI model and confirmed with histopathology. The video recordings for validation were typically 10–20 s in length, and each video represented a polyp. The polyps in these videos had no overlap with the images in the training sets or the test sets. Then, 3 experts with more than 5 years of colonoscopy experience and 2 novices with 1 year of colonoscopy experience, all of whom were blinded to the histology results, were asked to classify the polyps in these videos according to NICE classifications.

Statistical Analysis

Continuous variables for those with a normal distribution are presented as the mean (standard deviation, SD), and those without a normal distribution are presented as the median (interquartile range, IQR). Categorical variables are expressed as numbers (percentages). To evaluate the performance of the CAD-N for differentiating the pathology of polyps, the sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), accuracy of each type of the CAD-N, and their 95% confidence intervals (CIs) were calculated. Moreover, a receiver operating characteristic curve (ROC) was plotted, and the area under the curve (AUC) was also calculated. The above calculation was performed by the Scikit-learn package in Python.

Results

Basic Information

A total of 10,573 images (7,032 images from 650 polyps and 3,541 normal mucous membrane images) from 478 patients were finally chosen for analysis, and the exact number of images used in each type is shown in Table 1. The mean age of the patients was 54.92 ( ± 13.56) years, and 295 patients (61.72%) were male. A total of 8,458 images were randomly divided into the training sets and 2,115 images into the test sets. The characteristics of the polyps/normal mucous membrane in the test sets are presented in Table 2.

TABLE 1
www.frontiersin.org

Table 1 The number of the images selected in each type.

TABLE 2
www.frontiersin.org

Table 2 The characteristics of the polyps/normal mucous membrane in the test sets.

Image Analysis With a Deep Neural Network for All the Images

The sensitivity, specificity, PPV, NPV, and accuracy for each type of the CAD-N in the test sets were 89.86%, 97.88%, 93.13%, 96.79%, and 95.93% for type 1; 93.91%, 95.49%, 91.80%, 96.69%, and 94.94% for type 2; 90.21%, 99.29%, 90.21%, 99.29%, and 98.68% for type 3; and 94.86%, 97.28%, 94.73%, 97.35%, and 96.45% for type 4, respectively (Table 3). The overall accuracy was 93%. The ROC curves for each type versus other types and the overall micro-averaging ROC are shown in Figure 3A, and the confusion matrices showing the pairwise comparison (number of images) in the test sets are presented in Figure 3B.

TABLE 3
www.frontiersin.org

Table 3 Diagnostic performance of the CAD-N for each type of polyps in the test sets by images.

FIGURE 3
www.frontiersin.org

Figure 3 Diagnostic accuracy of the deep-learning model in the test sets. (A) Receiver operator curve (ROC) for the computer-aided detection (CAD)-N model for differentiation of each type versus other types and the overall micro-averaging ROC. (B) Confusion matrices show the pairwise comparison (number of images) in the test set. (C) ROC of type 1 versus type 2 for polyps ≤5 mm. (D) Confusion matrices for polyps ≤5 mm (type 1, hyperplastic or inflammatory polyps; type 2, adenomatous polyps, intramucosal cancer, or superficial submucosal invasive cancer; type 3, deep submucosal invasive cancer; and type 4, normal mucosa).

Image Analysis With a Deep Neural Network for Polyps ≤5 mm

We further analyzed polyps with sizes ≤5 mm, and 3,395 images were selected. The training sets contained 3,055 images from 376 polyps (220 were type 1 and 156 were type 2), and the test sets included 340 images from 158 polyps (88 were type 1 and 70 were type 2). The sensitivity, specificity, PPV, NPV, and accuracy for differentiating the type of polyps ≤5 mm in the test sets were 96.81% (93.21%–98.53%), 94.08% (89.13%–96.85%), 95% (91.29%–97.5%), 95.97% (91.49%–98.14%), and 95.59% (92.85%–97.31%), respectively. The ROC curves for differentiating the type of polyps ≤5 mm are shown in Figure 3C, and the confusion matrices for them are presented in Figure 3D.

Validation Results of the Videos

Among the 116 videos (also 116 polyps) used for further validation, 65 polyps were type 1, and 51 polyps were type 2. The sensitivity, specificity, and accuracy of the CAD-N were 84.62% (73.94%–91.42%), 86.27% (73.13%–93.85%), and 85.34% (77.78%–90.64%), respectively. The diagnostic performance of the experts and novices seemed to not be significant different from that of the CAD-N (Table 4).

TABLE 4
www.frontiersin.org

Table 4 Diagnostic performance of the CAD-N, experts, and novice in the validation videos.

Discussion

Polypectomy of neoplastic polyps during colonoscopy remains the best policy for screening and prevention of colorectal cancer (14). Studies have shown that reliable real-time histopathology analysis is useful to improve the cost-effectiveness of colonoscopy in colorectal cancer surveillance and screening (15, 16). Except for the need to differentiate hyperplastic polyps and neoplastic polyps, ideally, endoscopists should be able to perceive the presence of invasive cancer during colonoscopy to make the suitable treatment decisions (17). Using white-light colonoscopy, the accuracy of real-time histopathology analysis was limited (18); the NICE classification is a simplified diagnostic criterion for the diagnosis of colorectal polyp histology and is widely used in centers without magnifying endoscopy (7, 8, 17). However, the judgment of the type may be somewhat subjective, and the confidence level of diagnosis may be different in endoscopists with different levels of experience (19, 20). Moreover, the detection of deep invasion of the polyps by non-magnifying NICE alone may not have sufficient accuracy compared with the magnifying endoscopic diagnosis (12). Hence, CAD-N, which enables the differentiation of real-time and objective histopathologic types of polyps even for non-magnifying images, is of great significance.

In this study, we used a DCNN-based machine learning algorithm to create the CAD-N model to help identify the histopathologic type of polyps in real time using NBI images, and the overall accuracy was excellent. Before our study, Rodriguez-Diaz et al. used 740 high-magnification NBI images from 607 polyps in 286 patients and over 65,000 subregions and developed a deep learning model to delineate polyp boundaries and to classify the histology of the polyps (11). In their study, they classified the polyps into two types, neoplastic and non-neoplastic, and the sensitivity, specificity, and NPV were 96% (92%–99%), 84% (74%–92%), and 91% (81%–97%), respectively. Their results were good, but they could not differentiate the neoplastic polyps with deep invasion.

Recently, Okamoto et al. used 4,156 NBI images to develop a CADx system using the NICE classification (12). Their model not only classified the neoplastic polyps and non-neoplastic polyps but also recognized the neoplastic polyps with deep invasion. In their study, the specificity for type 2 and the sensitivity for type 3 were not that satisfied. We think one of the reasons might be that in their training sets they used 3,670 magnifying images, and only 486 were non-magnifying images; if they used non-magnifying images in the test sets, the results would be influenced. Compared with their study, ours had some differences. First, the method they used to develop the model was ResNet, while we used ResNeSt, which is a new ResNet variant, preserving the overall ResNet structure without introducing additional computational costs and with better performance (13). Second, we collected more NBI images and built this model, whose test results were good, and the program was installed in a machine, which could give real-time histopathologic results during colonoscopy, as the video in the Supplementary Material shows.

We further validated the accuracy of the CAD-N using videos, as validation with videos rather than images could better reflect the clinical situation better. Although the accuracy in the validation videos was not as high as that in the test sets, it was close to the accuracy of the three experts with more than 5 years of colonoscopy experience (≥5,000 colonoscopies) and 2 novices with 1 year of colonoscopy experience (<5,000 colonoscopies). Byrne et al. also tested their models with videos, and their accuracy was 94%, sensitivity was 98%, and specificity was 83% (21). Actually, they used 125 polyp videos, but their model did not have enough confidence to predict the histology in 19 polyps, so they predicted the types of polyps in only 106 videos; hence, their accuracy, sensitivity, and specificity were overestimated and might be close to ours.

Several studies have focused on the classification of histopathologic types of diminutive polyps (<5 mm or ≤5 mm in size) (5, 11, 21). The ranges of the sensitivity, specificity, and NPV of their models were 95%–98%, 78.1%–88%, and 91.5%–97%, respectively. The Preservation and Incorporation of Valuable Endoscopic Innovations (PIVI) initiatives reported in the American Society of Gastrointestinal Endoscopy guidelines suggest that a histologic assessment of diminutive polyps should provide no less than 90% NPV for adenoma detection (22, 23). Their models all met the “leave in situ” criteria proposed by the PIVI initiatives. In Chen et al.’s study (5), they found that 3 of the novice endoscopists failed to meet the criteria, proving the advantages of the model over non-experts; moreover, their model could make the diagnosis faster than both the experts and non-experts, further suggesting the usefulness of the model. In our study, we also analyzed diminutive polyps, and our results met the criteria proposed by the PIVI initiatives. Therefore, we agreed that, with quick response and good reproducibility, CAD would become a very useful clinical tool especially for non-experts (24, 25).

Serrated lesions are another issue we are concerned about, ant the NICE system is not excellent in distinguishing sessile serrated adenoma/polyps (SSA/Ps) from benign hyperplastic polyps. To address this problem, the modified Sano (MS) classification and the Workgroup on Serrated Polyps and Polyposis (WASP) add-on classification have been developed (26, 27). Zorron et al. developed CAD for characterization of colorectal lesions, including the differentiation of serrated lesions (28), and the AUC for the SSA was 0.85 in the validation sets. In previous studies, the number of SSA/Ps was limited (11, 21), and in our study, we collected only 144 images of SSAs, which is also a very small number and a limitation of our study. We think that, in the future, if we want to develop better convincible CADx, we should include more images of SSA/Ps, especially for the diminutive images, to meet the “resect and discard” strategy (23).

One of the strengths of this study is the relatively large number of images in the training sets, and the diagnostic performance of CAD-N in the test sets was good, with real-time histopathologic diagnosis. However, there are some limitations in this study. First, there was a lack of external validation, so we do not know how the CAD-N worked in other centers. In the future, we hope we can do some research to answer this question. Second, as mentioned above, the number of images of SSA/Ps included in this study was limited, and we should accumulate more images of SSA/Ps in the next version. Third, there were no type 3 polyps in the validation videos, and the diagnostic performance of the CAD-N using the validation videos was not as excellent as that in the test sets; hence, perhaps more polyps were needed to improve the models.

In conclusion, we developed a real-time AI-based histologic classification model for colorectal polyps using NBI images, which could not only accurately distinguish hyperplastic polyps and neoplastic polyps but also differentiate the neoplastic polyps with deep invasion, helping clinical management and documentation of optical histology results. Future work is required as more images are required, especially of SSA/Ps, for further development and in designing larger external validation studies. Although the CAD-N has good performance, we believe it still cannot replace the role of endoscopists, as the latter must drive the scope stably, clean away debris and foam, observe the mucosal surfaces without missing areas, and ensure clear visualization of the lesions to let the CAD-N focus on the lesion and make a diagnosis. Moreover, endoscopists can apply their knowledge and skills during intervention. Deep machine learning technology will continually learn from us, helping us to improve our performance.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics Statement

This study was approved by the Institutional Review Board of the Sixth Affiliated Hospital, Sun Yat-sen University (Approval Code: 2021ZSLYEC-221), and Guangdong Second Provincial Central Hospital (Approval Code: 2021-KZ-228-02), and it has been registered in the Chinese Clinical Trial Registry (No. ChiCTR2100051800). Written informed consent from the participants’ legal guardian/next of kin was not required to participate in this study in accordance with the national legislation and the institutional requirements.

Author Contributions

YLu and JW designed the study and wrote the manuscript. YLu, JW, XZ, MH, YC, and JS collected the clinical data and the images. YLuo, YF and their teams processed the images and built the models. YLu, JW, YLuo, and YF performed the statistical analysis. YLu, XZ, MH, YC, and JS performed the video validation. MZ, CL, and JS revised the manuscript. All authors contributed to the article and approved the submitted version.

Funding

This study was funded by grants from the National Key R&D Program of China (Grant No. 2017YFC1308800) and the Sixth Affiliated Hospital of Sun Yat-sen University of Horizontal Program (Grant No. H202101162024041054).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Acknowledgments

The authors thank all the members from TEDA Yujin Digestive Health Industry Research Institute who have made contributions to this program.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fonc.2022.879239/full#supplementary-material

References

1. Sung H, Ferlay J, Siegel RL, Laversanne M, Soerjomataram I, Jemal A, et al. Global Cancer Statistics 2020: GLOBOCAN Estimates of Incidence and Mortality Worldwide for 36 Cancers in 185 Countries. CA Cancer J Clin (2021) 71:209–49. doi: 10.3322/caac.21660

CrossRef Full Text | Google Scholar

2. Hassan C, Spadaccini M, Iannone A, Maselli R, Jovani M, Chandrasekar VT, et al. Performance of Artificial Intelligence in Colonoscopy for Adenoma and Polyp Detection: A Systematic Review and Meta-Analysis. Gastrointest Endosc (2021) 93:77–85. doi: 10.1016/j.gie.2020.06.059

CrossRef Full Text | Google Scholar

3. Saito H, Tanimoto T, Ozawa T, Ishihara S, Fujishiro M, Shichijo S, et al. Automatic Anatomical Classification of Colonoscopic Images Using Deep Convolutional Neural Networks. Gastroenterol Rep (Oxf) (2021) 9:226–33. doi: 10.1093/gastro/goaa078

CrossRef Full Text | Google Scholar

4. Barua I, Vinsard DG, Jodal HC, Løberg M, Kalager M, Holme Ø, et al. Artificial Intelligence for Polyp Detection During Colonoscopy: A Systematic Review and Meta-Analysis. Endoscopy (2021) 53:277–84. doi: 10.1055/a-1201-7165

CrossRef Full Text | Google Scholar

5. Chen PJ, Lin MC, Lai MJ, Lin JC, Lu HH, Tseng VS. Accurate Classification of Diminutive Colorectal Polyps Using Computer-Aided Analysis. Gastroenterology (2018) 154:568–75. doi: 10.1053/j.gastro.2017.10.010

CrossRef Full Text | Google Scholar

6. Machida H, Sano Y, Hamamoto Y, Muto M, Kozu T, Tajiri H, et al. Narrow-Band Imaging in the Diagnosis of Colorectal Mucosal Lesions: A Pilot Study. Endoscopy (2004) 36:1094–8. doi: 10.1055/s-2004-826040

CrossRef Full Text | Google Scholar

7. Hewett DG, Kaltenbach T, Sano Y, Tanaka S, Saunders BP, Ponchon T, et al. Validation of a Simple Classification System for Endoscopic Diagnosis of Small Colorectal Polyps Using Narrow-Band Imaging. Gastroenterology (2012) 143:599–607. doi: 10.1053/j.gastro.2012.05.006

CrossRef Full Text | Google Scholar

8. Tanaka S, Sano Y. Aim to Unify the Narrow Band Imaging (NBI) Magnifying Classification for Colorectal Tumors: Current Status in Japan From a Summary of the Consensus Symposium in the 79th Annual Meeting of the Japan Gastroenterological Endoscopy Society. Dig Endosc (2011) 23(Suppl 1):131–9. doi: 10.1111/j.1443-1661.2011.01106.x

CrossRef Full Text | Google Scholar

9. Ladabaum U, Fioritto A, Mitani A, Desai M, Kim JP, Rex DK, et al. Real-Time Optical Biopsy of Colon Polyps With Narrow Band Imaging in Community Practice Does Not Yet Meet Key Thresholds for Clinical Decisions. Gastroenterology (2013) 144:81–91. doi: 10.1053/j.gastro.2012.09.054

CrossRef Full Text | Google Scholar

10. Hamada Y, Tanaka K, Katsurahara M, Horiki N, Yamada R, Yamada T, et al. Utility of the Narrow-Band Imaging International Colorectal Endoscopic Classification for Optical Diagnosis of Colorectal Polyp Histology in Clinical Practice: A Retrospective Study. BMC Gastroenterol (2021) 21:336. doi: 10.1186/s12876-021-01898-z

CrossRef Full Text | Google Scholar

11. Rodriguez-Diaz E, Baffy G, Lo WK, Mashimo H, Vidyarthi G, Mohapatra SS, et al. Real-Time Artificial Intelligence-Based Histologic Classification of Colorectal Polyps With Augmented Visualization. Gastrointest Endosc (2021) 93:662–70. doi: 10.1016/j.gie.2020.09.018

CrossRef Full Text | Google Scholar

12. Okamoto Y, Yoshida S, Izakura S, Katayama D, Michida R, Koide T, et al. Development of Multi-Class Computer-Aided Diagnostic Systems Using the NICE/JNET Classifications for Colorectal Lesions. J Gastroenterol Hepatol (2021) 37(1):104–10. doi: 10.1111/jgh.15682

CrossRef Full Text | Google Scholar

13. Zhang H, Wu C, Zhang Z, Zhu Y, Lin H, Zhang Z, et al. ResNeSt: Split-Attention Networks. Available at: https://hangzhang.org/files/resnest.pdf.

Google Scholar

14. Brenner H, Stock C, Hoffmeister M. Effect of Screening Sigmoidoscopy and Screening Colonoscopy on Colorectal Cancer Incidence and Mortality: Systematic Review and Meta-Analysis of Randomised Controlled Trials and Observational Studies. BMJ (2014) 348:g2467. doi: 10.1136/bmj.g2467

CrossRef Full Text | Google Scholar

15. Mori Y, Kudo SE, East JE, Rastogi A, Bretthauer M, Misawa M, et al. Cost Savings in Colonoscopy With Artificial Intelligence-Aided Polyp Diagnosis: An Add-on Analysis of a Clinical Trial (With Video). Gastrointest Endosc (2020) 92:905–11. doi: 10.1016/j.gie.2020.03.3759

CrossRef Full Text | Google Scholar

16. Hassan C, Pickhardt PJ, Rex DK. A Resect and Discard Strategy Would Improve Cost-Effectiveness of Colorectal Cancer Screening. Clin Gastroenterol Hepatol (2010) 8:865–9 861–9. doi: 10.1016/j.cgh.2010.05.018

CrossRef Full Text | Google Scholar

17. Puig I, López-Cerón M, Arnau A, Rosiñol Ò, Cuatrecasas M, Herreros-de-Tejada A, et al. Accuracy of the Narrow-Band Imaging International Colorectal Endoscopic Classification System in Identification of Deep Invasion in Colorectal Polyps. Gastroenterology (2019) 156:75–87. doi: 10.1053/j.gastro.2018.10.004

CrossRef Full Text | Google Scholar

18. Sikka S, Ringold DA, Jonnalagadda S, Banerjee B. Comparison of White Light and Narrow Band High Definition Images in Predicting Colon Polyp Histology, Using Standard Colonoscopes Without Optical Magnification. Endoscopy (2008) 40:818–22. doi: 10.1055/s-2008-1077437

CrossRef Full Text | Google Scholar

19. Patel SG, Schoenfeld P, Kim HM, Ward EK, Bansal A, Kim Y, et al. Real-Time Characterization of Diminutive Colorectal Polyp Histology Using Narrow-Band Imaging: Implications for the Resect and Discard Strategy. Gastroenterology (2016) 150:406–18. doi: 10.1053/j.gastro.2015.10.042

CrossRef Full Text | Google Scholar

20. Rees CJ, Rajasekhar PT, Wilson A, Close H, Rutter MD, Saunders BP, et al. Narrow Band Imaging Optical Diagnosis of Small Colorectal Polyps in Routine Clinical Practice: The Detect Inspect Characterise Resect and Discard 2 (DISCARD 2) Study. Gut (2017) 66:887–95. doi: 10.1136/gutjnl-2015-310584

CrossRef Full Text | Google Scholar

21. Byrne MF, Chapados N, Soudan F, Oertel C, Linares PM, Kelly R, et al. Real-Time Differentiation of Adenomatous and Hyperplastic Diminutive Colorectal Polyps During Analysis of Unaltered Videos of Standard Colonoscopy Using a Deep Learning Model. Gut (2019) 68:94–100. doi: 10.1136/gutjnl-2017-314547

CrossRef Full Text | Google Scholar

22. Abu DB, Thosani N, Konda V, Wallace MB, Rex DK, Chauhan SS, et al. ASGE Technology Committee Systematic Review and Meta-Analysis Assessing the ASGE PIVI Thresholds for Adopting Real-Time Endoscopic Assessment of the Histology of Diminutive Colorectal Polyps. Gastrointest Endosc (2015) 81:501–2. doi: 10.1016/j.gie.2014.12.022

CrossRef Full Text | Google Scholar

23. Rex DK, Kahi C, O'Brien M, Levin TR, Pohl H, Rastogi A, et al. The American Society for Gastrointestinal Endoscopy PIVI (Preservation and Incorporation of Valuable Endoscopic Innovations) on Real-Time Endoscopic Assessment of the Histology of Diminutive Colorectal Polyps. Gastrointest Endosc (2011) 73:419–22. doi: 10.1016/j.gie.2011.01.023

CrossRef Full Text | Google Scholar

24. Kominami Y, Yoshida S, Tanaka S, Sanomura Y, Hirakawa T, Raytchev B, et al. Computer-Aided Diagnosis of Colorectal Polyp Histology by Using a Real-Time Image Recognition System and Narrow-Band Imaging Magnifying Colonoscopy. Gastrointest Endosc (2016) 83:643–9. doi: 10.1016/j.gie.2015.08.004

CrossRef Full Text | Google Scholar

25. Tischendorf JJ, Gross S, Winograd R, Hecker H, Auer R, Behrens A, et al. Computer-Aided Classification of Colorectal Polyps Based on Vascular Patterns: A Pilot Study. Endoscopy (2010) 42:203–7. doi: 10.1055/s-0029-1243861

CrossRef Full Text | Google Scholar

26. Singh R, Jayanna M, Navadgi S, Ruszkiewicz A, Saito Y, Uedo N. Narrow-Band Imaging With Dual Focus Magnification in Differentiating Colorectal Neoplasia. Dig Endosc (2013) 25(Suppl 2):16–20. doi: 10.1111/den.12075

CrossRef Full Text | Google Scholar

27. IJspeert JEG, Bastiaansen BAJ, van Leerdam ME, Meijer GA, van Eeden S, Sanduleanu S, et al. Development and Validation of the WASP Classification System for Optical Diagnosis of Adenomas, Hyperplastic Polyps and Sessile Serrated Adenomas/Polyps. Gut (2016) 65:963. doi: 10.1136/gutjnl-2014-308411

CrossRef Full Text | Google Scholar

28. Zorron CTPL, Maicas G, Tian Y, Yamamura T, Nakamura M, Suzuki H, et al. Computer-Aided Diagnosis for Characterization of Colorectal Lesions: Comprehensive Software That Includes Differentiation of Serrated Lesions. Gastrointest Endosc (2020) 92:891–9. doi: 10.1016/j.gie.2020.02.042

CrossRef Full Text | Google Scholar

Keywords: artificial intelligence, colorectal, polyp, NBI, NICE

Citation: Lu Y, Wu J, Zhuo X, Hu M, Chen Y, Luo Y, Feng Y, Zhi M, Li C and Sun J (2022) Real-Time Artificial Intelligence-Based Histologic Classifications of Colorectal Polyps Using Narrow-Band Imaging. Front. Oncol. 12:879239. doi: 10.3389/fonc.2022.879239

Received: 19 February 2022; Accepted: 28 March 2022;
Published: 26 April 2022.

Edited by:

Luca Saragoni, L. Pierantoni GB Morganis Hospital, Italy

Reviewed by:

Arnaldo Amato, Valduce Hospital, Italy
Huafeng Wang, North China University of Technology, China

Copyright © 2022 Lu, Wu, Zhuo, Hu, Chen, Luo, Feng, Zhi, Li and Sun. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Chujun Li, lichujun@mail.sysu.edu.cn; Jiachen Sun, sunjch8@mail.sysu.edu.cn

These authors have contributed equally to this work

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.