The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Deep Learning Localizes and Identifies Polyps in Real Time With 96% Accuracy in Screening Colonoscopy
Open accessAbstract
Background & Aims: The benefit of colonoscopy for colorectal cancer prevention depends on the adenoma detection rate (ADR). The ADR should reflect adenoma prevalence rate, estimated to be greater than 50% among the screening-age population. Yet the rate of adenoma detection by colonoscopists varies from 7% to 53%. It is estimated that every 1% increase in ADR reduces the risk of interval colorectal cancers by 3-6%. New strategies are needed to increase the ADR during colonoscopy. We tested the ability of computer-assisted image analysis, with convolutional neural networks (a deep learning model for image analysis), to improve polyp detection, a surrogate of ADR. Methods: We designed and trained deep convolutional neural networks (CNN) to detect polyps using a diverse and representative set of 8641 hand labeled images from screening colonoscopies collected from over 2000 patients. We tested the models on 20 colonoscopy videos with a total duration of 5 hours. Expert colonoscopists were asked to identify all polyps in 9 de-identified colonoscopy videos, selected from archived video studies, either with or without benefit of the CNN overlay. Their findings were compared with those of the CNN, using CNN-assisted expert review as the reference. Results: When tested on manually labeled images, the CNN identified polyps with an area under the receiver operating characteristic curve (ROC-AUC) of 0.991 and an accuracy of 96.4%. In the analysis of colonoscopy videos in which 28 polyps were removed, 4 expert reviewers identified 8 additional polyps without CNN assistance that had not been removed and identified an additional 17 polyps with CNN assistance (45 in total). All polyps removed and identified by expert review were detected by the CNN. The CNN had a false-positive rate of 7%. Conclusion: In a set of 8641 colonoscopy images containing 4088 unique polyps the CNN identified polyps with a cross-validation accuracy of 96.4% and ROC-AUC value of 0.991. The CNN system can detect and localize polyps well within real-time constraints using an ordinary desktop machine with a contemporary graphics processing unit. This system could increase ADR and reduce interval colorectal cancers but requires validation in large multicenter trials.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
Cited by
Efficacy of real-time computer-aided detection of colorectal neoplasia in a randomized trial
Repici, A., Badalamenti, M., Maselli, R., Correale, L., Radaelli, F., Rondonotti, E., Ferrara, E., Spadaccini, M., Alkandari, A., Fugazza, A., et al. (2020) · Gastroenterology · doi:10.1053/j.gastro.2020.04.062 · Cited by 646
Application of Artificial Intelligence to Gastroenterology and Hepatology
Le Berre, C., Sandborn, W. J., Aridhi, S., Devignes, M.-D., Fournier, L., Smaïl-Tabbone, M., Danese, S., & Peyrin-Biroulet, L. (2020) · Gastroenterology · doi:10.1053/j.gastro.2019.08.058 · Cited by 516
Masud, M., Sikder, N., Nahid, A.-A., Bairagi, A. K., & AlZain, M. A. (2021) · Sensors · doi:10.3390/s21030748 · Cited by 464
Kamiński, M., Hassan, C., Bisschops, R., Pohl, J., Pellisé, M., Dekker, E., Ignjatovic-Wilson, A., Hoffman, A., Longcroft-Wheaton, G., Heresbach, D., et al. (2014) · Endoscopy · doi:10.1055/s-0034-1365348 · Cited by 433
Gong, D., Wu, L., Zhang, J., Mu, G., Shen, L., Liu, J., Wang, Z., Zhou, W., An, P., Huang, X., et al. (2020) · The Lancet Gastroenterology & Hepatology · doi:10.1016/s2468-1253(19)30413-3 · Cited by 393
de Groof, A. J., Struyvenberg, M. R., van der Putten, J., van der Sommen, F., Fockens, K. N., Curvers, W. L., Zinger, S., Pouw, R. E., Coron, E., Baldaque-Silva, F., et al. (2020) · Gastroenterology · doi:10.1053/j.gastro.2019.11.030 · Cited by 340
Bisschops, R., East, J. E., Hassan, C., Hazewinkel, Y., Kamiński, M. F., Neumann, H., Pellisé, M., Antonelli, G., Bustamante Balen, M., Coron, E., et al. (2019) · Endoscopy · doi:10.1055/a-1031-7657 · Cited by 340
Wu, L., Zhang, J., Zhou, W., An, P., Shen, L., Liu, J., Jiang, X., Huang, X., Mu, G., Wan, X., et al. (2019) · Gut · doi:10.1136/gutjnl-2018-317366 · Cited by 316
Designing deep learning studies in cancer diagnostics
Kleppe, A., Skrede, O.-J., De Raedt, S., Liestøl, K., Kerr, D. J., & Danielsen, H. E. (2021) · Nature Reviews Cancer · doi:10.1038/s41568-020-00327-9 · Cited by 316
Mehmood, S., Ghazal, T. M., Khan, M. A., Zubair, M., Naseem, M. T., Faiz, T., & Ahmad, M. (2022) · IEEE Access · doi:10.1109/access.2022.3150924 · Cited by 292
Su, J.-R., Li, Z., Shao, X.-J., Ji, C.-R., Ji, R., Zhou, R.-C., Li, G.-C., Liu, G.-Q., He, Y.-S., Zuo, X.-L., et al. (2020) · Gastrointestinal Endoscopy · doi:10.1016/j.gie.2019.08.026 · Cited by 286
Stidham, R. W., Liu, W., Bishu, S., Rice, M. D., Higgins, P. D. R., Zhu, J., Nallamothu, B. K., & Waljee, A. K. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.3963 · Cited by 285
Chen, Z., Lin, L., Wu, C., Li, C., Xu, R., & Sun, Y. (2021) · Cancer Communications · doi:10.1002/cac2.12215 · Cited by 285
Deep learning in medical image analysis: A third eye for doctors
Fourcade, A., & Khonsari, R. H. (2019) · Journal of Stomatology, Oral and Maxillofacial Surgery · doi:10.1016/j.jormas.2019.06.002 · Cited by 284
A comprehensive review of deep learning in colon cancer
Pacal, I., Karaboga, D., Basturk, A., Akay, B., & Nalbantoglu, U. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.104003 · Cited by 283
Application of artificial intelligence in gastroenterology
Yang, Y. J., & Bang, C. S. (2019) · World Journal of Gastroenterology · doi:10.3748/wjg.v25.i14.1666 · Cited by 263
Chakraborty, C., Bhattacharya, M., Pal, S., & Lee, S.-S. (2024) · Current Research in Biotechnology · doi:10.1016/j.crbiot.2023.100164 · Cited by 274
Artificial Intelligence in Colorectal Cancer Screening, Diagnosis and Treatment. A New Era
Mitsala, A., Tsalikidis, C., Pitiakoudis, M., Simopoulos, C., & Tsaroucha, A. K. (2021) · Current Oncology · doi:10.3390/curroncol28030149 · Cited by 271
Yamada, M., Saito, Y., Imaoka, H., Saiko, M., Yamada, S., Kondo, H., Takamaru, H., Sakamoto, T., Sese, J., Kuchiba, A., et al. (2019) · Scientific Reports · doi:10.1038/s41598-019-50567-5 · Cited by 265
Deep learning models in medical image analysis
Tsuneki, M. (2022) · Journal of Oral Biosciences · doi:10.1016/j.job.2022.03.003 · Cited by 257
Wickstrøm, K., Kampffmeyer, M., & Jenssen, R. (2020) · Medical Image Analysis · doi:10.1016/j.media.2019.101619 · Cited by 185
Study on detection rate of polyps and adenomas in artificial-intelligence-aided colonoscopy
Huang, J., Liu, W.-N., Zhang, Y.-Y., Bian, X.-Q., Wang, L.-J., Yang, Q., & Zhang, X.-D. (2020) · Saudi Journal of Gastroenterology · doi:10.4103/sjg.sjg_377_19 · Cited by 179
“[6,18] The main research focused in this field includes automatic paired polyp detection [19,20] and feature analysis, [8,10] which may help improve the detection rate of adenomas, respectively.”
BackgroundArtificial intelligence and colonoscopy: Current status and future perspectives
Kudo, S., Mori, Y., Misawa, M., Takeda, K., Kudo, T., Itoh, H., Oda, M., & Mori, K. (2019) · Digestive Endoscopy · doi:10.1111/den.13340 · Cited by 147
Marya, N. B., Powers, P. D., Chari, S. T., Gleeson, F. C., Leggett, C. L., Abu Dayyeh, B. K., Chandrasekhara, V., Iyer, P. G., Majumder, S., Pearson, R. K., et al. (2021) · Gut · doi:10.1136/gutjnl-2020-322821 · Cited by 146
Jin, E. H., Lee, D., Bae, J. H., Kang, H. Y., Kwak, M.-S., Seo, J. Y., Yang, J. I., Yang, S. Y., Lim, S. H., Yim, J. Y., et al. (2020) · Gastroenterology · doi:10.1053/j.gastro.2020.02.036 · Cited by 140
Maassen, O., Fritsch, S., Palm, J., Deffge, S., Kunze, J., Marx, G., Riedel, M., Schuppert, A., & Bickenbach, J. (2021) · Journal of Medical Internet Research · doi:10.2196/26646 · Cited by 125
“3 Analysis of endoscopic pictures or videos [41-43]”
BackgroundDiagnostic evaluation of a deep learning model for optical diagnosis of colorectal cancer
Zhou, D., Tian, F., Tian, X., Sun, L., Huang, X., Zhao, F., Zhou, N., Chen, Z., Zhang, Q., Yang, M., et al. (2020) · Nature Communications · doi:10.1038/s41467-020-16777-6 · Cited by 123
Deep learning in biomedical data science
Baldi, P. (2018) · Annual Review of Biomedical Data Science · doi:10.1146/annurev-biodatasci-080917-013343 · Cited by 119
Zachariah, R., Samarasena, J., Luba, D., Duh, E., Dao, T., Requa, J., Ninh, A., & Karnes, W. (2020) · American Journal of Gastroenterology · doi:10.14309/ajg.0000000000000429 · Cited by 117
Self-citationYao, L., Zhang, L., Liu, J., Zhou, W., He, C., Zhang, J., Wu, L., Wang, H., Xu, Y., Gong, D., et al. (2022) · Endoscopy · doi:10.1055/a-1706-6174 · Cited by 116
Artificial intelligence in gastrointestinal endoscopy: general overview
El Hajjar, A., & Rey, J.-F. (2020) · Chinese Medical Journal · doi:10.1097/cm9.0000000000000623 · Cited by 102
“In the same year, Urban al [52] published the result of their work on a CADe.”
Berzin, T. M., Parasa, S., Wallace, M. B., Gross, S. A., Repici, A., & Sharma, P. (2020) · Gastrointestinal Endoscopy · doi:10.1016/j.gie.2020.06.035 · Cited by 102
Colorectal polyp detection in colonoscopy images using YOLO-V8 network
Lalinia, M., & Sahafi, A. (2024) · Signal, Image and Video Processing · doi:10.1007/s11760-023-02835-1 · Cited by 99
Ma, H., Liu, Z.-X., Zhang, J.-J., Wu, F.-T., Xu, C.-F., Shen, Z., Yu, C.-H., & Li, Y.-M. (2020) · World Journal of Gastroenterology · doi:10.3748/wjg.v26.i34.5156 · Cited by 84
Computer-aided detection-assisted colonoscopy: classification and relevance of false positives
Hassan, C., Badalamenti, M., Maselli, R., Correale, L., Iannone, A., Radaelli, F., Rondonotti, E., Ferrara, E., Spadaccini, M., Alkandari, A., et al. (2020) · Gastrointestinal Endoscopy · doi:10.1016/j.gie.2020.06.021 · Cited by 81
Artificial Intelligence Advancements in Oncology: A Review of Current Trends and Future Directions
Huhulea, E. N., Huang, L., Eng, S., Sumawi, B., Huang, A., Aifuwa, E., Hirani, R., Tiwari, R. K., & Etienne, M. (2025) · Biomedicines · doi:10.3390/biomedicines13040951 · Cited by 74
“AI-powered CAD systems and deep learning models are enhancing early cancer detection, surpassing traditional imaging in sensitivity and specificity [38,39,42].”
Christou, C. D., & Tsoulfas, G. (2021) · World Journal of Gastroenterology · doi:10.3748/wjg.v27.i37.6191 · Cited by 54
Thakkar, S., Carleton, N. M., Rao, B., & Syed, A. (2020) · Gastroenterology · doi:10.1053/j.gastro.2019.12.035 · Cited by 47
Xu, Y., Ding, W., Wang, Y., Tan, Y., Xi, C., Ye, N., Wu, D., & Xu, X. (2021) · PLOS ONE · doi:10.1371/journal.pone.0246892 · Cited by 42
“Author Year Country type of endoscopes type of CNN system real-time use of CNN system type of lesions type of images Training material Testing material Field focused Testing objects Lequan [28] 2016 China images from online database 3D fully convolutional neural networks N/A polyps of any size N/A Images Images Detect…”
BackgroundInfluentialColorectal cancer screening in Lynch syndrome: Indication, techniques and future perspectives
Perrod, G., Rahmi, G., & Cellier, C. (2021) · Digestive Endoscopy · doi:10.1111/den.13702 · Cited by 28
Artificial intelligence in colonoscopy: A review on the current status
Larsen, S. L. V., & Mori, Y. (2022) · DEN Open · doi:10.1002/deo2.109 · Cited by 21
Artificial Intelligence-assisted colonoscopy and colorectal cancer screening: Where are we going?
Spadaccini, M., Troya, J., Khalaf, K., Facciorusso, A., Maselli, R., Hann, A., & Repici, A. (2024) · Digestive and Liver Disease · doi:10.1016/j.dld.2024.01.203 · Cited by 20
Syed, S., & Stidham, R. W. (2020) · Inflammatory Bowel Diseases · doi:10.1093/ibd/izaa211 · Cited by 16
Metadata
- Authors
- Urban, G., Tripathi, P., Alkayali, T., Mittal, M., Jalali, F., Karnes, W., & Baldi, P.
- Venue
- Gastroenterology
- Publisher
- Elsevier BV
- Published
- 2018-10
- Volume
- 155
- Issue
- 4
- Pages
- 1069-1078.e8
- ISSN
- 0016-5085 (ISSN-L)
- OpenAlex
- W2809596283
- Cited by
- 744
- References
- 46
- FWCI
- 31.26
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.