The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Automated Polyp Detection in Colonoscopy Videos Using Shape and Context Information
Abstract
This paper presents the culmination of our research in designing a system for computer-aided detection (CAD) of polyps in colonoscopy videos. Our system is based on a hybrid context-shape approach, which utilizes context information to remove non-polyp structures and shape information to reliably localize polyps. Specifically, given a colonoscopy image, we first obtain a crude edge map. Second, we remove non-polyp edges from the edge map using our unique feature extraction and edge classification scheme. Third, we localize polyp candidates with probabilistic confidence scores in the refined edge maps using our novel voting scheme. The suggested CAD system has been tested using two public polyp databases, CVC-ColonDB, containing 300 colonoscopy images with a total of 300 polyp instances from 15 unique polyps, and ASU-Mayo database, which is our collection of colonoscopy videos containing 19,400 frames and a total of 5,200 polyp instances from 10 unique polyps. We have evaluated our system using free-response receiver operating characteristic (FROC) analysis. At 0.1 false positives per frame, our system achieves a sensitivity of 88.0% for CVC-ColonDB and a sensitivity of 48% for the ASU-Mayo database. In addition, we have evaluated our system using a new detection latency analysis where latency is defined as the time from the first appearance of a polyp in the colonoscopy video to the time of its first detection by our system. At 0.05 false positives per frame, our system yields a polyp detection latency of 0.3 seconds.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Multiresolution gray-scale and rotation invariant texture classification with local binary patterns
Ojala, T., Pietikainen, M., & Maenpaa, T. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1017623 · Cited by 15,398
Siegel, R. L., Miller, K. D., & Jemal, A. (2015) · CA: A Cancer Journal for Clinicians · doi:10.3322/caac.21254 · Cited by 11,853
Mcgill, R., Tukey, J. W., & Larsen, W. A. (1978) · The American Statistician · doi:10.1080/00031305.1978.10479236 · Cited by 2,490
Bernal, J., Sánchez, F. J., Fernández-Esparrach, G., Gil, D., Rodríguez, C., & Vilariño, F. (2015) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2015.02.007 · Cited by 2,191
DAISY: An Efficient Dense Descriptor Applied to Wide-Baseline Stereo
Tola, E., Lepetit, V., & Fua, P. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.77 · Cited by 1,405 · cited 1×
“13(a) shows the receiver operating characteristic (ROC) curves of the first classification layer for the suggested patch descriptor and the other widely used descriptors such as HoG1 [46], LBP2 [47], and Daisy3 [48].”
BackgroundPolyp Miss Rate Determined by Tandem Colonoscopy: A Systematic Review
van Rijn, J. C., Reitsma, J. B., Stoker, J., Bossuyt, P. M., van Deventer, S. J., & Dekker, E. (2006) · The American Journal of Gastroenterology · doi:10.1111/j.1572-0241.2006.00390.x · Cited by 1,344
Toward embedded detection of polyps in WCE images for early diagnosis of colorectal cancer
Silva, J., Histace, A., Romain, O., Dray, X., & Granado, B. (2014) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-013-0926-3 · Cited by 1,309
CT Colonography versus Colonoscopy for the Detection of Advanced Neoplasia
Kim, D. H., Pickhardt, P. J., Taylor, A. J., Leung, W. K., Winter, T. C., Hinshaw, J. L., Gopal, D. V., Reichelderfer, M., Hsu, R. H., & Pfau, P. R. (2007) · New England Journal of Medicine · doi:10.1056/nejmoa070543 · Cited by 706
Towards automatic polyp detection with a polyp appearance model
Bernal, J., Sánchez, J., & Vilariño, F. (2012) · Pattern Recognition · doi:10.1016/j.patcog.2012.03.002 · Cited by 705
Cited by
Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning?
Tajbakhsh, N., Shin, J. Y., Gurudu, S. R., Hurst, R. T., Kendall, C. B., Gotway, M. B., & Liang, J. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2535302 · Cited by 3,277
“(a) Comparison between incremental fine-tuning, training from scratch, and a handcrafted approach [42].”
BackgroundMethodSelf-citationKvasir-SEG: A Segmented Polyp Dataset
Jha, D., Smedsrud, P. H., Riegler, M. A., Halvorsen, P., de Lange, T., Johansen, D., & Johansen, H. D. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-37734-2_37 · Cited by 1,661
PraNet: Parallel Reverse Attention Network for Polyp Segmentation
Fan, D.-P., Ji, G.-P., Zhou, T., Chen, G., Fu, H., Shen, J., & Shao, L. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-59725-2_26 · Cited by 1,499
TransFuse: Fusing Transformers and CNNs for Medical Image Segmentation
Zhang, Y., Liu, H., & Hu, Q. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-87193-2_2 · Cited by 1,312
Transformers in medical imaging: A survey
Shamshad, F., Khan, S., Zamir, S. W., Khan, M. H., Hayat, M., Khan, F. S., & Fu, H. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102802 · Cited by 1,296
DS-TransUNet: Dual Swin Transformer U-Net for Medical Image Segmentation
Lin, A., Chen, B., Xu, J., Zhang, Z., Lu, G., & Zhang, D. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3178991 · Cited by 882
A Benchmark for Endoluminal Scene Segmentation of Colonoscopy Images
Vázquez, D., Bernal, J., Sánchez, F. J., Fernández-Esparrach, G., López, A. M., Romero, A., Drozdzal, M., & Courville, A. (2017) · Journal of Healthcare Engineering · doi:10.1155/2017/4037190 · Cited by 866
Wang, P., Berzin, T. M., Glissen Brown, J. R., Bharadwaj, S., Becq, A., Xiao, X., Liu, P., Li, L., Song, Y., Zhang, D., et al. (2019) · Gut · doi:10.1136/gutjnl-2018-317500 · Cited by 865
KVASIR: A Multi-Class Image Dataset for Computer Aided Gastrointestinal Disease Detection
Pogorelov, K., Randel, K. R., Griwodz, C., Eskeland, S. L., de Lange, T., Johansen, D., Spampinato, C., Dang-Nguyen, D.-T., Lux, M., Schmidt, P. T., et al. (2017) · Proceedings of the 8th ACM on Multimedia Systems Conference · doi:10.1145/3083187.3083212 · Cited by 684
HyperKvasir, a comprehensive multi-class image and video dataset for gastrointestinal endoscopy
Borgli, H., Thambawita, V., Smedsrud, P. H., Hicks, S., Jha, D., Eskeland, S. L., Randel, K. R., Pogorelov, K., Lux, M., Nguyen, D. T. D., et al. (2020) · Scientific Data · doi:10.1038/s41597-020-00622-y · Cited by 564
Polyp-PVT: Polyp Segmentation with Pyramid Vision Transformers
Dong, B., Wang, W., Fan, D.-P., Li, J., Fu, H., & Shao, L. (2023) · CAAI Artificial Intelligence Research · doi:10.26599/air.2023.9150015 · Cited by 530
Deep learning for image-based cancer detection and diagnosis − A survey
Hu, Z., Tang, J., Wang, Z., Zhang, K., Zhang, L., & Sun, Q. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.05.014 · Cited by 509
Transformers in medical image analysis
He, K., Gan, C., Li, Z., Rekik, I., Yin, Z., Ji, W., Gao, Y., Wang, Q., Zhang, J., & Shen, D. (2023) · Intelligent Medicine · doi:10.1016/j.imed.2022.07.002 · Cited by 475
Bernal, J., Tajkbaksh, N., Sanchez, F. J., Matuszewski, B. J., Chen, H., Yu, L., Angermann, Q., Romain, O., Rustad, B., Balasingham, I., et al. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2664042 · Cited by 437
Self-citationShallow Attention Network for Polyp Segmentation
Wei, J., Hu, Y., Zhang, R., Li, Z., Zhou, S. K., & Cui, S. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-87193-2_66 · Cited by 383
Medical Image Segmentation via Cascaded Attention Decoding
Rahman, M. M., & Marculescu, R. (2023) · 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv56688.2023.00616 · Cited by 382
Zhang, R., Zheng, Y., Mak, T. W. C., Yu, R., Wong, S. H., Lau, J. Y. W., & Poon, C. C. Y. (2017) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2016.2635662 · Cited by 374
Cross-level Feature Aggregation Network for Polyp Segmentation
Zhou, T., Zhou, Y., He, K., Gong, C., Yang, J., Fu, H., & Shen, D. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.109555 · Cited by 347
Jha, D., Smedsrud, P. H., Johansen, D., de Lange, T., Johansen, H. D., Halvorsen, P., & Riegler, M. A. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2021.3049304 · Cited by 345
Segment anything model for medical image segmentation: Current applications and future directions
Zhang, Y., Shen, Z., & Jiao, R. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108238 · Cited by 332
Automatic Polyp Segmentation via Multi-scale Subtraction Network
Zhao, X., Zhang, L., & Lu, H. (2021) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-87193-2_12 · Cited by 319
Kvasir-Capsule, a video capsule endoscopy dataset
Smedsrud, P. H., Thambawita, V., Hicks, S. A., Gjestang, H., Nedrejord, O. O., Næss, E., Borgli, H., Jha, D., Berstad, T. J. D., Eskeland, S. L., et al. (2021) · Scientific Data · doi:10.1038/s41597-021-00920-z · Cited by 290
Ozyoruk, K. B., Gokceler, G. I., Bobrow, T. L., Coskun, G., Incetan, K., Almalioglu, Y., Mahmood, F., Curto, E., Perdigoto, L., Oliveira, M., et al. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102058 · Cited by 270
Polyp Segmentation in Colonoscopy Images Using Fully Convolutional Network
Akbari, M., Mohrekesh, M., Nasr-Esfahani, E., Soroushmehr, S. M. R., Karimi, N., Samavi, S., & Najarian, K. (2018) · 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2018.8512197 · Cited by 266
Yamada, M., Saito, Y., Imaoka, H., Saiko, M., Yamada, S., Kondo, H., Takamaru, H., Sakamoto, T., Sese, J., Kuchiba, A., et al. (2019) · Scientific Reports · doi:10.1038/s41598-019-50567-5 · Cited by 265
Unsupervised Reverse Domain Adaptation for Synthetic Medical Images via Adversarial Training
Mahmood, F., Chen, R., & Durr, N. J. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2842767 · Cited by 257
“3) Real Endoscopy Data: We also evaluate our networks on publicly available endoscopy data2 [59], [60].”
MethodFocus U-Net: A novel dual attention-gated CNN for polyp segmentation during colonoscopy
Yeung, M., Sala, E., Schönlieb, C.-B., & Rundo, L. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104815 · Cited by 186
Wickstrøm, K., Kampffmeyer, M., & Jenssen, R. (2020) · Medical Image Analysis · doi:10.1016/j.media.2019.101619 · Cited by 185
Artificial intelligence and colonoscopy: Current status and future perspectives
Kudo, S., Mori, Y., Misawa, M., Takeda, K., Kudo, T., Itoh, H., Oda, M., & Mori, K. (2019) · Digestive Endoscopy · doi:10.1111/den.13340 · Cited by 147
Colorectal polyp detection in colonoscopy images using YOLO-V8 network
Lalinia, M., & Sahafi, A. (2024) · Signal, Image and Video Processing · doi:10.1007/s11760-023-02835-1 · Cited by 99
Model-Heterogeneous Semi-Supervised Federated Learning for Medical Image Segmentation
Ma, Y., Wang, J., Yang, J., & Wang, L. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2023.3348982 · Cited by 55
Controlling False Positives in Image Segmentation via Conformal Prediction
Mossina, L., & Friedrich, C. (2025) · arXiv · doi:10.48550/arxiv.2511.15406
Metadata
- Authors
- Tajbakhsh, N., Gurudu, S. R., & Liang, J.
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2016-02
- Volume
- 35
- Issue
- 2
- Pages
- 630-644
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W2285968993
- Cited by
- 1,203
- References
- 38
- FWCI
- 9.23
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.