Impact of 3-second rule for high confidence assignment on the performance of endoscopists for the real-time optical diagnosis of colorectal polyps
Abstract
Background Confusion between high and low confidence decisions in optical diagnosis hinders the implementation of real-time optical diagnosis in clinical practice. We evaluated the effect of a 3-second rule (decision time limited to 3 seconds for a high confidence assignment) in expert and nonexpert endoscopists. Methods This single-center prospective study included eight board-certified gastroenterologists. A 2-month baseline phase used standard real-time optical diagnosis for colorectal polyps < 10 mm and was followed by a 6-month intervention phase using optical diagnosis with the 3-second rule. Performance, including high confidence accuracy, and Preservation and Incorporation of Valuable Endoscopic Innovations (PIVI) and Simple Optical Diagnosis Accuracy (SODA) thresholds, was measured. Results Real-time optical diagnosis was performed on 1793 patients with 3694 polyps. There was significant improvement in high confidence accuracy between baseline and intervention phases in the nonexpert group (79.2 % vs. 86.3 %; P = 0.01) but not in the expert group (85.3 % vs. 87.5 %; P = 0.53). Using the 3-second rule improved the overall performance of PIVI and SODA in both groups. Conclusions The 3-second rule was effective in improving real-time optical diagnosis performance, especially in nonexperts.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The study's sample size was calculated to require a minimum of 470 observations per group, based on an assumed HC rate of 61%, HC accuracy of 81%, expected effect size of 10%, α=0.025, and 90% power.
“The sample size calculation was therefore based on the unpaired comparison, assuming an HC rate of 61% and an HC accuracy of 81% from a previous 3-second rule study,11 with an expected effect size of 10%, α=0.025 (adjusted for two hypotheses), and 90% power. This yielded requirements of 470 observations per group for the HC rate hypothesis and 251 per group for the HC accuracy hypothesis; thus, to”
From Structured Integration of an Artificial Intelligence-Based System for the Optical Diagnosis of Colorectal Polyps (2026) · cites this paper as [11]
Applying the 3-second rule significantly enhances the capability to meet the SODA and PIVI thresholds in real-time optical diagnosis.
“Applying this 3-second rule significantly enhances the capability to meet the SODA and PIVI thresholds in real-time optical diagnosis.11”
From Structured Integration of an Artificial Intelligence-Based System for the Optical Diagnosis of Colorectal Polyps (2026) · cites this paper as [11]
The 3-second threshold was established based on earlier research indicating an average decision time of 3.9 seconds.
“This 3-second threshold was established based on earlier research indicating an average decision time of 3.9 seconds.11,12”
From Structured Integration of an Artificial Intelligence-Based System for the Optical Diagnosis of Colorectal Polyps (2026) · cites this paper as [11]
Cited by
Sorted by citations
Kang, H. Y., Kang, S., Chung, G. E., Baek, D. H., Lee, H. S., Park, J., Yang, S. Y., Lim, S. H., Choi, J. M., Kim, J., et al. (2026) · Gut and Liver · doi:10.5009/gnl250331
Self-citation
- Authors
- Kim, J., Lim, S. H., Kang, H. Y., Song, J. H., Yang, S. Y., Chung, G. E., Jin, E. H., Choi, J. M., & Bae, J. H.
- Affiliations
- Seoul National University (KR)
- ORCID
- Venue
- Endoscopy
- Publisher
- Georg Thieme Verlag KG
- Published
- 2023-05-12
- Volume
- 55
- Issue
- 10
- Pages
- 945-951
- ISSN
- 0013-726X (ISSN-L)
- 1438-8812
- OpenAlex
- W4376269749
- Cited by
- 5
- References
- 0
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 1
- FWCI
- 0.61
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Endoscopy (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Ministry of Health and Welfare, Republic of Korea
- Topics
- Health Sciences › Medicine › Oncology › Colorectal Cancer Screening and Detection
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Optical Imaging and Spectroscopy Techniques
- Keywords
- colorectal polyps
- MeSH terms
- Colonic Polyps, Colonoscopy, Humans, Predictive Value of Tests, Prospective Studies, Colorectal Neoplasms, Narrow Band Imaging
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review