Cited by 5Colorectal Cancer Screening and DetectionAI in cancer detectionOptical Imaging and Spectroscopy Techniques

Impact of 3-second rule for high confidence assignment on the performance of endoscopists for the real-time optical diagnosis of colorectal polyps

Kim, Jung, Lim, Seon Hee, Kang, Hae Yeon, Song, Ji Hyun, Yang, Sun Young, Chung, Goh Eun, Jin, Eun Hyo, Choi, Ji Min +1 more·2023·Endoscopy

Abstract

Background Confusion between high and low confidence decisions in optical diagnosis hinders the implementation of real-time optical diagnosis in clinical practice. We evaluated the effect of a 3-second rule (decision time limited to 3 seconds for a high confidence assignment) in expert and nonexpert endoscopists. Methods This single-center prospective study included eight board-certified gastroenterologists. A 2-month baseline phase used standard real-time optical diagnosis for colorectal polyps < 10 mm and was followed by a 6-month intervention phase using optical diagnosis with the 3-second rule. Performance, including high confidence accuracy, and Preservation and Incorporation of Valuable Endoscopic Innovations (PIVI) and Simple Optical Diagnosis Accuracy (SODA) thresholds, was measured. Results Real-time optical diagnosis was performed on 1793 patients with 3694 polyps. There was significant improvement in high confidence accuracy between baseline and intervention phases in the nonexpert group (79.2 % vs. 86.3 %; P = 0.01) but not in the expert group (85.3 % vs. 87.5 %; P = 0.53). Using the 3-second rule improved the overall performance of PIVI and SODA in both groups. Conclusions The 3-second rule was effective in improving real-time optical diagnosis performance, especially in nonexperts.

Integrity signals

Registry

Crossref · 10.1055/a-2073-3411

Cites

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The study's sample size was calculated to require a minimum of 470 observations per group, based on an assumed HC rate of 61%, HC accuracy of 81%, expected effect size of 10%, α=0.025, and 90% power.

    “The sample size calculation was therefore based on the unpaired comparison, assuming an HC rate of 61% and an HC accuracy of 81% from a previous 3-second rule study,11 with an expected effect size of 10%, α=0.025 (adjusted for two hypotheses), and 90% power. This yielded requirements of 470 observations per group for the HC rate hypothesis and 251 per group for the HC accuracy hypothesis; thus, to”
  • Applying the 3-second rule significantly enhances the capability to meet the SODA and PIVI thresholds in real-time optical diagnosis.

    “Applying this 3-second rule significantly enhances the capability to meet the SODA and PIVI thresholds in real-time optical diagnosis.11”
  • The 3-second threshold was established based on earlier research indicating an average decision time of 3.9 seconds.

    “This 3-second threshold was established based on earlier research indicating an average decision time of 3.9 seconds.11,12”

Cited by

Sorted by citations

Authors
Kim, J., Lim, S. H., Kang, H. Y., Song, J. H., Yang, S. Y., Chung, G. E., Jin, E. H., Choi, J. M., & Bae, J. H.
Affiliations
Seoul National University (KR)
Venue
Endoscopy
Published
2023-05-12
Volume
55
Issue
10
Pages
945-951
ISSN
  • 0013-726X (ISSN-L)
  • 1438-8812
OpenAlex
W4376269749
Cited by
5
References
0
Citations by year
2026: 1 · 2025: 3 · 2024: 1
FWCI
0.61
Type
journal article
Language
en
Open access
closed
Locations
  • Endoscopy (publishedVersion)
  • PubMed (publishedVersion)
Funders
Ministry of Health and Welfare, Republic of Korea
Topics
  • Health Sciences › Medicine › Oncology › Colorectal Cancer Screening and Detection
  • Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
  • Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Optical Imaging and Spectroscopy Techniques
Keywords
colorectal polyps
MeSH terms
Colonic Polyps, Colonoscopy, Humans, Predictive Value of Tests, Prospective Studies, Colorectal Neoplasms, Narrow Band Imaging

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review