Training Programs on Endoscopic Scoring Systems for Inflammatory Bowel Disease Lead to a Significant Increase in Interobserver Agreement Among Community Gastroenterologists
The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
Background and Aims: Endoscopic outcomes are increasingly used in clinical trials and in routine practice for inflammatory bowel disease [IBD] in order to reach more objective patient evaluations than possible using only clinical features. However, reproducibility of endoscopic scoring systems used to categorize endoscopic activity has been reported to be suboptimal. The aim of this study was to analyse the inter-rated agreement of non-dedicated gastroenterologists on IBD endoscopic scoring systems, and to explore the effects of a dedicated training programme on agreement. Methods: A total of 237 physicians attended training courses on IBD endoscopic scoring systems, and they independently scored a set of IBD endoscopic videos for ulcerative colitis [with Mayo endoscopic subscore], post-operative Crohn's disease [with Rutgeerts score] and luminal Crohn's disease (with the Simple Endoscopic Score for Crohn's Disease [SESCD] and Crohn's Endoscopic Index of Severity [CDEIS]). A second round of scoring was collected after discussion about determinants of discrepancy. Interobserver agreement was measured by means of the Fleiss' kappa [kappa] or intraclass correlation coefficient [ICC] as appropriate. Results: The inter-rater agreement increased from kappa 0.51 (95% confidence interval [95% CI] 0.48-0.55) to 0.76 [95% CI 0.72-0.79] for the Mayo endoscopic subscore, and from 0.45 [95% CI 0.40-0.50] to 0.79 [0.74-0.83] for the Rutgeerts score before and after the training programme, respectively, and both differences were significant [P < 0.0001]. The ICC was 0.77 [95% CI 0.56-0.96] for SESCD and 0.76 [0.54- 0.96] for CDEIS, respectively, with only one measurement. Discussion: The basal inter-rater agreement of inexperienced gastroenterologists focused on IBD management is moderate; however, a dedicated training programme can significantly impact on inter-rater agreement, increasing it to levels expected among expert central reviewers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Converging goals of treatment of inflammatory bowel disease from clinical trials and practice
Levesque, B. G., Sandborn, W. J., Ruel, J., Feagan, B. G., Sands, B. E., & Colombel, J.-F. (2015) · Gastroenterology · doi:10.1053/j.gastro.2014.08.003 · Cited by 217
Cited by
Iacucci, M., Daperno, M., Lazarev, M., Arsenascu, R., Tontini, G. E., Akinola, O., Gui, X. S., Villanacci, V., Goetz, M., Lowerison, M., et al. (2017) · Gastrointestinal Endoscopy · doi:10.1016/j.gie.2017.03.012 · Cited by 92
Self-citationFan, Y., Mu, R., Xu, H., Xie, C., Zhang, Y., Liu, L., Wang, L., Shi, H., Hu, Y., Ren, J., et al. (2023) · Gastrointestinal Endoscopy · doi:10.1016/j.gie.2022.08.015 · Cited by 58
Lo, B., Liu, Z., Bendtsen, F., Igel, C., Vind, I., & Burisch, J. (2022) · American Journal of Gastroenterology · doi:10.14309/ajg.0000000000001904 · Cited by 29
Scoring endoscopic disease activity in IBD: artificial intelligence sees more and better than we do
Bossuyt, P., Vermeire, S., & Bisschops, R. (2020) · Gut · doi:10.1136/gutjnl-2019-318235 · Cited by 24
Endoscopy in IBD: when and how?
Daperno, M. (2023) · Diagnostics · doi:10.3390/diagnostics13223423 · Cited by 20
Self-citation
Metadata
- Authors
- Daperno, M., Comberlato, M., Bossa, F., Armuzzi, A., Biancone, L., Bonanomi, A. G., Cosintino, R., Lombardi, G., Mangiarotti, R., Papa, A., Pica, R., Grassano, L., Pagana, G., D’Incà, R., Orlando, A., Rizzello, F., & on behalf of the IGIBDEndo Group
- Venue
- Journal of Crohn's and Colitis
- Publisher
- Oxford University Press (OUP)
- Published
- 2016-10-04
- Volume
- 11
- Issue
- 5
- Pages
- jjw181
- ISSN
- 1873-9946 (ISSN-L)
- 1876-4479
- OpenAlex
- W2528101273
- Cited by
- 64
- References
- 1
- FWCI
- 2.94
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Training Programs on Endoscopic Scoring Systems for Inflammatory Bowel Disease Lead to a Significant Increase in Interobserver Agreement Among Community Gastroenterologists. https://app.cochat.ai/papers/10.1093/ecco-jcc/jjw181
- The paper
- Daperno, M., Comberlato, M., Bossa, F., Armuzzi, A., Biancone, L., Bonanomi, A. G., Cosintino, R., Lombardi, G., Mangiarotti, R., Papa, A., Pica, R., Grassano, L., Pagana, G., D’Incà, R., Orlando, A., Rizzello, F., & on behalf of the IGIBDEndo Group. (2016). Training Programs on Endoscopic Scoring Systems for Inflammatory Bowel Disease Lead to a Significant Increase in Interobserver Agreement Among Community Gastroenterologists. Journal of Crohn's and Colitis. https://doi.org/10.1093/ecco-jcc/jjw181
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.