CoChat

Uncertainty-Aware Organ Classification for Surgical Data Science Applications in Laparoscopy

Open access
Moccia, Sara, Wirkert, Sebastian J., Kenngott, Hannes, Vemuri, Anant S., Apitz, Martin, Mayer, Benjamin, De Momi, Elena, Mattos, Leonardo S., Maier-Hein, Lena · 2018 · IEEE Transactions on Biomedical Engineering

The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.

Abstract

OBJECTIVE: Surgical data science is evolving into a research field that aims to observe everything occurring within and around the treatment process to provide situation-aware data-driven assistance. In the context of endoscopic video analysis, the accurate classification of organs in the field of view of the camera proffers a technical challenge. Herein, we propose a new approach to anatomical structure classification and image tagging that features an intrinsic measure of confidence to estimate its own performance with high reliability and which can be applied to both RGB and multispectral imaging (MI) data. METHODS: Organ recognition is performed using a superpixel classification strategy based on textural and reflectance information. Classification confidence is estimated by analyzing the dispersion of class probabilities. Assessment of the proposed technology is performed through a comprehensive in vivo study with seven pigs. RESULTS: When applied to image tagging, mean accuracy in our experiments increased from 65% (RGB) and 80% (MI) to 90% (RGB) and 96% (MI) with the confidence measure. CONCLUSION: Results showed that the confidence measure had a significant influence on the classification accuracy, and MI data are better suited for anatomical structure labeling than RGB data. SIGNIFICANCE: This paper significantly enhances the state of art in automatic labeling of endoscopic videos by introducing the use of the confidence metric, and by being the first study to use MI data for in vivo laparoscopic tissue classification. The data of our experiments will be released as the first in vivo MI dataset upon publication of this paper.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/tbme.2018.2813015

Cites

45 of 45 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 45 references

Research works printed but not linked: 1

  1. sheffield, 1985, Selecting band combinations from multispectral data, Photogrammetric Eng Remote Sens, 51, 681

Cited by

See all 56

Metadata

Authors
Moccia, S., Wirkert, S. J., Kenngott, H., Vemuri, A. S., Apitz, M., Mayer, B., De Momi, E., Mattos, L. S., & Maier-Hein, L.
Affiliations
  • Fondazione Politecnico di Milano (IT)
  • German Cancer Research Center (DE)
  • University Hospital Heidelberg (DE)
  • Italian Institute of Technology (IT)
Venue
IEEE Transactions on Biomedical Engineering
Published
2018-11
Volume
65
Issue
11
Pages
2649-2659
ISSN
  • 0018-9294 (ISSN-L)
  • 1558-2531
OpenAlex
W2679674811
Cited by
56
References
45
Citations by year
2026: 4 · 2025: 5 · 2024: 1 · 2023: 4 · 2022: 8 · 2021: 7 · 2020: 13 · 2019: 8 · 2018: 3
FWCI
3.84
Type
journal article
Language
en
Open access
Locations
  • IEEE Transactions on Biomedical Engineering (publishedVersion)
  • PubMed (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • Virtual Community of Pathological Anatomy (University of Castilla La Mancha) (submittedVersion, other-oa)
  • Università Politecnica delle Marche (Università Politecnica delle Marche) (submittedVersion)
  • CINECA IRIS Institutional Research Information System (Sant'Anna School of Advanced Studies) (submittedVersion, other-oa)
  • arXiv (Cornell University)
Funders
Horizon 2020 Framework Programme (ERC-2015-StG-37960)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
  • Health Sciences › Medicine › Surgery › Surgical Simulation and Training
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
Keywords
organ classification, laparoscopy, endoscopic video analysis, multispectral imaging, classification confidence, superpixel classification, image tagging, surgical data science, tissue classification
MeSH terms
Animals, Digestive System, Image Processing, Computer-Assisted, Laparoscopy, Spleen, Digestive System Surgical Procedures, Swine, Video Recording

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.