CoChat

DeepDRR – A Catalyst for Machine Learning in Fluoroscopy-Guided Procedures

Open access

The DOI matches its Crossref record; 15 of the 19 references it cites were found in a registry or an index; 2 of the 12 sources its claims cite were checked for support.

Overview

CoChat Summary

TL;DR

DeepDRR is a framework for fast, realistic simulation of fluoroscopy and digital radiography from CT by combining learned material decomposition and scatter estimation with analytic forward projection and noise injection. Models trained on DeepDRRs generalized to unseen clinically acquired X-ray images for pelvic anatomical landmark detection without re-training or domain adaptation, whereas models trained on conventional DRRs failed.

Key findings

  • Volumetric segmentation of air, soft tissue, and bone in CT achieved a misclassification rate of (2.03 ± 3.63)%.
  • Scatter estimation on a 30-image test set yielded a mean squared error of 6.4% of the total scatter image energy.
  • Simulating one 615 × 479-pixel X-ray projection took 2.0 s irrespective of the number of photons used.
  • In pelvic landmark detection with 23 anatomical landmarks, a model trained on DeepDRRs produced accurate predictions on unseen clinical cadaver X-ray data, including partial anatomy, while the same model trained on conventional DRRs failed; no re-training or domain adaptation was performed.

Methods

  • DeepDRR consists of four modules: deep ConvNet material decomposition in CT, material- and spectrum-aware ray-tracing forward projection, neural-network Rayleigh scatter estimation, and quantum/electronic readout noise injection.
  • Material decomposition used an encoder-decoder ConvNet with skip connections, trained on 128 × 128 × 128-voxel patches with voxel sizes of 0.86 × 0.86 × 1.0 mm, multi-class Dice loss, 12 manually annotated whole-body CT volumes split into 10 training and 2 validation/testing, and 600 epochs.
  • Scatter estimation used a ten-layer ConvNet trained on 330 Monte Carlo–generated images augmented by random rotations and reflections, with input downsampled to 128 × 128 pixels. Task-based evaluation used 23 pelvic landmarks, DRRs over a spherical segment covering 120° in RAO/LAO and 90° in CRAN/CAUD, 615 × 479-pixel images with 0.616² mm pixel size, a tungsten anode at 120 kV with 4.3 mm aluminum, and 5 × 10⁵ photons per pixel, tested on cadaver studies with a flat-panel C-arm system.

Limitations

  • The paper states future work will focus on improving volumetric segmentation by introducing more materials, in particular metal, and on scatter estimation that could benefit from a larger training set size.
  • Evident from the text: the task-based evaluation is a surrogate using cadaveric specimen data rather than live clinical patient data, and this paper reports qualitative landmark detection results while referring to [9] for comprehensive quantitative results.
  • Evident from the text: material decomposition is limited to air, soft tissue, and bone.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1007/978-3-030-00937-3_12

Cites

15 of 15 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

1 Valid · 2 Not valid · 9 Not checked · 9 Own results and interpretations

8 more claims

Create a free account to see all 21 claims and to verify the 10 references still open.

See all claims — free account
  • It may state two separate claims as one. 5
  • Probably not a substantial claim. 3

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Cited by

See all 145

Metadata

Authors
Unberath, M., Zaech, J.-N., Lee, S. C., Bier, B., Fotouhi, J., Armand, M., & Navab, N.
Affiliations
Johns Hopkins University (US)
Corresponding author
Unberath, Mathias
Venue
Lecture Notes in Computer Science
Published
2018
Pages
98-106
ISSN
  • 0302-9743 (ISSN-L)
  • 1611-3349
OpenAlex
W2789356647
Cited by
145
References
19
Citations by year
2026: 14 · 2025: 27 · 2024: 24 · 2023: 25 · 2022: 14 · 2021: 17 · 2020: 16 · 2019: 6 · 2018: 2
FWCI
22.47
Type
conference paper
Language
en
Open access
Licence
Locations
  • Lecture notes in computer science (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Engineering › Biomedical Engineering › Medical Imaging and Analysis
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiation Dose and Imaging
Keywords
material decomposition, scatter estimation, noise injection, synthetic training data, anatomical landmark detection, pelvis, interventional radiology, domain generalization, 2D-3D registration

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-09-29, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-09-29 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (qwen3.8-omni-flash).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.