Learning to detect anatomical landmarks of the pelvis in X-rays from arbitrary views
Open accessAbstract
Purpose Minimally invasive alternatives are now available for many complex surgeries. These approaches are enabled by the increasing availability of intra-operative image guidance. Yet, fluoroscopic X-rays suffer from projective transformation and thus cannot provide direct views onto anatomy. Surgeons could highly benefit from additional information, such as the anatomical landmark locations in the projections, to support intra-operative decision making. However, detecting landmarks is challenging since the viewing direction changes substantially between views leading to varying appearance of the same landmark. Therefore, and to the best of our knowledge, view-independent anatomical landmark detection has not been investigated yet.Methods In this work, we propose a novel approach to detect multiple anatomical landmarks in X-ray images from arbitrary viewing directions. To this end, a sequential prediction framework based on convolutional neural networks is employed to simultaneously regress all landmark locations. For training, synthetic X-rays are generated with a physically accurate forward model that allows direct application of the trained model to real X-ray images of the pelvis. View invariance is achieved via data augmentation by sampling viewing angles on a spherical segment of [Formula: see text].Results On synthetic data, a mean prediction error of 5.6 ± 4.5 mm is achieved. Further, we demonstrate that the trained model can be directly applied to real X-rays and show that these detections define correspondences to a respective CT volume, which allows for analytic estimation of the 11 degree of freedom projective mapping.Conclusion We present the first tool to detect anatomical landmarks in X-ray images independent of their viewing direction. Access to this information during surgery may benefit decision making and constitutes a first step toward global initialization of 2D/3D registration without the need of calibration. As such, the proposed concept has a strong prospect to facilitate and enhance applications and methods in the realm of image-guided surgery.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
2 of 7 cited sources checked · 1 supported · 0 flagged · accuracy not yet measured
- Premisecitation
The angular range used for training approximates the range of variation in X-ray images during surgical procedures on the pelvis.
“This range approximates the range of variation in X-ray images during surgical procedures on the pelvis [13].”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [13] Khurana B, Sheehan SE, Sodickson AD, Weaver MJ (2014) Pelvic ring fractures: what the orthopedic surgeon wants to know. Radiographics 34(5):1317–1333 source
Two searches of Khurana et al.’s “Pelvic Ring Fractures: What the Orthopedic Surgeon Wants to Know” returned no full-text snippets, so the cited paper could not be checked directly. An unscoped search found nearly identical wording in “X-ray-transform Invariant Anatomical Landmark Detection for Pelvic Trauma Surgery” (score 0.457), where the sentence itself cites reference [14]. That match may be a secondary citation; it does not establish that Khurana et al. is the wrong source. (LLM, conf=0.65)
Experimental — accuracy not yet measured
- Findingown data
On synthetic data, the mean prediction error across all projections and landmarks was 5.6 ± 4.5 mm (9.1 ± 7.4 pixels).
“On synthetic data, a mean prediction error of 5.6 ± 4.5mm is achieved.”
- Also stated in: § Synthetic data · plain
“Quantitatively, the average distance between ground truth positions and detection across all projections and landmarks is 9.1 ± 7.4pixels (5.6 ± 4.5 mm).”
Quote in the paperSubstantial claim- The authors state this as an assumption: Anatomical landmarks exhibit strong constraints and characteristic patterns even when viewing angles are arbitrary.
- Rests on an assumption: The manually labeled 3D landmark positions in the CT volumes are accurate enough to serve as ground truth for evaluating detection.
- Also stated in: § Synthetic data · plain
- Findingown data
In real X-ray images, the automatic landmark detections agreed well with ground truth across various poses and truncations.
“Overall, the well agreement between the automatic detections and the ground truth positions can be appreciated for various poses and truncations.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Anatomical landmarks exhibit strong constraints and characteristic patterns even when viewing angles are arbitrary.
- Rests on an assumption: The manually labeled 3D landmark positions in the CT volumes are accurate enough to serve as ground truth for evaluating detection.
- Findingreasoning
The trained model can be applied directly to real X-ray images without retraining.
“Further, we demonstrate that the trained model can be directly applied to real X-rays”
- Also stated in: § Data generation · plain
“This allows direct application of the network model to real clinical X-ray images.”
- Also stated in: § Experiments and results · plain
“Note, that the network has not been re-trained for this purpose.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Anatomical landmarks exhibit strong constraints and characteristic patterns even when viewing angles are arbitrary.
- Also stated in: § Data generation · plain
- Findingown data
The landmark detections on real X-rays define correspondences to a CT volume and allow analytic estimation of the 11 degree-of-freedom projective mapping.
“show that these detections define correspondences to a respective CT volume, which allows for analytic estimation of the 11 degree of freedom projective mapping.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Anatomical landmarks exhibit strong constraints and characteristic patterns even when viewing angles are arbitrary.
- Rests on an assumption: The manually labeled 3D landmark positions in the CT volumes are accurate enough to serve as ground truth for evaluating detection.
- Findingown data
There is a correlation between average maximum belief response and average error: higher belief map response corresponds to lower detection error.
“Second, there exists a correlation between the average maximum belief response and the average error: The higher the response in a belief map, the lower the error.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: Anatomical landmarks exhibit strong constraints and characteristic patterns even when viewing angles are arbitrary.
- Findingown data
Detection results are refined with increasing stages of the network.
“It can be well observed that the detection results are refined with increasing stages.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: Anatomical landmarks exhibit strong constraints and characteristic patterns even when viewing angles are arbitrary.
- Findingreasoning
When tools are present in the image, the landmark detection approach fails to detect surrounding landmarks.
“In complicated situations when tools are present in the image, the landmark detection approach fails to detect the surrounding landmarks, as can be seen in example 4.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: Anatomical landmarks exhibit strong constraints and characteristic patterns even when viewing angles are arbitrary.
- Findingown data
The landmark detections can initialize 2D/3D registration without additional calibration.
“As a possible application, we showed that an initialization of 2D/3D registration based on the automatic detections is successful without the need for additional calibration.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Anatomical landmarks exhibit strong constraints and characteristic patterns even when viewing angles are arbitrary.
- Rests on an assumption: The manually labeled 3D landmark positions in the CT volumes are accurate enough to serve as ground truth for evaluating detection.
- Findingnone given
Small unknown objects such as metallic beads on the bone have only limited influence on detection performance.
“Small unknown objects, such as the metallic beads on the bone, seem to only have a limited influence on performance.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: Anatomical landmarks exhibit strong constraints and characteristic patterns even when viewing angles are arbitrary.
- Findingown data
A pelvic fracture present in an X-ray image did not substantially influence detection qualitatively.
“Furthermore, example 5 depicts an image of the sequence where a fracture is present in the X-ray image, indicated with the white arrow. Qualitatively, this did not influence the detection substantially.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: Anatomical landmarks exhibit strong constraints and characteristic patterns even when viewing angles are arbitrary.
- Findingreasoning
The accuracy from views at the border of the spherical segment is slightly inferior to frontal views.
“Also, the accuracy from views of the border of the spherical segment is slightly inferior compared to frontal views.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: Anatomical landmarks exhibit strong constraints and characteristic patterns even when viewing angles are arbitrary.
- Premisereasoning
Detecting anatomical landmarks in X-ray images is difficult because the viewing direction changes substantially between views, causing the same landmark to appear differently.
“However, detecting landmarks is challenging since the viewing direction changes substantially between views leading to varying appearance of the same landmark.”
- Also stated in: § Introduction · plain
“The view independence substantially complicates the landmark detection problem in X-ray images since object edges vanish and anatomical structures overlap due to the effect of transmission imaging.”
Quote in the paperSubstantial claim - Also stated in: § Introduction · plain
- Premisereasoning
In transmission imaging, image and landmark appearance can change fundamentally with viewing direction because the whole 3D object contributes to the detector measurement.
“Unfortunately, the above concept defined for reflection imaging does not translate directly to transmission imaging. For the latter, image and landmark appearance can change fundamentally depending on the viewing direction since the whole 3D object contributes to the resulting detector measurement.”
Quote in the paperSubstantial claim - Premisereasoning
Accurate and consistent manual labeling of landmarks in 2D projection images cannot be guaranteed because of vanishing edges and superimposed anatomy.
“However, and more importantly, an accurate and consistent labeling cannot be guaranteed in the 2D projection images due to the discussed properties of transmission imaging (vanishing edges, superimposed anatomy).”
Quote in the paperSubstantial claim - Interpretationcitation
The detected 2D landmarks and corresponding 3D points from a pre-operative CT allow computation of the projection matrix in closed form.
“Since the landmark detections supply semantic information, correspondences between the 2D and 3D points are defined, which enables the computation of the projection matrix P∈ℝ3×4 in closed form across the two domains [9].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [9] Hartley RI, Zisserman A (2004) Multiple view geometry in computer vision. Cambridge University Press, Cambridge. ISBN 0521540518
Not checked in the free run.
- The authors state this as an assumption: Anatomical landmarks exhibit strong constraints and characteristic patterns even when viewing angles are arbitrary.
- Rests on an assumption: The manually labeled 3D landmark positions in the CT volumes are accurate enough to serve as ground truth for evaluating detection.
- Premisecitation
Providing additional implicit 3D information during interventions can drastically ease the mental mapping from 2D X-ray images to 3D patient anatomy.
“Providing additional, “implicit 3D” information during these interventions can drastically ease the mental mapping, where the surgeon has to register the tool in his hand to the 3D patient anatomy using 2D X-ray images only [8,22].”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [8] Härtl R, Lam KS, Wang J, Korge A, Audigé FKL (2013) Worldwide survey on the use of navigation in spine surgery. World Neurosurg 379(1):162–172 source
Not checked in the free run.
- cites [22] Starr R, Jones A, Reinert C, Borer D (2001) Preliminary results and complications following limited open reduction and percutaneous screw fixation of displaced fractures of the acetabulum. Injury 32:SA45–SA50 source
Not checked in the free run.
- Interpretationnone given
The paper presents the first tool to detect anatomical landmarks in X-ray images independent of viewing direction.
“We present the first tool to detect anatomical landmarks in X-ray images independent of their viewing direction.”
- Also stated in: § Discussion and conclusion · plain
“We presented a novel approach to detect anatomical landmarks in X-ray images independent of the viewing direction.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: Anatomical landmarks exhibit strong constraints and characteristic patterns even when viewing angles are arbitrary.
- Also stated in: § Discussion and conclusion · plain
- Study design and conductreasoning
Data augmentation by sampling viewing angles on a spherical segment of 120° × 90° is crucial for achieving view invariance.
“View invariance is achieved via data augmentation by sampling viewing angles on a spherical segment of 120° × 90°.”
- Also stated in: § Data generation · boosted
“the augmentation of training data in order to obtain view invariance is crucial. To this end, we applied random translation to the CT volume, varied the source-to-isocenter distance, applied flipping on the detector, and most importantly, varied the angular range of the X-ray source position on a spherical segment of 120° in LAO/RAO and in 90° in CRAN/CAUD, centered around an AP view of the pelvis”
Quote in the paperSubstantial claim- The authors state this as an assumption: Anatomical landmarks exhibit strong constraints and characteristic patterns even when viewing angles are arbitrary.
- Also stated in: § Data generation · boosted
- Interpretationreasoning
The network's belief maps are downsampled by a factor of about eight, which inherently limits detection accuracy.
“Further, the network architecture in its current state yields belief maps that are downsampled by a factor of around eight compared to the input image. This downsampling inherently limits the accuracy of the detection results.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Anatomical landmarks exhibit strong constraints and characteristic patterns even when viewing angles are arbitrary.
- Interpretationreasoning
The sequential prediction framework enables learning long-range contextual dependencies of landmark configurations.
“This enables the model to learn long-range contextual dependencies of landmark configurations.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Anatomical landmarks exhibit strong constraints and characteristic patterns even when viewing angles are arbitrary.
- Interpretationreasoning
The accuracy of detections in clinical X-rays may benefit initialization of 2D/3D registration.
“Further, we argue that the accuracy of our detections in clinical X-rays may benefit the initialization of 2D/3D registration.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Anatomical landmarks exhibit strong constraints and characteristic patterns even when viewing angles are arbitrary.
- Interpretationreasoning
The first-stage belief maps are predicted only on local image information, leading to false positive responses due to ambiguities in local appearance.
“The belief maps of the first stage b1p are predicted only on local image information, which leads to false positive responses due to ambiguities in the local image appearance.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Anatomical landmarks exhibit strong constraints and characteristic patterns even when viewing angles are arbitrary.
- Interpretationreasoning
The network's stage-wise application resolves false positive responses by implicitly incorporating characteristic landmark configurations.
“The stage-wise application resolves these by implicitly incorporating the characteristic configuration of the landmark positions.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Anatomical landmarks exhibit strong constraints and characteristic patterns even when viewing angles are arbitrary.
- May combine two claims. 15
- Classified as probably not a substantial claim. 9
May combine two claims.
Study design and conductcitationA physically accurate forward projector was used to generate realistic synthetic training data, allowing direct application of the network to real clinical X-ray images.
“A realistic forward projector that accounts for physically accurate image formation, while being capable of fast data generation, was used to obtain realistic synthetic training data. This allows direct application of the network model to real clinical X-ray images.”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [26] Unberath M, Zaech JN, Lee SC, Bier B, Fotouhi J, Armand M, Navab N (2018) Deepdrr–a catalyst for machine learning in fluoroscopy-guided procedures. In: International conference on medical image computing and computer-assisted intervention. Springer, New York sourceExperimental — accuracy not yet measured
- The authors state this as an assumption: Anatomical landmarks exhibit strong constraints and characteristic patterns even when viewing angles are arbitrary.
May combine two claims.
Findingown dataSome landmarks have lower average error (e.g., landmark #9, 5.26 pixels) while others are detected poorly (e.g., landmark #23, 26.05 pixels).
“First, some landmarks have an overall lower error (e.g., land mark #9 with an average error of 5.26pixels), while others are detected poorly (e.g., landmark #23 with an average error of 26.05pixels).”
Quote in the paperNot a substantial claim- The authors state this as an assumption: Anatomical landmarks exhibit strong constraints and characteristic patterns even when viewing angles are arbitrary.
- Rests on an assumption: The manually labeled 3D landmark positions in the CT volumes are accurate enough to serve as ground truth for evaluating detection.
May combine two claims.
Findingown dataSome landmarks can be detected equally well independent of viewing direction (e.g., landmark #11), while for others detectability varies across quadrants (e.g., landmark #19).
“Third, some landmarks can be detected equally well, independently of the viewing direction (e.g., landmark #11), while for others, the detectability highly varies across the quadrants (e.g., landmark #19).”
Quote in the paperNot a substantial claim- The authors state this as an assumption: Anatomical landmarks exhibit strong constraints and characteristic patterns even when viewing angles are arbitrary.
- Rests on an assumption: The manually labeled 3D landmark positions in the CT volumes are accurate enough to serve as ground truth for evaluating detection.
May combine two claims.
Findingown dataThe reprojection error of the BB-based projection matrices was 2-5 pixels, which the authors consider appropriate as a reference for evaluating landmark detection.
“The low reprojection error of 2–5pixel is in line with our expectations and suggests that the resulting projection matrices are an appropriate reference when evaluating the performance of our proposed view-invariant landmark detection.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S1 (asserted), S2 (checkable), S3 (load-bearing).
Findingnone givenThe robustness toward unseen scenarios such as tools in the image or changes due to fractured anatomy must be improved.
“First of all, the robustness toward unseen scenarios such as tools in the image or changes of the anatomy due to fractured anatomy must be improved.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: Anatomical landmarks exhibit strong constraints and characteristic patterns even when viewing angles are arbitrary.
May combine two claims.
Findingown dataThe network was trained on synthetic data generated with a physics-based framework and evaluated on synthetic and real test sets, showing promising performance.
“The network was trained on synthetic data generated using a physics-based framework and evaluated on both synthetic and real test sets, revealing promising performance.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Anatomical landmarks exhibit strong constraints and characteristic patterns even when viewing angles are arbitrary.
Probably not a substantial claim: may not pass S4 (based).
Premisenone givenBefore this work, view-independent anatomical landmark detection in X-ray images had not been investigated.
“Therefore, and to the best of our knowledge, view-independent anatomical landmark detection has not been investigated yet.”
- Also stated in: § Introduction · hedged
“To the best of our knowledge, there exists no approach that is able to detect anatomical landmarks in X-ray images independent of the viewing direction.”
- Also stated in: § Discussion and conclusion · hedged
“Due to the characteristics of transmission imaging, landmark appearances change substantially with the viewing direction making anatomical landmark detection a challenging task that has, to the best of our knowledge, not previously been addressed.”
Quote in the paperNot a substantial claim- Also stated in: § Introduction · hedged
May combine two claims.
InterpretationreasoningAccess to landmark information during surgery may benefit decision making and is a first step toward global initialization of 2D/3D registration without calibration.
“Access to this information during surgery may benefit decision making and constitutes a first step toward global initialization of 2D/3D registration without the need of calibration.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: Anatomical landmarks exhibit strong constraints and characteristic patterns even when viewing angles are arbitrary.
Classified as probably not a substantial claim.
Study design and conductown dataThe 20,000 generated X-rays were split into training, validation, and testing such that images of one patient were not shared among sets.
“In total, 20,000 X-rays were generated and split 18 × 1 × 1-fold into training, validation, and testing, where we ensured that images of one patient are not shared among these sets.”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationManual labeling of landmarks is time-consuming, interrupts clinical workflow, and is subjective, yielding rater-dependent results.
“Manual labeling is time-consuming, interrupts the clinical workflow, and is subjective, which yields rater dependent results.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [28] Wang CW, Huang CT, Hsieh MC, Li CH, Chang SW, Li WC, Vandaele R, Marée R, Jodogne S, Geurts P, Chen C, Zhen G, Chu C, Mirzaalian H, Vrtovec T, Ibragimov B (2015) Evaluation and comparison of anatomical landmark detection methods for cephalometric x-ray images: a grand challenge. IEEE Trans Med Imaging 34(9):1890–1900 source
Not checked in the free run.
May combine two claims.
Interpretationnone givenThe proposed method is purely image-based and detects multiple anatomical landmarks independent of viewing direction.
“In this work, we propose an automatic, purely image-based method to detect multiple anatomical landmarks in X-ray images independent of the viewing direction.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Anatomical landmarks exhibit strong constraints and characteristic patterns even when viewing angles are arbitrary.
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.
Interpretationnone givenThe closed-form solution for image pose estimation is simple but a maximum likelihood approach would likely yield superior results with statistical outliers.
“In this work, we relied on a closed form solution to estimate the image pose which is compelling due to its simplicity, yet a more sophisticated approach based on maximum likelihood would certainly yield superior results in the presence of statistical outliers.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataConsidering the maximum belief is powerful for selecting reliably detected landmarks and can serve as a confidence measure.
“In this task, we also showed that considering the maximum belief is powerful for selecting reliably detected landmarks. This additional information can be used as a confidence measure for further processing tasks.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Anatomical landmarks exhibit strong constraints and characteristic patterns even when viewing angles are arbitrary.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe proposed concept has been transferred to projection images of knees to estimate involuntary motion during scans.
“Recently, the proposed concept of view-invariant anatomical landmark detection has been transferred to projection images of knees in an attempt to estimate involuntary motion during scans [3].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [3] Bier B, Aschoff K, Syben C, Unberath M, Levenston M, Gold G, Fahrig R, Maier A (2018) Detecting anatomical landmarks for motion estimation in weight-bearing imaging of knees. In: International workshop on machine learning for medical image reconstruction. Springer, New York, pp 83–90 source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenManual labeling of landmarks in the 3D volume is a possible source of error because it is inherently prone to errors.
“A possible source of error might be introduced by the labeling of the landmarks in the 3D volume that, since manual, is inherently prone to errors.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationnone givenThe network has a very large receptive field that increases over stages, enabling learning of spatial dependencies over long distances.
“Furthermore, the network has a very large receptive field that also increases over stages, which enables the learning of spatial dependencies over long distances.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Anatomical landmarks exhibit strong constraints and characteristic patterns even when viewing angles are arbitrary.
May combine two claims.
InterpretationreasoningThe method can identify corresponding landmarks between arbitrary views of the same anatomy and estimate pose relative to a pre-procedurally acquired volume without calibration.
“Based on landmark knowledge, we can (a) identify corresponding landmarks between arbitrary views of the same anatomy and (b) estimate pose relative to a pre-procedurally acquired volume without the need for any calibration.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Anatomical landmarks exhibit strong constraints and characteristic patterns even when viewing angles are arbitrary.
- Rests on an assumption: The manually labeled 3D landmark positions in the CT volumes are accurate enough to serve as ground truth for evaluating detection.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
InterpretationreasoningThe lower accuracy at border views may be explained by more overlapping anatomy and less variation in training data sampled in that area.
“This might be explained by the higher amount of overlapping anatomy from these directions as well as a lower amount of variation of the training data sampled in this area.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: Anatomical landmarks exhibit strong constraints and characteristic patterns even when viewing angles are arbitrary.
Classified as probably not a substantial claim. May combine two claims.
Interpretationnone givenComputing the loss over all intermediate predictions counteracts vanishing gradients and guides the network to focus early on detection.
“Lastly, the loss over all intermediate predictions btp is computed, which counteracts the vanishing gradient effect and simultaneously guides the network to focus early on the detection task.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Anatomical landmarks exhibit strong constraints and characteristic patterns even when viewing angles are arbitrary.
Probably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningThe proposed concept has strong prospect to facilitate and enhance applications and methods in image-guided surgery.
“As such, the proposed concept has a strong prospect to facilitate and enhance applications and methods in the realm of image-guided surgery.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: Anatomical landmarks exhibit strong constraints and characteristic patterns even when viewing angles are arbitrary.
May combine two claims.
Interpretationown dataThe landmark detection accuracy was sufficient to generate DRRs very similar to target X-ray images, suggesting successful initialization of 2D/3D registration.
“For these various poses, the landmark detection accuracy proves sufficient to achieve views that are very similar to the target X-ray image, suggesting successful initialization.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Anatomical landmarks exhibit strong constraints and characteristic patterns even when viewing angles are arbitrary.
- Rests on an assumption: The manually labeled 3D landmark positions in the CT volumes are accurate enough to serve as ground truth for evaluating detection.
The authors state this as an assumption.
Anatomical landmarks exhibit strong constraints and characteristic patterns even when viewing angles are arbitrary.
“Our assumption is that anatomical landmarks exhibit strong constraints and thus characteristic patterns even in the presence of arbitrary viewing angles.”
The paper relies on this without support.
The manually labeled 3D landmark positions in the CT volumes are accurate enough to serve as ground truth for evaluating detection.
“In total, 23 landmark positions were manually labeled in 20 CTs of male and female patients using 3D volume renderings in 3D Slicer [5].”
“A possible source of error might be introduced by the labeling of the landmarks in the 3D volume that, since manual, is inherently prone to errors.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Unlike [16,19,20], the authors train networks on smaller datasets of actual fluoroscopy and achieve state-of-the-art results on clinically relevant data.
“Contrary to [16,19,20], we train our networks using smaller datasets of actual fluoroscopy and achieve state-of-the-art results on clinically relevant data.”
From Automatic Annotation of Hip Anatomy in Fluoroscopy for Robust and Efficient 2D/3D Registration (2020) · cites this paper as [19]
Bier et al. (2019) say they trained on synthetic X-rays and then applied the model to real X-rays, contrary to the claim that they trained on actual fluoroscopy. The quoted sentence appears instead in “Automatic Annotation of Hip Anatomy in Fluoroscopy for Robust and Efficient 2D/3D Registration” (unscoped score 0.52). That paper explicitly contrasts its approach with Bier’s, which it cites as [19]; it does not attribute its own training method to Bier. (LLM, conf=0.58)
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredBier trained CNNs to annotate pelvic anatomical landmarks using simulated fluoroscopy; on five sequences of actual fluoroscopy from two cadaveric specimens, mean annotation errors of 12-24 mm in the detector plane were reported.
“Using a large collection of simulated fluoroscopy, Bier trained CNNs to annotate anatomical landmarks of the pelvis [19]. When evaluated on five sequences of actual fluoroscopy across two cadaveric specimens, mean annotation errors of 12-24 mm in the detector plane were reported.”
From Automatic Annotation of Hip Anatomy in Fluoroscopy for Robust and Efficient 2D/3D Registration (2020) · cites this paper as [19]
Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
Experimental — accuracy not yet measuredPelvis poses estimated from Bier's annotations produced reprojection errors of 14-34 mm for other landmarks not learned by the network.
“Pelvis poses were estimated using these annotations, yielding reprojection errors of 14-34 mm for other landmarks not learned by the network.”
From Automatic Annotation of Hip Anatomy in Fluoroscopy for Robust and Efficient 2D/3D Registration (2020) · cites this paper as [19]
The Materials and methods section (‘2D/3D registration’; page unavailable) says detected pelvis landmarks were matched to CT labels to estimate a projection matrix, supporting the pose-estimation part. The Clinical data results (page unavailable) do not report 14–34 mm reprojection errors for landmarks the network did not learn; their stated 2–5 pixel error concerns a different, metal-bead-based reference projection. (LLM, conf=0.87)
Experimental — accuracy not yet measuredFeature-based 2D/3D registration methods need to define meaningful landmark features manually and do not learn registration in an end-to-end fashion.
“However, these methods need to define meaningful landmark features manually and do not learn registration in an end-to-end fashion.”
From A Fully Differentiable Framework for 2D/3D Registration and the Projective Spatial Transformers (2024) · cites this paper as [16]
In Materials and methods (Data generation), the authors say they manually selected clinically meaningful landmarks. In Materials and methods (2D/3D registration), they describe learned 2D landmark detection followed by a separate closed-form registration calculation, rather than end-to-end learning of registration. This supports the claim for the paper’s method, but not its implication that feature-based methods generally require manually defined landmarks. (LLM, conf=0.85)
Experimental — accuracy not yet measuredThere are popular feature-based 2D/3D registration methods, such as solving a PnP problem using corresponding anatomical landmarks, which may be complementary to intensity-based registration methods.
“We are aware that there are popular feature-based 2D/3D registration methods, such as solving a PnP problem using corresponding anatomical landmarks [13], [16], [17], which may be complementary to the intensity-based registration methods.”
From A Fully Differentiable Framework for 2D/3D Registration and the Projective Spatial Transformers (2024) · cites this paper as [16]
The Materials and methods section (2D/3D registration; page unavailable) describes using corresponding 2D X-ray and 3D CT landmarks to initialize registration by estimating a projection matrix. It specifies a direct linear transform, not a PnP solver, and does not explicitly discuss complementarity with intensity-based registration. The Discussion and conclusion likewise describes landmark-based initialization, supporting that part of the claim. (LLM, conf=0.85)
Experimental — accuracy not yet measured
Evaluation on synthetic data may include data sampled from a broad range of viewpoints or deformations that are approximately uniformly distributed, whereas real data is not uniformly sampled but clustered around certain viewpoints.
“For example, evaluation on synthetic data may include data sampled from a broad range of viewpoints or deformations that are approximately uniformly distributed. Real data, on the other hand, is not uniformly sampled from such a distribution, but rather, will be clustered around certain viewpoints (see (Grupp et al., 2020c) for a visualization of viewpoints used during a cadaveric surgery vs the”
From The Impact of Machine Learning on 2D/3D Registration for Image-Guided Interventions: A Systematic Review and Perspective (2021) · cites this paper as Bier et al., 2019
The Data generation section describes synthetic X-rays generated across a broad range of viewing angles, and the Synthetic data results evaluate detection across viewing directions. It does not say those angles were sampled approximately uniformly or that real surgical images cluster around particular viewpoints; it also does not address deformations. Page numbers are unavailable in our copy. (LLM, conf=0.83)
Experimental — accuracy not yet measuredAmong seven studies that trained deep CNNs on synthetic data and evaluated comparably on synthetic and real data, substantial performance drops were found.
“Indeed, among the seven studies that trained deep CNNs on synthetic data and evaluated in a way that allowed for comparisons between synthetic and real data performance, we found quite substantial performance drops (Miao et al., 2018; Bier et al., 2019; Gao et al., 2020c; Doerr et al., 2020; Gu et al., 2020; Guan et al., 2020; Li et al., 2020).”
From The Impact of Machine Learning on 2D/3D Registration for Image-Guided Interventions: A Systematic Review and Perspective (2021) · cites this paper as Bier et al., 2019
The Experiments and results section says the CNN was trained on synthetic data and evaluated quantitatively on both synthetic and real X-rays. The Synthetic data subsection reports a mean landmark error, and the Clinical data subsection says real-image errors are presented in Table 2, but the passages in our copy do not give those values or establish a substantial overall performance drop. The cited paper also cannot substantiate the citing authors’ count of seven studies. (LLM, conf=0.82)
Experimental — accuracy not yet measuredThe error metrics used in the reviewed studies included standard registration pose error, keypoint distances, mean target registration error (mTRE) in 3D, and varied 2D metrics such as reprojection distances, DICE score, and contour differences.
“The error metrics that were used included the standard registration pose error (commonly separated into translational and rotational DoFs), keypoint distances (Chou and Pizer, 2014; Zhang et al., 2020), and the mean target registration error (mTRE) in 3D, and varied other metrics in 2D, such as reprojection distances (Bier et al., 2019), segmentation or overlap DICE score (Zhang et al., 2020), or”
From The Impact of Machine Learning on 2D/3D Registration for Image-Guided Interventions: A Systematic Review and Perspective (2021) · cites this paper as Bier et al., 2019
Cites
Lecture Notes in Computer Science 1205
(1999) · Industrial Robot the international journal of robotics research and application · doi:10.1108/ir.1999.04926fae.001 · Cited by 39,228 · see citing works
Multiple View Geometry in Computer Vision
Hartley, R., & Zisserman, A. (2004) · doi:10.1017/cbo9780511811685 · Cited by 21,070 · see citing works
A survey on deep learning in medical image analysis
Litjens, G., Kooi, T., Bejnordi, B. E., Setio, A. A. A., Ciompi, F., Ghafoorian, M., van der Laak, J. A. W. M., van Ginneken, B., & Sánchez, C. I. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.07.005 · Cited by 15,332 · see citing works
3D Slicer as an image computing platform for the Quantitative Imaging Network
Fedorov, A., Beichel, R., Kalpathy–Cramer, J., Finet, J., Fillion‐Robin, J., Pujol, S., Bauer, C., Jennings, D. L., Fennessy, F., Milan Sonka, A., et al. (2012) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2012.05.001 · Cited by 9,095 · see citing works
Wei, S.-E., Ramakrishna, V., Kanade, T., & Sheikh, Y. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.511 · Cited by 2,966 · cited 3× · see citing works
“The sequential prediction framework used in this work has been initially developed for human pose estimation [29].”
Statistical shape models for 3D medical image segmentation: A review
Heimann, T., & Meinzer, H.-P. (2009) · Medical Image Analysis · doi:10.1016/j.media.2009.05.004 · Cited by 1,424 · see citing works
A Review of 3d/2d Registration Methods for Image-Guided Interventions
Markelj, P., Tomaževič, D., Likar, B., & Pernuš, F. (2012) · Medical Image Analysis · doi:10.1016/j.media.2010.03.005 · Cited by 746 · see citing works
Zheng, Y., Barbu, A., Georgescu, B., Scheuering, M., & Comaniciu, D. (2008) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2008.2004421 · Cited by 546 · see citing works
Consistent landmark and intensity-based image registration
Johnson, H. J., & Christensen, G. E. (2002) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2002.1009381 · Cited by 400 · see citing works
Multi-Scale Deep Reinforcement Learning for Real-Time 3D-Landmark Detection in CT Scans
Ghesu, F.-C., Georgescu, B., Zheng, Y., Grbic, S., Maier, A., Hornegger, J., & Comaniciu, D. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2782687 · Cited by 310 · see citing works
Self-citationWorldwide Survey on the Use of Navigation in Spine Surgery
Härtl, R., Lam, K. S., Wang, J., Korge, A., Kandziora, F., & Audigé, L. (2013) · World Neurosurgery · doi:10.1016/j.wneu.2012.03.011 · Cited by 270 · cited 2× · see citing works
“Providing additional, “implicit 3D” information during these interventions can drastically ease the mental mapping, where the surgeon has to register the tool in his hand to the 3D patient anatomy using 2D X-ray images only [8,22].”
Regressing Heatmaps for Multiple Landmark Localization Using CNNs
Payer, C., Štern, D., Bischof, H., & Urschler, M. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46723-8_27 · Cited by 248 · see citing works
Wang, C.-W., Huang, C.-T., Hsieh, M.-C., Li, C.-H., Chang, S.-W., Li, W.-C., Vandaele, R., Maree, R., Jodogne, S., Geurts, P., et al. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2412951 · Cited by 235 · see citing works
Starr, A. J., Jones, A. L., Reinert, C. M., & Borer, D. S. (2001) · Injury · doi:10.1016/s0020-1383(01)00060-2 · Cited by 172 · see citing works
An Artificial Agent for Anatomical Landmark Detection in Medical Images
Ghesu, F. C., Georgescu, B., Mansi, T., Neumann, D., Joachim Hornegger, A., & Comaniciu, D. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46726-9_27 · Cited by 160 · cited 1× · see citing works
“Landmark detection methods have been developed for various imaging modalities and for 2D or 3D image data [6,7].”
DeepDRR – A Catalyst for Machine Learning in Fluoroscopy-Guided Procedures
Unberath, M., Zaech, J.-N., Lee, S. C., Bier, B., Fotouhi, J., Armand, M., & Navab, N. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00937-3_12 · Cited by 145 · cited 5× · see citing works
“Payer et al. [18] evaluated different CNN architectures to detect multiple landmark locations in X-ray images of hand X-rays by regressing a single heat map for each landmark.”
InfluentialSelf-citationX-ray-transform Invariant Anatomical Landmark Detection for Pelvic Trauma Surgery
Bier, B., Unberath, M., Zaech, J.-N., Fotouhi, J., Armand, M., Osgood, G. M., Navab, N., & Maier, A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00937-3_7 · Cited by 98 · cited 1× · see citing works
“This paper is an extended version of the work presented at the MICCAI 2018 conference [4] and provides a broader background on existing landmark detection research, a comprehensive quantitative analysis of the view invariance on synthetic data, and a quantitative evaluation on real X-ray images of cadaveric specimens.”
Self-citationIntervertebral disc detection in X-ray images using faster R-CNN
Sa, R., Owens, W., Wiegand, R., Studin, M., Capoferri, D., Barooha, K., Greaux, A., Rattray, R., Hutton, A., Cintineo, J., et al. (2017) · 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2017.8036887 · Cited by 90 · cited 1× · see citing works
“detected intervertebral discs in X-ray images of the spine to predict a bounding box of the respective vertebrae, by using a pretrained Faster-RNN and refining its weights [21].”
Urschler, M., Ebner, T., & Štern, D. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.09.003 · Cited by 86 · see citing works
Pelvic Ring Fractures: What the Orthopedic Surgeon Wants to Know
Khurana, B., Sheehan, S. E., Sodickson, A. D., & Weaver, M. J. (2014) · RadioGraphics · doi:10.1148/rg.345135113 · Cited by 86 · see citing works
Image guidance in pelvic and acetabular surgery—Expectations, success and limitations
Stöckle, U., Schaser, K. D., & König, B. (2007) · Injury · doi:10.1016/j.injury.2007.01.024 · Cited by 80 · see citing works
Epipolar Consistency in Transmission Imaging
Aichert, A., Berger, M., Wang, J., Maaß, N., Doerfler, A., Joachim Hornegger, A., & Maier, A. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2426417 · Cited by 69 · see citing works
Self-citationPredicting Slice-to-Volume Transformation in Presence of Arbitrary Subject Motion
Hou, B., Alansary, A., McDonagh, S., Davidson, A., Rutherford, M., Hajnal, J. V., Rueckert, D., Glocker, B., & Kainz, B. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66185-8_34 · Cited by 68 · cited 1× · see citing works
“The primary reasons are disruptions to the surgical workflow [8], as well as susceptibility to both truncation and initialization due to the low capture range of the optimization target [11].”
Search strategies for multiple landmark detection by submodular maximization
Liu, D., Zhou, K. S., Bernhardt, D., & Comaniciu, D. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5540016 · Cited by 55 · cited 1× · see citing works
“Alternatively, priors can be incorporated implicitly, if multiple landmarks are detected simultaneously by reducing the search space to possible configurations [15].”
From Local to Global Random Regression Forests: Exploring Anatomical Landmark Localization
Štern, D., Ebner, T., & Urschler, M. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46723-8_26 · Cited by 47 · see citing works
Baumgartner, R. E., Libuit, K., Ren, D., et al. (2015) · Journal of Orthopaedic Trauma · doi:10.1097/bot.0000000000000442 · Cited by 38 · see citing works
Pouch, A. M., Yushkevich, P. A., Jackson, B. M., et al. (2012) · Medical Physics · doi:10.1118/1.3673773 · Cited by 33 · cited 1× · see citing works
“A non-exhaustive review reveals that anatomical landmarks have been used to guide and model segmentation tasks [10,31], to perform image registration [12], to extract relevant clinical quantitative measurements [19], to plan therapies [14], or to initialize further image processing [16].”
Tucker, E. W., Fotouhi, J., Lee, S. C., Unberath, M., Fuerst, B., Johnson, A., Armand, M., Osgood, G. M., & Navab, N. (2018) · Medical Imaging 2018: Imaging Informatics for Healthcare, Research, and Applications · doi:10.1117/12.2293675 · Cited by 19 · cited 1× · see citing works
“These solutions rely on external markers to track the tools or the patient in 3D [17], consistency conditions to estimate relative pose between Xray images [1], or 2D/3D registration of pre-operative CT to intra-operative X-ray to render multiple views simultaneously [17,25].”
Self-citationDetecting Anatomical Landmarks for Motion Estimation in Weight-Bearing Imaging of Knees
Bier, B., Aschoff, K., Syben, C., Unberath, M., Levenston, M., Gold, G., Fahrig, R., & Maier, A. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00129-2_10 · Cited by 16 · cited 1× · see citing works
“Recently, the proposed concept of view-invariant anatomical landmark detection has been transferred to projection images of knees in an attempt to estimate involuntary motion during scans [3].”
Self-citationA new 2.5 D representation for lymph node detection in CT (CT Lymph Nodes)
Roth, H., Lu, L., Seff, A., et al. (2015) · The Cancer Imaging Archive · doi:10.7937/k9/tcia.2015.aqiidcnm · Cited by 16 · see citing works
Mader, A. O., von Berg, J., Fabritz, A., et al. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00934-2_63 · Cited by 8 · cited 2× · see citing works
“[16] used a U-net to localize ribs in chest radiographs.”
Xie, W., Franke, J., Chen, C., et al. (2014) · International Journal of Medical Robotics and Computer Assisted Surgery · doi:10.1002/rcs.1619 · Cited by 7 · see citing works
Flagged first, then by citations
2 of the 34 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Data augmentation for medical imaging: A systematic literature review
Garcea, F., Serra, A., Lamberti, F., & Morra, L. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.106391 · Cited by 423 · see citing works
Gao, C., Killeen, B. D., Hu, Y., Grupp, R. B., Taylor, R. H., Armand, M., & Unberath, M. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00629-1 · Cited by 123 · see citing works
“The results of the surgical tool detection task are summarized in Extended Data Tables 4 and 5.”
BackgroundMethodResultInfluentialSelf-citationUnberath, M., Gao, C., Hu, Y., Judish, M., Taylor, R. H., Armand, M., & Grupp, R. (2021) · Frontiers in Robotics and AI · doi:10.3389/frobt.2021.716007 · Cited by 102 · see citing works
“‡ Indeed, among the seven studies that trained deep CNNs on synthetic data and evaluated in a way that allowed for comparisons between synthetic and real data performance, we found quite substantial performance drops [76, 54, 65, 63, 41, 33, 73].”
BackgroundInfluentialSelf-citationAutomatic Annotation of Hip Anatomy in Fluoroscopy for Robust and Efficient 2D/3D Registration
Grupp, R. B., Unberath, M., Gao, C., Hegeman, R. A., Murphy, R. J., Alexander, C. P., Otake, Y., McArthur, B. A., Armand, M., & Taylor, R. H. (2020) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-020-02162-7 · Cited by 81 · see citing works
“Using a large collection of simulated fluoroscopy, Bier trained CNNs to annotate anatomical landmarks of the pelvis [19].”
MethodSelf-citationEnabling machine learning in X-ray-based procedures via realistic simulation of image formation
Unberath, M., Zaech, J.-N., Gao, C., Bier, B., Goldmann, F., Lee, S. C., Fotouhi, J., Taylor, R., Armand, M., & Navab, N. (2019) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-019-02011-2 · Cited by 63 · see citing works
“However, the amount of outliers can, in principle, be reduced substantially by only considering landmarks that are detected with a certain belief [5,6],”
Self-citationYang, W., Ye, Q., Ming, S., Hu, X., Jiang, Z., Shen, Q., He, L., & Gong, X. (2020) · European Journal of Radiology · doi:10.1016/j.ejrad.2020.109303 · Cited by 52 · see citing works
A Fully Differentiable Framework for 2D/3D Registration and the Projective Spatial Transformers
Gao, C., Feng, A., Liu, X., Taylor, R. H., Armand, M., & Unberath, M. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2023.3299588 · Cited by 36 · see citing works
“Researchers have proposed deep learning models that automatically detect 2D landmarks to solve the PnP problem [12] for pose estimation [13], [14], [15], [16], [17].”
BackgroundMethodSelf-citationChen, Y.-P., Fan, T., Chu, C.-C. J., et al. (2023) · Biomedical Journal · doi:10.1016/j.bj.2023.100614 · Cited by 25 · see citing works
Yu, M., Ruan, J., Yang, B., Gao, Y., Jin, J., Dong, F., Ji, H., He, L., Cheng, G., & Gong, X. (2022) · European Radiology · doi:10.1007/s00330-022-08771-x · Cited by 25 · see citing works
“For example, in the automated measurement of the bone and joint, Bier et al [32] reported that the average distance between baseline position and detection across all projections and landmarks was 5.”
MethodInfluentialModeling Annotation Uncertainty with Gaussian Heatmaps in Landmark Localization
Thaler, F., Payer, C., Urschler, M., & Štern, D. (2021) · The Journal of Machine Learning for Biomedical Imaging · doi:10.59275/j.melba.2021-77a7 · Cited by 20 · see citing works
Extended Capture Range of Rigid 2D/3D Registration by Estimating Riemannian Pose Gradients
Gu, W., Gao, C., Grupp, R., Fotouhi, J., & Unberath, M. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-59861-7_29 · Cited by 16 · see citing works
“In [2,3,6], distinct anatomical landmarks were extracted from 2D X-ray images using CNNs and were matched with their corresponding locations on the 3D data.”
MethodSelf-citationIn silico simulation: a key enabling technology for next-generation intelligent surgical systems
Killeen, B. D., Cho, S. M., Armand, M., Taylor, R. H., & Unberath, M. (2023) · Progress in Biomedical Engineering · doi:10.1088/2516-1091/acd28b · Cited by 16 · see citing works
“Considering arbitrary viewpoints, Bier et al [208] find that in silico training with DeepDRR enabled successful 2D/3D registration on real radiographs [26, 208].”
BackgroundSelf-citationMeng, X., Wang, Z., Ma, X., et al. (2022) · BMC Musculoskeletal Disorders · doi:10.1186/s12891-022-05818-4 · Cited by 15 · see citing works
“[11] proposed a deep convolutional neural network (DCNN) algorithm to detect multiple anatomical landmarks in pelvic X-ray images from arbitrary viewing directions.”
BackgroundMulti-task hourglass network for online automatic diagnosis of developmental dysplasia of the hip
Xu, J., Xie, H., Tan, Q., Wu, H. Y., Liu, C., Zhang, S., Mao, Z., & Zhang, Y. (2022) · World Wide Web · doi:10.1007/s11280-022-01051-0 · Cited by 15 · see citing works
“Liu et al. [22] and Bier et al. [23] utilize convolutional neural network to detect hip landmarks on the X-ray image.”
BackgroundC-Arm Positioning for Spinal Standard Projections in Different Intra-operative Settings
Kausch, L., Thomas, S., Kunze, H., Norajitra, T., Klein, A., Barbari, J. S. E., Privalov, M., Vetter, S. Y., Mahnken, A. H., Maier‐Hein, L., et al. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87202-1_34 · Cited by 11 · see citing works
C-arm positioning for standard projections during spinal implant placement
Kausch, L., Thomas, S., Kunze, H., Norajitra, T., Klein, A., Ayala, L. A., Barbari, J. S. E., Mandelka, E., Privalov, M., Vetter, S. Y., et al. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102557 · Cited by 9 · see citing works
Reconstruction of Orthographic Mosaics From Perspective X-Ray Images
Fotouhi, J., Liu, X., Armand, M., et al. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2021.3093198 · Cited by 10 · see citing works
Self-citationHassan, T., Khan, S. H., Akçay, S., Bennamoun, M., & Werghi, N. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.04251 · Cited by 12 · see citing works
“Initially the CAS systems were developed using handcrafted features but now researchers are using deep learning frameworks as well for better and reliable detection of anomalies and malicious items [22].”
Sánchez, S. A., Overschelde, P. V., & Vandemeulebroucke, J. (2024) · IEEE Access · doi:10.1109/access.2024.3394895 · Cited by 7 · see citing works
“Bier et al. [16] employed a two-stage pipeline that estimated heat maps to detect landmarks in hip X-rays.”
BackgroundMethodDeep learning model for measuring the sagittal Cobb angle on cervical spine computed tomography
Wang, C., Ni, M., Tian, S., Ouyang, H., Liu, X., Fan, L., Dong, P., Jiang, L., Lang, N., & Yuan, H. (2023) · BMC Medical Imaging · doi:10.1186/s12880-023-01156-6 · Cited by 8 · see citing works
“The percentage of correct key points (PCK) [20, 21] was used to evaluate the performance of the key point detection of the model.”
MethodLi, X., Li, L., & Zhang, K. (2025) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2025.3547079 · Cited by 5 · see citing works
“We invited two professional surgeons to anno-tate 19 landmarks in each image according to the definition of clinical anatomical pelvis position [46].”
An interpretable deep learning model for hallux valgus prediction
Ma, S., Wang, H., Zhao, W., et al. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.109468 · Cited by 5 · see citing works
Sun, W., Zhao, Y., Liu, J., et al. (2023) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-023-02877-3 · Cited by 5 · see citing works
“This is done by extracting semantic information from the 2D or 3D data [13, 14, 21, 22].”
MethodUncertainty Estimation in Landmark Localization Based on Gaussian Heatmaps
Payer, C., Urschler, M., Bischof, H., & Štern, D. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-60365-6_5 · Cited by 7 · see citing works
Rashmi, S., Srinath, S., Murthy, P. S., et al. (2023) · Dentomaxillofacial Radiology · doi:10.1093/dmfr/twad011 · Cited by 4 · see citing works
Grupp, R. B., Murphy, R. J., Hegeman, R. A., et al. (2020) · Physics in Medicine and Biology · doi:10.1088/1361-6560/aba089 · Cited by 4 · see citing works
“Using recent advances in fluoroscopic deep learning (Bier et al., 2019), we believe it may be possible for these landmarks to be localized automatically.”
BackgroundSelf-citationParametric Bi-invariant Learning for Improved Precision in 2D/3D Image Registration
Meng, R., Chen, C., Lu, M., Fu, X., Xiao, Y., Wang, K., Zou, Y., & Li, Y. (2025) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2025.107603 · Cited by 3 · see citing works
Jiang, Y., Li, P., Zhang, Y., Pei, Y., Guo, Y., Xu, T., & Yuan, X. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-59861-7_33 · Cited by 3 · see citing works
Rapid patient-specific neural networks for intraoperative X-ray to volume registration
Gopalakrishnan, V., Chlorogiannis, D.-D., Abumoussa, A., Larson, A. M., Haouchine, N., Orbach, D. B., Frisken, S., Dey, N., & Golland, P. (2025) · arXiv · doi:10.48550/arxiv.2503.16309 · Cited by 2 · see citing works
Zou, Y. S., Pan, S., Wang, Q., Zhang, Y., Gao, Y., & Fu, Z. (2025) · European Journal of Radiology · doi:10.1016/j.ejrad.2025.112231 · Cited by 1 · see citing works
Unsupervised motion artifacts reduction for cone-beam CT via enhanced landmark detection
Viriyasaranon, T., Ma, S., Thies, M., Maier, A., & Choi, J. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.127258 · Cited by 1 · see citing works
Self-citationScaling Methods of the Pelvis without Distortion for the Analysis of Bone Defects
Micheler, C. M., Lang, J. J., Wilhelm, N., et al. (2022) · Current Directions in Biomedical Engineering · doi:10.1515/cdbme-2022-1203 · Cited by 1 · see citing works
Intraoperative Fluoroscopy-Volume Registration Using Virtual-Supervision Skeleton Attention
Zhang, S., Feng, N., Fan, W., et al. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38186-6_13
Rapid patient-specific neural networks for X-ray to volume registration
Gopalakrishnan, V., Chlorogiannis, D., Abumoussa, A. L., Larson, A. M., Haouchine, N., Orbach, D. B., Frisken, S., Dey, N., & Golland, P. (2026) · Nature · doi:10.1038/s41586-026-11045-x · Cited by 7 · see citing works
A Machine Learning Framework for Predicting Human Pubic Bone Morphometric Parameters
Tufegdžić, M., Mitković, M. M., Mirjanić, Đ., et al. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-30110-9_35
Zhang, H., Li, T., Alenezi, A., et al. (2026) · BIO Integration · doi:10.15212/bioi-2026-0075
Automated system of analysis to quantify pediatric hip morphology
Gartland, C. N., Healy, J. J., Lynham, R.-S., et al. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.110904
Rashmi, S., Srinath, S., Rakshitha, R., et al. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-93688-3_18
Deep learning-based analysis on X-ray images of full lower limbs
Wang, Q., Li, Z., Li, S., et al. (2024) · doi:10.1109/icmee63700.2024.11025287
“Bier et al. proposed a deep convolutional neural network (DCNN) algorithm capable of detecting anatomical landmarks in pelvic X-ray images from any viewing angle [9].”
Rashmi, S., Srinath, S., Poornima, B. V., et al. (2024) · Proceedings in adaptation, learning and optimization · doi:10.1007/978-3-031-71391-0_2
Correction of Two Human Key-Points Estimations for Medical Applications
Luo, H., Rashid, S. R., Nie, Y., Chen, A., Li, C., Wu, S., Zheng, Z., Cheng, Z., Castañeda, B., Peng, B., et al. (2023) · International Conference on Pattern Recognition and Artificial Intelligence (PRAI) · doi:10.1109/prai59366.2023.10331970
“These techniques utilize face, hand, and body key point recognition algorithms as a multi-network method [9], [11], [12] and have been used to evaluate and compare body movements [13], [14].”
BackgroundMethodTechniques for automatic landmark detection of human tissue
Jiménez-Perez, J. R., Negrillo-Cárdenas, J., & Feito, F. R. (2023) · Elsevier eBooks · doi:10.1016/b978-0-12-823913-1.00005-1
Meng, X., Wang, Z., Ma, X., et al. (2022) · Research Square · doi:10.21203/rs.3.rs-1763264/v1
From Perspective X-ray Imaging to Parallax-Robust Orthographic StitchingPreprint
Fotouhi, J., Liu, X., Armand, M., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.02959
“Compared to naive DRRs, this mechanism has demonstrated improved generalizability [3, 2].”
BackgroundSelf-citation
- Authors
- Bier, B., Goldmann, F., Zaech, J.-N., Fotouhi, J., Hegeman, R., Grupp, R., Armand, M., Osgood, G., Navab, N., Maier, A., & Unberath, M.
- Affiliations
- Johns Hopkins University (US)
- Friedrich-Alexander-Universität Erlangen-Nürnberg (DE)
- Corresponding author
- Bier, Bastian
- ORCID
- Venue
- International Journal of Computer Assisted Radiology and Surgery
- Published
- 2019-04-20
- Volume
- 14
- Issue
- 9
- Pages
- 1463-1473
- ISSN
- 1861-6410 (ISSN-L)
- 1861-6429
- PMC
- PMC7297500
- OpenAlex
- W2936692422
- Cited by
- 43
- References
- 34
- Citations by year
- 2026: 4 · 2025: 6 · 2024: 4 · 2023: 9 · 2022: 7 · 2021: 4 · 2020: 7 · 2019: 2
- FWCI
- 1.76
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- International Journal of Computer Assisted Radiology and Surgery (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health (R01 EB023939, R21 EB020113, R01 EB016703, R01 EB0223939, 5R01AR065248-03)
- Nvidia (GPU donation)
- Topics
- Physical Sciences › Engineering › Biomedical Engineering › Medical Imaging and Analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Health Sciences › Dentistry › Oral Surgery › Dental Radiography and Imaging
- Keywords
- anatomical landmark detection, pelvis, fluoroscopy, homography, 2D-3D registration, data augmentation, minimally invasive surgery
- MeSH terms
- Algorithms, Calibration, Female, Humans, Male, Pelvis, Radiography, Tomography, X-Ray Computed, X-Rays, Reproducibility of Results, Neural Networks, Computer, Imaging, Three-Dimensional, Surgery, Computer-Assisted
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-09-29.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-09-29.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review