Non-Rigid 2D-3D Registration Using Convolutional Autoencoders
The DOI matches its Crossref record; 21 of the 24 references it cites were found in a registry or an index.
Abstract
In this paper, we propose a novel neural network-based framework for the non-rigid 2D-3D registration of the lateral cephalogram and the volumetric cone-beam CT (CBCT) images. The task is formulated as an embedding problem, where we utilize the statistical volumetric representation and embed the X-ray image to a code vector regarding the non-rigid volumetric deformations. In particular, we build a deep ResNet-based encoder to infer the code vector from the input X-ray image. We design a decoder to generate digitally reconstructed radiographs (DRRs) from the non-rigidly deformed volumetric image determined by the code vector. The parameters of the encoder are optimized by minimizing the difference between synthetic DRRs and input X-ray images in an unsupervised way. Without geometric constraints from multi-view X-ray images, we exploit structural constraints of the multi-scale feature pyramid in similarity analysis. The training process is unsupervised and does not require paired 2D X-ray images and 3D CBCT images. The system allows constructing a volumetric image from a single X-ray image and realizes the 2D-3D registration between the lateral cephalograms and CBCT images.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Li et al. [325] introduced a neural network-based approach for the non-rigid 2D–3D registration of the lateral cephalogram and the volumetric cone-beam CT (CBCT) images.”
From Review of deep learning: concepts, CNN architectures, challenges, applications, future directions (2021) · cites this paper as [325]
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 4×
“The TRE, the LRE, and the GFR of the proposed method (EN), traditional optimization-based methods of the OP M and the OP C [1], the RBF [19], the PLSR [6], and the RestNet [17]-based methods on synthetic X-ray images.”
MethodInfluentialAdam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · cited 1×
“We train the network using the ADAM optimizer [18] with (cid:12) 1 = 0 : 9 and (cid:12) 2 = 0 : 999 .”
MethodA Review of 3d/2d Registration Methods for Image-Guided Interventions
Markelj, P., Tomaževič, D., Likar, B., & Pernuš, F. (2012) · Medical Image Analysis · doi:10.1016/j.media.2010.03.005 · Cited by 746 · cited 6×
“The iterative optimization of most non-convex objective functions regarding the 2D-3D registration requires good initializations for convergence to a global optimum [1].”
BackgroundMethodInfluentialA CNN Regression Approach for Real-Time 2D/3D Registration
Miao, S., Wang, Z. J., & Liao, R. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2521800 · Cited by 514 · cited 2×
“The supervised partial least squares registration (PLSR) [6], the random forest [7], and the deep convolutional neural network (CNN) [8, 9, 10] are used to learn the mapping function between 2D X-ray images and transformation parameters for volumetric deformations.”
MethodZhang, Y., Miao, S., Mansi, T., & Liao, R. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00934-2_67 · Cited by 204
Walczak, B., & Massart, D. L. (1996) · Analytica Chimica Acta · doi:10.1016/0003-2670(96)00202-4 · Cited by 200
Single‐image Tomography: 3D Volumes from 2D Cranial X‐Rays
Henzler, P., Rasche, V., Ropinski, T., & Ritschel, T. (2018) · Computer Graphics Forum · doi:10.1111/cgf.13369 · Cited by 145
Dilated FCN for Multi-Agent 2D/3D Medical Image Registration
Miao, S., Piat, S., Fischer, P., Tuysuzoglu, A., Mewes, P., Mansi, T., & Liao, R. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11576 · Cited by 113
Monitoring tumor motion by real time 2D/3D registration during radiotherapy
Gendrin, C., Furtado, H., Weber, C., Bloch, C., Figl, M., Pawiro, S. A., Bergmann, H., Stock, M., Fichtinger, G., Georg, D., et al. (2012) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2011.07.031 · Cited by 87 · cited 1×
“The traditional generative approaches for the 2D-3D registration design the feature or intensity-based metrics to find the overlapping between the digitally reconstructed radiographs (DRR) of 3D surface meshes or volumes and the target X-ray images [2, 1].”
2D/3D image registration using regression learning
Chou, C.-R., Frederick, B., Mageras, G., Chang, S., & Pizer, S. (2013) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2013.02.009 · Cited by 64 · cited 1×
“The regression-based methods [11, 7, 6] avoid online computationally expensive DRR evaluations.”
Method
Cited by
Review of deep learning: concepts, CNN architectures, challenges, applications, future directions
Alzubaidi, L., Zhang, J., Humaidi, A. J., Al-Dujaili, A., Duan, Y., Al-Shamma, O., Santamaría, J., Fadhel, M. A., Al-Amidie, M., & Farhan, L. (2021) · Journal of Big Data · doi:10.1186/s40537-021-00444-8 · Cited by 7,906
Unberath, M., Gao, C., Hu, Y., Judish, M., Taylor, R. H., Armand, M., & Grupp, R. (2021) · Frontiers in Robotics and AI · doi:10.3389/frobt.2021.716007 · Cited by 121
“‡ Indeed, among the seven studies that trained deep CNNs on synthetic data and evaluated in a way that allowed for comparisons between synthetic and real data performance, we found quite substantial performance drops [76, 54, 65, 63, 41, 33, 73].”
BackgroundMethodInfluentialAubert, B., Cresson, T., de Guise, J. A., & Vázquez, C. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3218568 · Cited by 42
“This is also a limitation of recently proposed methods that directly infer a 3D model from 2D images [25], [26], even though some deep learning methods now consider varying the projection (camera parameters) in generating training data [27], [28].”
MethodZhang, C., Liu, L., Dai, J., Liu, X., He, W., Chan, Y., Xie, Y., Chi, F., & Liang, X. (2024) · Physics in Medicine and Biology · doi:10.1088/1361-6560/ad3320 · Cited by 35
“…techniques, such as CNN regression methods for 2D / 3D rigid registration [13], projection space transformation for spatial transformation [14], point-of-interest networks for 2D / 3D rigid registration under multiple views [15], and deep learning-based methods for non-rigid registration [4, 16].”
MethodDong, G., Dai, J., Li, N., Zhang, C., He, W., Liu, L., Chan, Y., Li, Y., Xie, Y., & Liang, X. (2023) · Bioengineering · doi:10.3390/bioengineering10020144 · Cited by 28
“[4] proposed an unsupervised multiscale encode decode framework to achieve non-rigid 2D/3D registration based on a single 2D lateral brain image and 3D CBCT image.”
Background
Metadata
- Authors
- Li, P., Pei, Y., Guo, Y., Ma, G., Xu, T., & Zha, H.
- Affiliations
- Peking University (CN)
- Luoyang Institute of Science and Technology (CN)
- Venue
- 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI)
- Publisher
- IEEE
- Published
- 2020-04
- Pages
- 700-704
- OpenAlex
- W3026967795
- Cited by
- 13
- References
- 24
- Citations by year
- 2025: 1 · 2024: 4 · 2023: 3 · 2022: 3 · 2021: 2
- FWCI
- 3.60
- Type
- conference paper
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE International Symposium on Biomedical Imaging (ISBI) (publishedVersion)
- Topics
- Health Sciences › Dentistry › Oral Surgery › Dental Radiography and Imaging
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Physical Sciences › Engineering › Biomedical Engineering › Medical Imaging and Analysis
- Keywords
- 2D-3D registration, non-rigid registration, cephalogram, cone-beam computed tomography, convolutional autoencoder, digitally reconstructed radiographs, volumetric deformation, unsupervised learning, multi-scale feature pyramid, ResNet encoder, dental imaging
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Non-Rigid 2D-3D Registration Using Convolutional Autoencoders. https://app.cochat.ai/papers/10.1109/isbi45749.2020.9098602
- The paper
- Li, P., Pei, Y., Guo, Y., Ma, G., Xu, T., & Zha, H. (2020). Non-Rigid 2D-3D Registration Using Convolutional Autoencoders. 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI). https://doi.org/10.1109/isbi45749.2020.9098602
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.