An Unsupervised Learning Model for Deformable Medical Image Registration
Open accessAbstract
We present a fast learning-based algorithm for deformable, pairwise 3D medical image registration. Current registration methods optimize an objective function independently for each pair of images, which can be time-consuming for large data. We define registration as a parametric function, and optimize its parameters given a set of images from a collection of interest. Given a new pair of scans, we can quickly compute a registration field by directly evaluating the function using the learned parameters. We model this function using a CNN, and use a spatial transform layer to reconstruct one image from another while imposing smoothness constraints on the registration field. The proposed method does not require supervised information such as ground truth registration fields or anatomical landmarks. We demonstrate registration accuracy comparable to state-of-the-art 3D image registration, while operating orders of magnitude faster in practice. Our method promises to significantly speed up medical image analysis and processing pipelines, while facilitating novel directions in learning-based registration and its applications. Our code is available at https://github.com/balakg/voxelmorph.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
DiffPose develops a sparse multiscale variant of local normalized cross correlation that is robust to local minima and faster to evaluate.
“we develop a sparse multiscale variant of local normalized cross correlation [6, 7] that is robust to local minima and faster to evaluate.”
From Intraoperative 2D/3D Image Registration via Differentiable X-Ray Rendering (2024) · cites this paper as [7]
Cites
Flownet: Learning optical flow with convolutional networks
Dosovitskiy, A., Fischer, P., Ilg, E., Hausser, P., Hazirbas, C., Golkov, V., Smagt, P. V. D., Cremers, D., & Brox, T. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.316 · Cited by 4,313 · see citing works
Quicksilver: Fast predictive image registration – A deep learning approach
Yang, X., Kwitt, R., Styner, M., & Niethammer, M. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.07.008 · Cited by 630 · cited 1× · see citing works
“Most of these rely on ground truth warp fields or segmentations [26, 35, 39, 45], a significant drawback compared to our method, which does not require either.”
MethodSvf-net: learning deformable image registration using shape matching
Rohé, M.-M., Datar, M., Heimann, T., Sermesant, M., & Pennec, X. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66182-7_31 · Cited by 330 · cited 1× · see citing works
“Most of these rely on ground truth warp fields or segmentations [26, 35, 39, 45], a significant drawback compared to our method, which does not require either.”
Method
Flagged first, then by citations
Cited by
Sorted by citations
An overview of deep learning in medical imaging focusing on MRI
Lundervold, A. S., & Lundervold, A. (2019) · Zeitschrift für Medizinische Physik · doi:10.1016/j.zemedi.2018.11.002 · Cited by 2,058 · see citing works
Deep learning in medical image registration: a survey
Haskins, G., Kruger, U., & Yan, P. (2020) · Machine Vision and Applications · doi:10.1007/s00138-020-01060-x · Cited by 704 · see citing works
Deep learning in medical image registration: a review
Fu, Y., Lei, Y., Wang, T., Curran, W. J., Liu, T., & Yang, X. (2020) · Physics in Medicine & Biology · doi:10.1088/1361-6560/ab843e · Cited by 661 · see citing works
Intraoperative 2D/3D Image Registration via Differentiable X-Ray Rendering
Gopalakrishnan, V., Dey, N., & Golland, P. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.01108 · Cited by 48 · see citing works
“We improve this test-time optimization procedure in two ways: We use differentiable X-ray rendering to optimize camera poses in the Lie algebra se (3) , and we develop a sparse multiscale variant of local normalized cross correlation [6, 7] that is robust to local minima and faster to evaluate.”
Method
- Authors
- Balakrishnan, G., Zhao, A., Sabuncu, M. R., Dalca, A. V., & Guttag, J.
- Affiliations
- Massachusetts Institute of Technology (US)
- Cornell University (US)
- Venue
- 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2018-06
- Pages
- 9252-9260
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2787740020
- Cited by
- 599
- References
- 3
- Citations by year
- 2026: 35 · 2025: 54 · 2024: 92 · 2023: 101 · 2022: 95 · 2021: 87 · 2020: 67 · 2019: 61 · 2018: 7
- FWCI
- 16.72
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Engineering › Biomedical Engineering › Medical Imaging and Analysis
- Keywords
- deformable image registration, 3D medical image registration, unsupervised learning, convolutional neural networks, pairwise registration, learning-based registration, VoxelMorph
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review