The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
VoxelMorph: A Learning Framework for Deformable Medical Image Registration
Open accessAbstract
We present VoxelMorph, a fast learning-based framework for deformable, pairwise medical image registration. Traditional registration methods optimize an objective function for each pair of images, which can be time-consuming for large datasets or rich deformation models. In contrast to this approach, and building on recent learning-based methods, we formulate registration as a function that maps an input image pair to a deformation field that aligns these images. We parameterize the function via a convolutional neural network (CNN), and optimize the parameters of the neural network on a set of images. Given a new pair of scans, VoxelMorph rapidly computes a deformation field by directly evaluating the function. In this work, we explore two different training strategies. In the first (unsupervised) setting, we train the model to maximize standard image matching objective functions that are based on the image intensities. In the second setting, we leverage auxiliary segmentations available in the training data. We demonstrate that the unsupervised model's accuracy is comparable to state-of-the-art methods, while operating orders of magnitude faster. We also show that VoxelMorph trained with auxiliary data improves registration accuracy at test time, and evaluate the effect of training set size on registration. Our method promises to speed up medical image analysis and processing pipelines, while facilitating novel directions in learning-based registration and its applications. Our code is freely available at https://github.com/voxelmorph/voxelmorph.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
Fischl, B. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.01.021 · Cited by 9,526
Voxel-Based Morphometry—The Methods
Ashburner, J., & Friston, K. J. (2000) · NeuroImage · doi:10.1006/nimg.2000.0582 · Cited by 8,676
A fast diffeomorphic image registration algorithm
Ashburner, J. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.07.007 · Cited by 8,122
Nonrigid registration using free-form deformations: application to breast mr images
Rueckert, D., Sonoda, L. I., Hayes, C., Hill, D. L. G., Leach, M. O., & Hawkes, D. J. (1999) · IEEE Transactions on Medical Imaging · doi:10.1109/42.796284 · Cited by 5,265
Flownet: Learning optical flow with convolutional networks
Dosovitskiy, A., Fischer, P., Ilg, E., Hausser, P., Hazirbas, C., Golkov, V., Smagt, P. V. D., Cremers, D., & Brox, T. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.316 · Cited by 4,313
Image matching as a diffusion process: an analogy with maxwell’s demons
Thirion, J.-P. (1998) · Medical Image Analysis · doi:10.1016/s1361-8415(98)80022-4 · Cited by 2,445
Evaluation of 14 nonlinear deformation algorithms applied to human brain MRI registration
Klein, A., Andersson, J., Ardekani, B. A., Ashburner, J., Avants, B., Chiang, M.-C., Christensen, G. E., Collins, D. L., Gee, J., Hellier, P., et al. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.12.037 · Cited by 2,227
Deformable medical image registration: a survey
Sotiras, A., Davatzikos, C., & Paragios, N. (2013) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2013.2265603 · Cited by 1,587 · cited 1×
“Most existing deformable registration algorithms iteratively optimize a transformation based on an energy function [7].”
Quicksilver: Fast predictive image registration – A deep learning approach
Yang, X., Kwitt, R., Styner, M., & Niethammer, M. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.07.008 · Cited by 630 · cited 1×
“Most of these rely on ground truth warp fields [35]–[39], which are either obtained by simulating deformations and deformed images, or running classical registration methods on pairs of scans.”
Background
Research works printed but not linked: 65
- 10.1016/j.pneurobio.2011.09.005 · DOI · Paper page
- 10.1007/s12021-013-9184-3 · DOI · Paper page
- milham, 2012, The ADHD-200 consortium: A model to advance the translational potential of neuroimaging in clinical neuroscience, Frontiers Syst Neurosci, 6, 62
- 10.1038/mp.2013.78 · DOI · Paper page
- chollet, 2015, Keras
- abadi, 2016, Tensorflow Large-scale machine learning on heterogeneous distributed systems
- 10.1016/j.neuroimage.2015.03.069 · DOI · Paper page
- holmes, 2015, Brain genomics superstruct project initial data release with structural, functional, and behavioral measures, Data Science Journal, 2
- 10.1007/978-3-319-66182-7_27 · DOI · Paper page
- kingma, 2014, Adam A method for stochastic optimization
- 10.1016/j.neuroimage.2008.10.040 · DOI · Paper page
- 10.1016/j.neuroimage.2009.01.002 · DOI · Paper page
- 10.1073/pnas.0503892102 · DOI · Paper page
- 10.1109/83.855431 · DOI · Paper page
- 10.1007/978-3-319-66182-7_35 · DOI · Paper page
- 10.1117/1.JMI.1.2.024003 · DOI · Paper page
- 10.1109/CVPR.2016.459 · DOI
- 10.1109/ICCV.2013.175 · DOI · Paper page
- 10.5244/C.30.145 · DOI
- 10.1016/j.neuroimage.2009.04.057 · DOI · Paper page
- ronneberger, 2015, U-net: Convolutional networks for biomedical image segmentation, Proc Int Conf Med Image Comput Comput -Assist Intervent (MICCAI), 234
- 10.1109/TMI.2005.853923 · DOI · Paper page
- 10.2307/1932409 · DOI · Paper page
- marino, 2018, Iterative amortized inference
- 10.1007/s11263-009-0219-z · DOI
- 10.1007/978-3-540-30135-6_80 · DOI
- 10.1007/978-3-319-02126-3_3 · DOI
- 10.1162/jocn.2007.19.9.1498 · DOI · Paper page
- 10.1109/TMI.2010.2049497 · DOI
- 10.1006/cviu.1997.0605 · DOI · Paper page
- 10.1007/978-3-319-59050-9_44 · DOI
- 10.1109/TMI.2002.803111 · DOI · Paper page
- pennec, 1999, Understanding the ‘Demon’s algorithm’: 3D non-rigid registration by gradient descent, Proc Int Conf Med Image Comput Comput -Assist Intervent, 597
- 10.1109/CVPR.2013.316 · DOI
- 10.1109/ICIP.2016.7532634 · DOI
- 10.1109/CVPR.2017.290 · DOI
- 10.1007/978-3-319-46493-0_18 · DOI · Paper page
- 10.1109/CVPR.2017.82 · DOI · Paper page
- 10.1109/CVPRW.2016.57 · DOI
- 10.1109/CVPR.2017.291 · DOI · Paper page
- jason, 2016, Back to basics: Unsupervised learning of optical flow via brightness constancy and motion smoothness, Proc Eur Conf Comput Vis, 3
- 10.1109/CVPR.2017.179 · DOI · Paper page
- 10.1023/A:1007958904918 · DOI · Paper page
- 10.1016/j.media.2007.06.004 · DOI · Paper page
- 10.1007/978-3-319-67558-9_24 · DOI · Paper page
- kim, 2018, Semi-amortized variational autoencoders
- sønderby, 2016, Amortised map inference for image super-resolution
- zhang, 2017, Advances in variational inference
- cremer, 2018, Inference suboptimality in variational autoencoders
- 10.1007/978-3-319-47118-1_8 · DOI
- 10.1016/j.media.2008.03.006 · DOI · Paper page
- 10.1016/j.cmpb.2009.09.002 · DOI · Paper page
- 10.1016/j.neuroimage.2010.09.025 · DOI · Paper page
- 10.1007/978-3-030-00928-1_82 · DOI · Paper page
- 10.1016/S0734-189X(89)80014-3 · DOI · Paper page
- 10.1109/TPAMI.2010.147 · DOI · Paper page
- 10.1023/B:VISI.0000043755.93987.aa · DOI · Paper page
- 10.1016/0004-3702(81)90024-2 · DOI · Paper page
- 10.1007/978-3-540-24673-2_3 · DOI · Paper page
- 10.1109/TPAMI.2010.143 · DOI · Paper page
- 10.1109/CVPR.2010.5539939 · DOI · Paper page
- jaderberg, 2015, Spatial transformer networks, Proc Adv Neural Inf Process Syst, 2017
- li, 2017, Non-rigid image registration using fully convolutional networks with deep self-supervision
- 10.1109/ISBI.2018.8363756 · DOI
- 10.1016/j.media.2018.07.002 · DOI · Paper page
Cited by
Deep learning and alignment of spatially resolved single-cell transcriptomes with Tangram
Biancalani, T., Scalia, G., Buffoni, L., Avasthi, R., Lu, Z., Sanger, A., Tokcan, N., Vanderburg, C. R., Segerstolpe, Å., Zhang, M., et al. (2021) · Nature Methods · doi:10.1038/s41592-021-01264-7 · Cited by 931
TransMorph: Transformer for unsupervised medical image registration
Chen, J., Frey, E. C., He, Y., Segars, W. P., Li, Y., & Du, Y. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102615 · Cited by 804
Deep learning in medical image registration: a review
Fu, Y., Lei, Y., Wang, T., Curran, W. J., Liu, T., & Yang, X. (2020) · Physics in Medicine & Biology · doi:10.1088/1361-6560/ab843e · Cited by 661
Li, J., Chen, J., Tang, Y., Wang, C., Landman, B. A., & Zhou, S. K. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102762 · Cited by 389
CycleMorph: Cycle consistent unsupervised deformable image registration
Kim, B., Kim, D. H., Park, S. H., Kim, J., Lee, J.-G., & Ye, J. C. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102036 · Cited by 336
Metadata
- Authors
- Balakrishnan, G., Zhao, A., Sabuncu, M. R., Guttag, J., & Dalca, A. V.
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2019-08
- Volume
- 38
- Issue
- 8
- Pages
- 1788-1800
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W2891631795
- Cited by
- 2,174
- References
- 13
- FWCI
- 72.17
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- Funders
- NIH R01 grants (R01LM012719, R01AG053949, 1R21AG050122)
- the NSF NeuroNex grant (1707312)
- NSF CAREER grant (1748377)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: VoxelMorph: A Learning Framework for Deformable Medical Image Registration. https://app.cochat.ai/papers/10.1109/tmi.2019.2897538
- The paper
- Balakrishnan, G., Zhao, A., Sabuncu, M. R., Guttag, J., & Dalca, A. V. (2019). VoxelMorph: A Learning Framework for Deformable Medical Image Registration. IEEE Transactions on Medical Imaging. https://doi.org/10.1109/tmi.2019.2897538
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.