Dual-stream pyramid registration network
The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
We propose a Dual-stream Pyramid Registration Network (referred as Dual-PRNet) for unsupervised 3D brain image registration. Unlike recent CNN-based registration approaches, such as VoxelMorph, which computes a registration field from a pair of 3D volumes using a single-stream network, we design a two-stream architecture able to estimate multi-level registration fields sequentially from a pair of feature pyramids. Our main contributions are: (i) we design a two-stream 3D encoder-decoder network that computes two convolutional feature pyramids separately from two input volumes; (ii) we propose sequential pyramid registration where a sequence of pyramid registration (PR) modules is designed to predict multi-level registration fields directly from the decoding feature pyramids. The registration fields are refined gradually in a coarse-to-fine manner via sequential warping, which equips the model with a strong capability for handling large deformations; (iii) the PR modules can be further enhanced by computing local 3D correlations between the feature pyramids, resulting in the improved Dual-PRNet++ able to aggregate rich detailed anatomical structure of the brain; (iv) our Dual-PRNet++ can be integrated into a 3D segmentation framework for joint registration and segmentation, by precisely warping voxel-level annotations. Our methods are evaluated on two standard benchmarks for brain MRI registration, where Dual-PRNet++ outperforms the state-of-the-art approaches by a large margin, i.e., improving recent VoxelMorph from 0.511 to 0.748 (Dice score) on the Mindboggle101 dataset. In addition, we further demonstrate that our methods can greatly facilitate the segmentation task in a joint learning framework, by leveraging limited annotations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
A fast diffeomorphic image registration algorithm
Ashburner, J. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.07.007 · Cited by 8,122
3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation
Çiçek, Ö., Abdulkadir, A., Lienkamp, S. S., Brox, T., & Ronneberger, O. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46723-8_49 · Cited by 7,945
A reproducible evaluation of ANTs similarity metric performance in brain image registration
Avants, B. B., Tustison, N. J., Song, G., Cook, P. A., Klein, A., & Gee, J. C. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.09.025 · Cited by 4,796
Flownet: Learning optical flow with convolutional networks
Dosovitskiy, A., Fischer, P., Ilg, E., Hausser, P., Hazirbas, C., Golkov, V., Smagt, P. V. D., Cremers, D., & Brox, T. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.316 · Cited by 4,313
A deep learning framework for unsupervised affine and deformable image registration
de Vos, B. D., Berendsen, F. F., Viergever, M. A., Sokooti, H., Staring, M., & Išgum, I. (2019) · Medical Image Analysis · doi:10.1016/j.media.2018.11.010 · Cited by 818
LiteFlowNet: A Lightweight Convolutional Neural Network for Optical Flow Estimation
Hui, T.-W., Tang, X., & Loy, C. C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00936 · Cited by 817
Deep learning in medical image registration: a survey
Haskins, G., Kruger, U., & Yan, P. (2020) · Machine Vision and Applications · doi:10.1007/s00138-020-01060-x · Cited by 704
Deep learning in medical image registration: a review
Fu, Y., Lei, Y., Wang, T., Curran, W. J., Liu, T., & Yang, X. (2020) · Physics in Medicine & Biology · doi:10.1088/1361-6560/ab843e · Cited by 661
Quicksilver: Fast predictive image registration – A deep learning approach
Yang, X., Kwitt, R., Styner, M., & Niethammer, M. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.07.008 · Cited by 630
Research works printed but not linked: 22
- Avants, 2008, Symmetric diffeomorphic image registration with cross-correlation: evaluating automated labeling of elderly and neurodegenerative brain, Med. Image Anal., 12, 26, 10.1016/j.media.2007.06.004 · DOI · Paper page
- Balakrishnan, 2019, VoxelMorph: a learning framework for deformable medical image registration, IEEE Trans. Med. Imaging, 38, 1788, 10.1109/TMI.2019.2897538 · DOI · Paper page
- Eppenhof, 2019, Progressively trained convolutional neural networks for deformable image registration, IEEE Trans. Med. Imaging, 39, 1594, 10.1109/TMI.2019.2953788 · DOI
- Glaunès, 2008, Large deformation diffeomorphic metric curve mapping, Int. J. Comput. Vis., 80, 317, 10.1007/s11263-008-0141-9 · DOI · Paper page
- Hering, 2019, Memory-efficient 2.5D convolutional transformer networks for multi-modal deformable registration with weak label supervision applied to whole-heart CT and MRI scans, Int. J. Comput. Assist.Radiol. Surg., 14, 1901, 10.1007/s11548-019-02068-z · DOI
- Hu, 2017, Learning-based deformable image registration for infant MR images in the first year of life, Med. Phys., 44, 158, 10.1002/mp.12007 · DOI
- Huang, 2021, A coarse-to-fine deformable transformation framework for unsupervised multi-contrast mr image registration with dual consistency constraint, IEEE Trans. Med. Imaging
- Jaderberg, 2015, Spatial transformer networks, Adv. Neural Inf. Process. Syst., 2017
- Jiang, 2020, A multi-scale framework with unsupervised joint training of convolutional neural networks for pulmonary deformable image registration, Phys. Med. Biol., 65, 015011, 10.1088/1361-6560/ab5da0 · DOI · Paper page
- Kim, 2021, CycleMorph: cycle consistent unsupervised deformable image registration, Med. Image Anal., 10.1016/j.media.2021.102036 · DOI · Paper page
- Klein, 2012, 101 Labeled brain images and a consistent human cortical labeling protocol, Front. Neurosci., 6, 171, 10.3389/fnins.2012.00171 · DOI · Paper page
- Krebs, 2019, Learning a probabilistic model for diffeomorphic registration, IEEE Trans. Med. Imaging, 38, 2165, 10.1109/TMI.2019.2897112 · DOI · Paper page
- Kuang, D., Schmah, T., 2018. FAIM-a convnet method for unsupervised 3D medical image registration. arXiv:1811.09243. · DOI
- Kuckertz, S., Papenberg, N., Honegger, J., Morgas, T., Haas, B., Heldmann, S., 2020. Deep-learning-based CT-CBCT image registration for adaptive radio therapy 11313, 113130Q. · doi:10.1117/12.2549531
- Lei, 2020, 4D-CT deformable image registration using multiscale unsupervised deep learning, Phys. Med. Biol., 65, 085003, 10.1088/1361-6560/ab79c4 · DOI
- Lewis, K. M., Balakrishnan, G., Rost, N. S., Guttag, J., Dalca, A. V., 2018. Fast learning-based registration of sparse clinical images. arXiv:1812.06932. · arXiv
- Liu, L., Aviles-Rivero, A. I., Schönlieb, C.-B., 2020. Contrastive registration for unsupervised medical image segmentation. arXiv:2011.08894. · arXiv
- Risheng, L., Zi, L., Xin, F., Chenying, Z., Hao, H., Zhongxuan, L., 2021. Learning deformable image registration from optimization: perspective, modules, bilevel training and beyond. arXiv:2004.14557. · arXiv
- Shattuck, 2008, Construction of a 3D probabilistic atlas of human cortical structures, Neuroimage, 39, 1064, 10.1016/j.neuroimage.2007.09.031 · DOI · Paper page
- Vercauteren, 2009, Diffeomorphic demons: efficient non-parametric image registration, NeuroImage, 45, 61, 10.1016/j.neuroimage.2008.10.040 · DOI · Paper page
- Xu, Z., Niethammer, M., 2019. DeepAtlas: joint semi-supervised learning of image registration and segmentation. arXiv:1904.08465. · DOI · Paper page
- Zhao, 2020, Unsupervised 3D end-to-end medical image registration with volume tweening network, IEEE J. Biomed. Health Inf., 24, 1394, 10.1109/JBHI.2019.2951024 · DOI · Paper page
Cited by
Gao, X., & Zheng, G. (2024) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2023.102322 · Cited by 13
Metadata
- Authors
- Kang, M., Hu, X., Huang, W., Scott, M. R., & Reyes, M.
- Venue
- Medical Image Analysis
- Publisher
- Elsevier BV
- Published
- 2022-05
- Volume
- 78
- Pages
- 102379
- ISSN
- 1361-8415 (ISSN-L)
- OpenAlex
- W4213089245
- Cited by
- 184
- References
- 12
- FWCI
- 11.57
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- doi.org/10.15223/policy-017 (stm-asf)
- doi.org/10.15223/policy-037 (stm-asf)
- doi.org/10.15223/policy-012 (stm-asf)
- doi.org/10.15223/policy-029 (stm-asf)
- doi.org/10.15223/policy-004 (stm-asf)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Dual-stream pyramid registration network. https://app.cochat.ai/papers/10.1016/j.media.2022.102379
- The paper
- Kang, M., Hu, X., Huang, W., Scott, M. R., & Reyes, M. (2022). Dual-stream pyramid registration network. Medical Image Analysis. https://doi.org/10.1016/j.media.2022.102379
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.