CoChat

Dual-stream pyramid registration network

Kang, Miao, Hu, Xiaojun, Huang, Weilin, Scott, Matthew R., Reyes, Mauricio · 2022 · Medical Image Analysis
Cited by 184

The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.

Abstract

We propose a Dual-stream Pyramid Registration Network (referred as Dual-PRNet) for unsupervised 3D brain image registration. Unlike recent CNN-based registration approaches, such as VoxelMorph, which computes a registration field from a pair of 3D volumes using a single-stream network, we design a two-stream architecture able to estimate multi-level registration fields sequentially from a pair of feature pyramids. Our main contributions are: (i) we design a two-stream 3D encoder-decoder network that computes two convolutional feature pyramids separately from two input volumes; (ii) we propose sequential pyramid registration where a sequence of pyramid registration (PR) modules is designed to predict multi-level registration fields directly from the decoding feature pyramids. The registration fields are refined gradually in a coarse-to-fine manner via sequential warping, which equips the model with a strong capability for handling large deformations; (iii) the PR modules can be further enhanced by computing local 3D correlations between the feature pyramids, resulting in the improved Dual-PRNet++ able to aggregate rich detailed anatomical structure of the brain; (iv) our Dual-PRNet++ can be integrated into a 3D segmentation framework for joint registration and segmentation, by precisely warping voxel-level annotations. Our methods are evaluated on two standard benchmarks for brain MRI registration, where Dual-PRNet++ outperforms the state-of-the-art approaches by a large margin, i.e., improving recent VoxelMorph from 0.511 to 0.748 (Dice score) on the Mindboggle101 dataset. In addition, we further demonstrate that our methods can greatly facilitate the segmentation task in a joint learning framework, by leveraging limited annotations.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.media.2022.102379

Cites

12 of 12 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 12 references

Research works printed but not linked: 22

  1. Avants, 2008, Symmetric diffeomorphic image registration with cross-correlation: evaluating automated labeling of elderly and neurodegenerative brain, Med. Image Anal., 12, 26, 10.1016/j.media.2007.06.004 · DOI · Paper page
  2. Balakrishnan, 2019, VoxelMorph: a learning framework for deformable medical image registration, IEEE Trans. Med. Imaging, 38, 1788, 10.1109/TMI.2019.2897538 · DOI · Paper page
  3. Eppenhof, 2019, Progressively trained convolutional neural networks for deformable image registration, IEEE Trans. Med. Imaging, 39, 1594, 10.1109/TMI.2019.2953788 · DOI
  4. Glaunès, 2008, Large deformation diffeomorphic metric curve mapping, Int. J. Comput. Vis., 80, 317, 10.1007/s11263-008-0141-9 · DOI · Paper page
  5. Hering, 2019, Memory-efficient 2.5D convolutional transformer networks for multi-modal deformable registration with weak label supervision applied to whole-heart CT and MRI scans, Int. J. Comput. Assist.Radiol. Surg., 14, 1901, 10.1007/s11548-019-02068-z · DOI
  6. Hu, 2017, Learning-based deformable image registration for infant MR images in the first year of life, Med. Phys., 44, 158, 10.1002/mp.12007 · DOI
  7. Huang, 2021, A coarse-to-fine deformable transformation framework for unsupervised multi-contrast mr image registration with dual consistency constraint, IEEE Trans. Med. Imaging
  8. Jaderberg, 2015, Spatial transformer networks, Adv. Neural Inf. Process. Syst., 2017
  9. Jiang, 2020, A multi-scale framework with unsupervised joint training of convolutional neural networks for pulmonary deformable image registration, Phys. Med. Biol., 65, 015011, 10.1088/1361-6560/ab5da0 · DOI · Paper page
  10. Kim, 2021, CycleMorph: cycle consistent unsupervised deformable image registration, Med. Image Anal., 10.1016/j.media.2021.102036 · DOI · Paper page
  11. Klein, 2012, 101 Labeled brain images and a consistent human cortical labeling protocol, Front. Neurosci., 6, 171, 10.3389/fnins.2012.00171 · DOI · Paper page
  12. Krebs, 2019, Learning a probabilistic model for diffeomorphic registration, IEEE Trans. Med. Imaging, 38, 2165, 10.1109/TMI.2019.2897112 · DOI · Paper page
  13. Kuang, D., Schmah, T., 2018. FAIM-a convnet method for unsupervised 3D medical image registration. arXiv:1811.09243. · DOI
  14. Kuckertz, S., Papenberg, N., Honegger, J., Morgas, T., Haas, B., Heldmann, S., 2020. Deep-learning-based CT-CBCT image registration for adaptive radio therapy 11313, 113130Q. · doi:10.1117/12.2549531
  15. Lei, 2020, 4D-CT deformable image registration using multiscale unsupervised deep learning, Phys. Med. Biol., 65, 085003, 10.1088/1361-6560/ab79c4 · DOI
  16. Lewis, K. M., Balakrishnan, G., Rost, N. S., Guttag, J., Dalca, A. V., 2018. Fast learning-based registration of sparse clinical images. arXiv:1812.06932. · arXiv
  17. Liu, L., Aviles-Rivero, A. I., Schönlieb, C.-B., 2020. Contrastive registration for unsupervised medical image segmentation. arXiv:2011.08894. · arXiv
  18. Risheng, L., Zi, L., Xin, F., Chenying, Z., Hao, H., Zhongxuan, L., 2021. Learning deformable image registration from optimization: perspective, modules, bilevel training and beyond. arXiv:2004.14557. · arXiv
  19. Shattuck, 2008, Construction of a 3D probabilistic atlas of human cortical structures, Neuroimage, 39, 1064, 10.1016/j.neuroimage.2007.09.031 · DOI · Paper page
  20. Vercauteren, 2009, Diffeomorphic demons: efficient non-parametric image registration, NeuroImage, 45, 61, 10.1016/j.neuroimage.2008.10.040 · DOI · Paper page
  21. Xu, Z., Niethammer, M., 2019. DeepAtlas: joint semi-supervised learning of image registration and segmentation. arXiv:1904.08465. · DOI · Paper page
  22. Zhao, 2020, Unsupervised 3D end-to-end medical image registration with volume tweening network, IEEE J. Biomed. Health Inf., 24, 1394, 10.1109/JBHI.2019.2951024 · DOI · Paper page

Metadata

Authors
Kang, M., Hu, X., Huang, W., Scott, M. R., & Reyes, M.
Venue
Medical Image Analysis
Publisher
Elsevier BV
Published
2022-05
Volume
78
Pages
102379
ISSN
1361-8415 (ISSN-L)
OpenAlex
W4213089245
Cited by
184
References
12
FWCI
11.57
Type
journal article
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Dual-stream pyramid registration network. https://app.cochat.ai/papers/10.1016/j.media.2022.102379
The paper
Kang, M., Hu, X., Huang, W., Scott, M. R., & Reyes, M. (2022). Dual-stream pyramid registration network. Medical Image Analysis. https://doi.org/10.1016/j.media.2022.102379

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.