The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
Recursive Cascaded Networks for Unsupervised Medical Image Registration
Open accessAbstract
We present recursive cascaded networks, a general architecture that enables learning deep cascades, for deformable image registration. The proposed architecture is simple in design and can be built on any base network. The moving image is warped successively by each cascade and finally aligned to the fixed image; this procedure is recursive in a way that every cascade learns to perform a progressive deformation for the current warped image. The entire system is end-to-end and jointly trained in an unsupervised manner. In addition, enabled by the recursive architecture, one cascade can be iteratively applied for multiple times during testing, which approaches a better fit between each of the image pairs. We evaluate our method on 3D medical images, where deformable registration is most commonly applied. We demonstrate that recursive cascaded networks achieve consistent, significant gains and outperform state-of-the-art methods. The performance reveals an increasing trend as long as more cascades are trained, while the limit is not observed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
A method for registration of 3-D shapes
Besl, P. J., & McKay, N. D. (1992) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.121791 · Cited by 18,103
Measures of the Amount of Ecologic Association Between Species
Dice, L. R. (1945) · Ecology · doi:10.2307/1932409 · Cited by 11,874
TensorFlow: A system for large-scale machine learning
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08695 · Cited by 11,822
Fischl, B. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.01.021 · Cited by 9,526
Voxel-Based Morphometry—The Methods
Ashburner, J., & Friston, K. J. (2000) · NeuroImage · doi:10.1006/nimg.2000.0582 · Cited by 8,676
A fast diffeomorphic image registration algorithm
Ashburner, J. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.07.007 · Cited by 8,122
Cascade R-CNN: Delving Into High Quality Object Detection
Cai, Z., & Vasconcelos, N. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00644 · Cited by 7,370
AVANTS, B., EPSTEIN, C., GROSSMAN, M., & GEE, J. (2008) · Medical Image Analysis · doi:10.1016/j.media.2007.06.004 · Cited by 5,669
Nonrigid registration using free-form deformations: application to breast mr images
Rueckert, D., Sonoda, L. I., Hayes, C., Hill, D. L. G., Leach, M. O., & Hawkes, D. J. (1999) · IEEE Transactions on Medical Imaging · doi:10.1109/42.796284 · Cited by 5,265
Learning Deconvolution Network for Semantic Segmentation
Noh, H., Hong, S., & Han, B. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.178 · Cited by 4,422
Flownet: Learning optical flow with convolutional networks
Dosovitskiy, A., Fischer, P., Ilg, E., Hausser, P., Hazirbas, C., Golkov, V., Smagt, P. V. D., Cremers, D., & Brox, T. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.316 · Cited by 4,313
Elastix: a toolbox for intensity-based medical image registration
Klein, S., Staring, M., Murphy, K., Viergever, M. A., & Pluim, J. (2010) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2009.2035616 · Cited by 4,311
FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networks
Ilg, E., Mayer, N., Saikia, T., Keuper, M., Dosovitskiy, A., & Brox, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.179 · Cited by 3,152
Di Martino, A., Yan, C.-G., Li, Q., Denio, E., Castellanos, F. X., Alaerts, K., Anderson, J. S., Assaf, M., Bookheimer, S. Y., Dapretto, M., et al. (2014) · Molecular Psychiatry · doi:10.1038/mp.2013.78 · Cited by 2,780
PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volume
Sun, D., Yang, X., Liu, M.-Y., & Kautz, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00931 · Cited by 2,648
Mayer, N., Ilg, E., Hausser, P., Fischer, P., Cremers, D., Dosovitskiy, A., & Brox, T. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.438 · Cited by 2,488
Method for registration of 3-D shapes:
Besl, P. J., & McKay, N. D. (1992) · SPIE Proceedings · doi:10.1117/12.57955 · Cited by 2,413
Iterative point matching for registration of free-form curves and surfaces
Zhang, Z. (1994) · International Journal of Computer Vision · doi:10.1007/bf01427149 · Cited by 2,402
Evaluation of 14 nonlinear deformation algorithms applied to human brain MRI registration
Klein, A., Andersson, J., Ardekani, B. A., Ashburner, J., Avants, B., Chiang, M.-C., Christensen, G. E., Collins, D. L., Gee, J., Hellier, P., et al. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.12.037 · Cited by 2,227
VoxelMorph: A Learning Framework for Deformable Medical Image Registration
Balakrishnan, G., Zhao, A., Sabuncu, M. R., Guttag, J., & Dalca, A. V. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2897538 · Cited by 2,174
Computing Large Deformation Metric Mappings via Geodesic Flows of Diffeomorphisms
Beg, M. F., Miller, M. I., Trouvé, A., & Younes, L. (2005) · International Journal of Computer Vision · doi:10.1023/b:visi.0000043755.93987.aa · Cited by 1,719
The Medical Segmentation Decathlon
Antonelli, M., Reinke, A., Bakas, S., Farahani, K., Kopp-Schneider, A., Landman, B. A., Litjens, G., Menze, B., Ronneberger, O., Summers, R. M., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-30695-9 · Cited by 1,384
A deep cascade of convolutional neural networks for dynamic MR image reconstruction
Schlemper, J., Caballero, J., Hajnal, J. V., Price, A. N., & Rueckert, D. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2760978 · Cited by 1,338
Instance-aware Semantic Segmentation via Multi-task Network Cascades
Dai, J., He, K., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1512.04412 · Cited by 1,273
Instance-Aware Semantic Segmentation via Multi-task Network Cascades
Dai, J., He, K., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.343 · Cited by 1,244
Mueller, S. G., Weiner, M. W., Thal, L. J., Petersen, R. C., Jack, C. R., Jagust, W., Trojanowski, J. Q., Toga, A. W., & Beckett, L. (2005) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2005.06.003 · Cited by 1,233
Mayer, N., Ilg, E., Cremers, D., Dosovitskiy, A., & Brox, T. (2016) · Cited by 1,214
Construction of a 3D probabilistic atlas of human cortical structures
Shattuck, D. W., Mirza, M., Adisetiyo, V., Hojatkashani, C., Salamon, G., Narr, K. L., Poldrack, R. A., Bilder, R. M., & Toga, A. W. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2007.09.031 · Cited by 1,203
Comparison and evaluation of methods for liver segmentation from CT datasets
Heimann, T., van Ginneken, B., Styner, M. A., Arzhaeva, Y., Aurich, V., Bauer, C., Beck, A., Becker, C., Beichel, R., Bekes, G., et al. (2009) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2009.2013851 · Cited by 1,135
Multiresolution elastic matching
Bajcsy, R., & Kovačič, S. (1989) · Computer Vision, Graphics, and Image Processing · doi:10.1016/s0734-189x(89)80014-3 · Cited by 1,106
HAMMER: hierarchical attribute matching mechanism for elastic registration
Shen, D., & Davatzikos, C. (2002) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2002.803111 · Cited by 1,083
Advanced Normalization Tools (ANTs)
Avants, B. (2020) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.5138158 · Cited by 982
Cascade object detection with deformable part models
Felzenszwalb, P. F., Girshick, R. B., & McAllester, D. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539906 · Cited by 913
A deep learning framework for unsupervised affine and deformable image registration
de Vos, B. D., Berendsen, F. F., Viergever, M. A., Sokooti, H., Staring, M., & Išgum, I. (2019) · Medical Image Analysis · doi:10.1016/j.media.2018.11.010 · Cited by 818
LiteFlowNet: A Lightweight Convolutional Neural Network for Optical Flow Estimation
Hui, T.-W., Tang, X., & Loy, C. C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00936 · Cited by 817
VoxelMorph: A Learning Framework for Deformable Medical Image RegistrationPreprint
Balakrishnan, G., Zhao, A. T., Sabuncu, M. R., Guttag, J. V., & Dalca, A. V. (2019) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 738
An Unsupervised Learning Model for Deformable Medical Image RegistrationPreprint
Balakrishnan, G., Zhao, A. T., Sabuncu, M. R., Guttag, J. V., & Dalca, A. V. (2018) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 691
Quicksilver: Fast Predictive Image Registration – a Deep Learning ApproachPreprint
Yang, X., Kwitt, R., Styner, M., & Niethammer, M. (2017) · NeuroImage · doi:10.48550/arxiv.1703.10908 · Cited by 655
Quicksilver: Fast predictive image registration – A deep learning approach
Yang, X., Kwitt, R., Styner, M., & Niethammer, M. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.07.008 · Cited by 630 · cited 2×
“Some initial works rely on the dense ground-truth flows obtained by either traditional algorithms [14, 56] or simulating intrasubject deformations [36, 53], but their performance is restricted due to the limited quality of training data.”
BackgroundMethodAn Unsupervised Learning Model for Deformable Medical Image Registration
Balakrishnan, G., Zhao, A., Sabuncu, M. R., Dalca, A. V., & Guttag, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00964 · Cited by 599
Dollar, P., Welinder, P., & Perona, P. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540094 · Cited by 528
Cascade Residual Learning: A Two-Stage Convolutional Neural Network for Stereo Matching
Pang, J., Sun, W., Ren, J. S., Yang, C., & Yan, Q. (2017) · 2017 IEEE International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw.2017.108 · Cited by 491
End-to-End Unsupervised Deformable Image Registration with a Convolutional Neural Network
de Vos, B. D., Berendsen, F. F., Viergever, M. A., Staring, M., & Išgum, I. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-67558-9_24 · Cited by 450
Dense image registration through MRFs and efficient linear programming
Glocker, B., Komodakis, N., Tziritas, G., Navab, N., & Paragios, N. (2008) · Medical Image Analysis · doi:10.1016/j.media.2008.03.006 · Cited by 427
Spatial Transformation and Registration of Brain Images Using Elastically Deformable Models
Davatzikos, C. (1997) · Computer Vision and Image Understanding · doi:10.1006/cviu.1997.0605 · Cited by 375
The Neuro Bureau ADHD-200 Preprocessed repository
Bellec, P., Chu, C., Chouinard-Decorte, F., Benhajali, Y., Margulies, D. S., & Craddock, R. C. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2016.06.034 · Cited by 355
Nonrigid Image Registration Using Multi-scale 3D Convolutional Neural Networks
Sokooti, H., de Vos, B., Berendsen, F., Lelieveldt, B. P. F., Išgum, I., & Staring, M. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66182-7_27 · Cited by 340
SimpleElastix: A User-Friendly, Multi-lingual Library for Medical Image Registration
Marstal, K., Berendsen, F., Staring, M., & Klein, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.78 · Cited by 325
Unsupervised 3D End-to-End Medical Image Registration With Volume Tweening Network
Zhao, S., Lau, T., Luo, J., Chang, E. I.-C., & Xu, Y. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2019.2951024 · Cited by 295
Self-citationDeep Network Cascade for Image Super-resolution
Cui, Z., Chang, H., Shan, S., Zhong, B., & Chen, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_4 · Cited by 255
Mitosis Detection in Breast Cancer Histology Images via Deep Cascaded Networks
Chen, H., Dou, Q., Wang, X., Qin, J., & Heng, P. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10140 · Cited by 255
Robust non-rigid registration through agent-based action learning
Krebs, J., Mansi, T., Delingette, H., Zhang, L., Ghesu, F. C., Miao, S., Maier, A. K., Ayache, N., Liao, R., & Kamen, A. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66182-7_40 · Cited by 225
Deformable Image Registration Based on Similarity-Steered CNN Regression
Cao, X., Yang, J., Zhang, J., Nie, D., Kim, M., Wang, Q., & Shen, D. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66182-7_35 · Cited by 225
Accurate Optical Flow via Direct Cost Volume Processing
Xu, J., Ranftl, R., & Koltun, V. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.615 · Cited by 213
Learning and Incorporating Shape Models for Semantic Segmentation
Ravishankar, H., Venkataramani, R., Thiruvenkadam, S. R., Sudhakar, P., & Vaidya, V. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-66182-7_24 · Cited by 155
Deep Deformation Network for Object Landmark Localization
Yu, X., Zhou, F., & Chandraker, M. K. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46454-1_4 · Cited by 120
Non-rigid image registration using fully convolutional networks with deep self-supervisionPreprint
Li, H., & Yong Fan, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.00799 · Cited by 95
GDL-FIRE$$^\text {4D}$$: Deep Learning-Based Fast 4D CT Image Registration
Sentker, T., Madesta, F., & Werner, R. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-00928-1_86 · Cited by 45
HAMMER: hierarchical attribute matching mechanism for elastic registration
Shen, D. G., & Davatzikos, C. A. (2002) · IEEE Workshop on Mathematical Methods in Biomedical Image Analysis (MMBIA) · doi:10.1109/mmbia.2001.991696 · Cited by 39
Quicksilver: Fast predictive image registration – A deep learning approach
Styner, M. A., Kwitt, R., Yang, X., & Niethammer, M. (2020) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/h90s-7k12 · Cited by 37
Bahrami, K., Rekik, I., Shi, F., & Shen, D. G. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-66182-7_87 · Cited by 29
Research works printed but not linked: 4
- 2018, Lits - liver tumor segmentation challenge, 5
- jaderberg, 2015, Spatial transformer networks, Advances in neural information processing systems, 2, 2017
- ronneberger, 2015, Unet: Convolutional networks for biomedical image segmentation, International Conference on Medical Image Computing and Computer-Assisted Intervention, 4, 234
- 2018, Medical segmentation decathlon, 5
Cited by
Unsupervised 3D End-to-End Medical Image Registration With Volume Tweening Network
Zhao, S., Lau, T., Luo, J., Chang, E. I.-C., & Xu, Y. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2019.2951024 · Cited by 295
Self-citationLarge Deformation Diffeomorphic Image Registration with Laplacian Pyramid Networks
Mok, T. C. W., & Chung, A. C. S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-59716-0_21 · Cited by 283
Deep Learning in Medical Image Registration
Chen, X., Diaz-Pinto, A., Ravikumar, N., & Frangi, A. (2020) · Progress in Biomedical Engineering · doi:10.1088/2516-1091/abd37c · Cited by 106
Li, J., & Wang, Q. (2022) · Information Fusion · doi:10.1016/j.inffus.2021.10.018 · Cited by 77
Gao, X., & Zheng, G. (2024) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2023.102322 · Cited by 13
Metadata
- Authors
- Zhao, S., Dong, Y., Chang, E., & Xu, Y.
- Venue
- 2019 IEEE/CVF International Conference on Computer Vision (ICCV)
- Publisher
- IEEE
- Published
- 2019-10
- Pages
- 10599-10609
- OpenAlex
- W2966108228
- Cited by
- 300
- References
- 64
- FWCI
- 9.11
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.