The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
MoDL: Model-Based Deep Learning Architecture for Inverse Problems
Open accessAbstract
We introduce a model-based image reconstruction framework with a convolution neural network (CNN)-based regularization prior. The proposed formulation provides a systematic approach for deriving deep architectures for inverse problems with the arbitrary structure. Since the forward model is explicitly accounted for, a smaller network with fewer parameters is sufficient to capture the image information compared to direct inversion approaches. Thus, reducing the demand for training data and training time. Since we rely on end-to-end training with weight sharing across iterations, the CNN weights are customized to the forward model, thus offering improved performance over approaches that rely on pre-trained denoisers. Our experiments show that the decoupling of the number of iterations from the network complexity offered by this approach provides benefits, including lower demand for training data, reduced risk of overfitting, and implementations with significantly reduced memory footprint. We propose to enforce data-consistency by using numerical optimization blocks, such as conjugate gradients algorithm within the network. This approach offers faster convergence per iteration, compared to methods that rely on proximal gradients steps to enforce data consistency. Our experiments show that the faster convergence translates to improved performance, primarily when the available GPU memory restricts the number of iterations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Boyd, S., Parikh, N., Chu, E., Peleato, B., & Eckstein, J. (2011) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000016 · Cited by 17,075
A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
Beck, A., & Teboulle, M. (2009) · SIAM Journal on Imaging Sciences · doi:10.1137/080716542 · Cited by 11,952
Image denoising by sparse 3-D transform-domain collaborative filtering
Dabov, K., Foi, A., Katkovnik, V., & Egiazarian, K. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.901238 · Cited by 9,283
Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising
Zhang, K., Zuo, W., Chen, Y., Meng, D., & Zhang, L. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2662206 · Cited by 8,983
Deep Convolutional Neural Network for Inverse Problems in Imaging
Jin, K. H., McCann, M. T., Froustey, E., & Unser, M. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2713099 · Cited by 2,529 · cited 1×
“Improved results may be possibly obtained by fixing the sampling pattern during training, as pursued by most of the deep learning image recovery strategies [16], [18], [33], [34], [43], albeit with increased sensitivity to acquisition settings.”
BackgroundLearning Deep CNN Denoiser Prior for Image Restoration
Zhang, K., Zuo, W., Gu, S., & Zhang, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.300 · Cited by 2,116
Low-Dose CT With a Residual Encoder-Decoder Convolutional Neural Network
Chen, H., Zhang, Y., Kalra, M. K., Lin, F., Chen, Y., Liao, P., Zhou, J., & Wang, G. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2715284 · Cited by 1,866
Learning a variational network for reconstruction of accelerated MRI data
Hammernik, K., Klatzer, T., Kobler, E., Recht, M. P., Sodickson, D. K., Pock, T., & Knoll, F. (2018) · Magnetic Resonance in Medicine · doi:10.1002/mrm.26977 · Cited by 1,713
ESPIRiT—an eigenvalue approach to autocalibrating parallel MRI: Where SENSE meets GRAPPA
Uecker, M., Lai, P., Murphy, M. J., Virtue, P., Elad, M., Pauly, J. M., Vasanawala, S. S., & Lustig, M. (2014) · Magnetic Resonance in Medicine · doi:10.1002/mrm.24751 · Cited by 1,392
A deep cascade of convolutional neural networks for dynamic MR image reconstruction
Schlemper, J., Caballero, J., Hajnal, J. V., Price, A. N., & Rueckert, D. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2760978 · Cited by 1,338
An EM algorithm for wavelet-based image restoration
Figueiredo, M. A. T., & Nowak, R. D. (2003) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.814255 · Cited by 1,219
Deep ADMM-Net for compressive sensing MRI
Yang, Y., Sun, J. Z., Li, H., & Xu, Z. (2016) · neural information processing systems · Cited by 1,024
Plug-and-Play ADMM for Image Restoration: Fixed-Point Convergence and Applications
Chan, S. H., Wang, X., & Elgendy, O. A. (2017) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2016.2629286 · Cited by 904
A deep convolutional neural network using directional wavelets for low‐dose X‐ray CT reconstruction
Kang, E., Min, J., & Ye, J. C. (2017) · Medical Physics · doi:10.1002/mp.12344 · Cited by 709
Statistical image reconstruction for polyenergetic X-ray computed tomography
Elbakri, I. A., & Fessler, J. A. (2002) · IEEE Transactions on Medical Imaging · doi:10.1109/42.993128 · Cited by 691
Accelerated Dynamic MRI Exploiting Sparsity and Low-Rank Structure: k-t SLR
Lingala, S. G., Hu, Y., DiBella, E., & Jacob, M. (2011) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2010.2100850 · Cited by 664
Self-citationWang, G. (2016) · IEEE Access · doi:10.1109/access.2016.2624938 · Cited by 455
Model-Based Image Reconstruction for MRI
Fessler, J. (2010) · IEEE Signal Processing Magazine · doi:10.1109/msp.2010.936726 · Cited by 335
A Deep Cascade of Convolutional Neural Networks for MR Image Reconstruction
Schlemper, J., Caballero, J., Hajnal, J. V., Price, A., & Rueckert, D. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-59050-9_51 · Cited by 329
One Network to Solve Them All — Solving Linear Inverse Problems Using Deep Projection Models
Chang, J. H. R., Li, C.-L., Poczos, B., Vijaya Kumar, B. V. K., & Sankaranarayanan, A. C. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.627 · Cited by 327
Haldar, J. P. (2014) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2013.2293974 · Cited by 326
Learning to invert: Signal recovery via Deep Convolutional Networks
Mousavi, A., & Baraniuk, R. G. (2017) · 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2017.7952561 · Cited by 274
Blind Compressive Sensing Dynamic MRI
Lingala, S. G., & Jacob, M. (2013) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2013.2255133 · Cited by 237
Self-citationHigher Degree Total Variation (HDTV) Regularization for Image Recovery
Hu, Y., & Jacob, M. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2183143 · Cited by 191
Self-citationModel-Based 2.5-D Deconvolution for Extended Depth of Field in Brightfield Microscopy
Aguet, F., Ville, D. V. D., & Unser, M. A. (2008) · IEEE Transactions on Image Processing · doi:10.1109/tip.2008.924393 · Cited by 159
Off-the-Grid Recovery of Piecewise Constant Images from Few Fourier Samples
Ongie, G., & Jacob, M. (2016) · SIAM Journal on Imaging Sciences · doi:10.1137/15m1042280 · Cited by 134
Self-citationImage Restoration: From Sparse and Low-Rank Priors to Deep Priors [Lecture Notes]
Zhang, L., & Zuo, W. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2717489 · Cited by 119
Acceleration of MR parameter mapping using annihilating filter‐based low rank hankel matrix (ALOHA)
Lee, D., Jin, K. H., Kim, E. Y., Park, S., & Ye, J. C. (2016) · Magnetic Resonance in Medicine · doi:10.1002/mrm.26081 · Cited by 110
Sparsifying Transform Learning With Efficient Optimal Updates and Convergence Guarantees
Ravishankar, S., & Bresler, Y. (2015) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2015.2405503 · Cited by 99
Dynamic MRI Using SmooThness Regularization on Manifolds (SToRM)
Poddar, S., & Jacob, M. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2509245 · Cited by 93
Self-citationDynamic PET Reconstruction Using Wavelet Regularization With Adapted Basis Functions
Verhaeghe, J. A. J., Ville, D. V. D., Khalidov, I., D’Asseler, Y., Lemahieu, I. A., & Unser, M. A. (2008) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2008.923698 · Cited by 67
Model-Based Free-Breathing Cardiac MRI Reconstruction Using Deep Learned & Storm Priors: MODL-STORM
Biswas, S., Aggarwal, H. K., Poddar, S., & Jacob, M. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8462637 · Cited by 11
Self-citation
Cited by
Plug-and-Play Image Restoration With Deep Denoiser Prior
Zhang, K., Li, Y., Zuo, W., Zhang, L., Van Gool, L., & Timofte, R. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3088914 · Cited by 1,113
Solving inverse problems using data-driven models
Arridge, S., Maass, P., Öktem, O., & Schönlieb, C.-B. (2019) · Acta Numerica · doi:10.1017/s0962492919000059 · Cited by 686
Deep Learning Techniques for Inverse Problems in Imaging
Ongie, G., Jalal, A., Metzler, C. A., Baraniuk, R. G., Dimakis, A. G., & Willett, R. (2020) · IEEE Journal on Selected Areas in Information Theory · doi:10.1109/jsait.2020.2991563 · Cited by 577
Deep learning for tomographic image reconstruction
Wang, G., Ye, J. C., & De Man, B. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-00273-z · Cited by 531
Knoll, F., Hammernik, K., Zhang, C., Moeller, S., Pock, T., Sodickson, D. K., & Akcakaya, M. (2020) · IEEE Signal Processing Magazine · doi:10.1109/msp.2019.2950640 · Cited by 403
Metadata
- Authors
- Aggarwal, H. K., Mani, M. P., & Jacob, M.
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2019-02
- Volume
- 38
- Issue
- 2
- Pages
- 394-405
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W2773850766
- Cited by
- 1,069
- References
- 35
- FWCI
- 32.40
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.