The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
ISTA-Net: Interpretable Optimization-Inspired Deep Network for Image Compressive Sensing
Open accessAbstract
With the aim of developing a fast yet accurate algorithm for compressive sensing (CS) reconstruction of natural images, we combine in this paper the merits of two existing categories of CS methods: the structure insights of traditional optimization-based methods and the speed of recent network-based ones. Specifically, we propose a novel structured deep network, dubbed ISTA-Net, which is inspired by the Iterative Shrinkage-Thresholding Algorithm (ISTA)for optimizing a general ℓ1norm CS reconstruction model. To cast ISTA into deep network form, we develop an effective strategy to solve the proximal mapping associated with the sparsity-inducing regularizer using nonlinear transforms. All the parameters in ISTA-Net (e.g. nonlinear transforms, shrinkage thresholds, step sizes, etc.) are learned end-to-end, rather than being hand-crafted. Moreover, considering that the residuals of natural images are more compressible, an enhanced version of ISTA-Net in the residual domain, dubbed ISTA-Net+, is derived to further improve CS reconstruction. Extensive CS experiments demonstrate that the proposed ISTA-Nets outperform existing state-of-the-art optimization-based and networkbased CS methods by large margins, while maintaining fast computational speed. Our source codes are available: http://jianzhang.tech/projects/ISTA-Net.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Multilayer feedforward networks are universal approximators
Hornik, K., Stinchcombe, M., & White, H. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90020-8 · Cited by 21,728
A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
Beck, A., & Teboulle, M. (2009) · SIAM Journal on Imaging Sciences · doi:10.1137/080716542 · Cited by 11,952
TensorFlow: A system for large-scale machine learning
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08695 · Cited by 11,822
Multilayer feedforward networks are universal approximators
HornikK., StinchcombeM., & WhiteH. (1989) · Neural Networks · doi:10.5555/70405.70408 · Cited by 9,081
Overview of the High Efficiency Video Coding (HEVC) Standard
Sullivan, G. J., Ohm, J.-R., Han, W.-J., & Wiegand, T. (2012) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2012.2221191 · Cited by 8,263
Martin, D., Fowlkes, C., Tal, D., & Malik, J. (2002) · Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001 · doi:10.1109/iccv.2001.937655 · Cited by 8,216
Sparse MRI: The application of compressed sensing for rapid MR imaging
Lustig, M., Donoho, D., & Pauly, J. M. (2007) · Magnetic Resonance in Medicine · doi:10.1002/mrm.21391 · Cited by 6,952
Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies?
Candes, E. J., & Tao, T. (2006) · IEEE Transactions on Information Theory · doi:10.1109/tit.2006.885507 · Cited by 6,839
Learning a Deep Convolutional Network for Image Super-Resolution
Dong, C., Loy, C. C., He, K., & Tang, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10593-2_13 · Cited by 5,494
Single-pixel imaging via compressive sampling
Duarte, M. F., Davenport, M. A., Takhar, D., Laska, J. N., Sun, T., Kelly, K. F., & Baraniuk, R. G. (2008) · IEEE Signal Processing Magazine · doi:10.1109/msp.2007.914730 · Cited by 3,575
The JPEG still picture compression standard
Wallace, G. K. (1992) · IEEE Transactions on Consumer Electronics · doi:10.1109/30.125072 · Cited by 2,851
Deep Convolutional Neural Network for Inverse Problems in Imaging
Jin, K. H., McCann, M. T., Froustey, E., & Unser, M. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2713099 · Cited by 2,529 · cited 1×
“The tremendous success of deep learning for many image processing applications has also led researchers to consider relating iterative optimization methods to neural networks [16, 39, 43, 32].”
BackgroundLearning Deep CNN Denoiser Prior for Image Restoration
Zhang, K., Zuo, W., Gu, S., & Zhang, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.300 · Cited by 2,116 · cited 5×
“From Table 1, we observe that SDA and ReconNet work better at 1We use the source code made publicly available by the authors of TVAL3 [22], D-AMP [28], IRCNN [49], and ReconNet [21] and implement SDA [30] ourselves, since its source code is not available. extremely low CS ratios of 1% and 4%, while traditional optimiz…”
MethodInfluentialLearning Fast Approximations of Sparse Coding
Gregor, K., & LeCun, Y. (2010) · International Conference on Machine Learning · Cited by 1,413
Image Denoising and Inpainting with Deep Neural Networks
Xie, J., Xu, L., & Chen, E. (2012) · Cited by 1,237
Deep ADMM-Net for compressive sensing MRI
Yang, Y., Sun, J. Z., Li, H., & Xu, Z. (2016) · neural information processing systems · Cited by 1,024
Afonso, M. V., Bioucas-Dias, J. M., & Figueiredo, M. A. T. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2076294 · Cited by 938
Deep Networks for Image Super-Resolution with Sparse Prior
Wang, Z., Liu, D., Yang, J., Han, W., & Huang, T. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.50 · Cited by 784
Afonso, M. V., Bioucas‐Dias, J. M., & Figueiredo, M. A. T. (2011) · Cited by 783
Group-Based Sparse Representation for Image Restoration
Zhang, J., Zhao, D., & Gao, W. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2323127 · Cited by 768
Self-citationReconNet: Non-Iterative Reconstruction of Images from Compressively Sensed Measurements
Kulkarni, K., Lohit, S., Turaga, P., Kerviche, R., & Ashok, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.55 · Cited by 768
An efficient augmented Lagrangian method with applications to total variation minimization
Li, C., Yin, W., Jiang, H., & Zhang, Y. (2013) · Computational Optimization and Applications · doi:10.1007/s10589-013-9576-1 · Cited by 656
1From Denoising to Compressed SensingPreprint
Metzler, C. A., Maleki, A., & Baraniuk, R. G. (2016) · Cited by 644
Compressive Sensing via Nonlocal Low-Rank Regularization
Dong, W., Shi, G., Li, X., Ma, Y., & Huang, F. (2014) · IEEE Transactions on Image Processing · doi:10.1109/tip.2014.2329449 · Cited by 598
Shrinkage Fields for Effective Image Restoration
Schmidt, U., & Roth, S. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.349 · Cited by 543
Exploiting Structure in Wavelet-Based Bayesian Compressive Sensing
He, L., & Carin, L. (2009) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2009.2022003 · Cited by 506
AMP-Inspired Deep Networks for Sparse Linear Inverse Problems
Borgerding, M., Schniter, P., & Rangan, S. (2017) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2017.2708040 · Cited by 455
Block Compressed Sensing of Images Using Directional Transforms
Mun, S., & Fowler, J. E. (2010) · 2010 Data Compression Conference · doi:10.1109/dcc.2010.90 · Cited by 406
A deep learning approach to structured signal recovery
Mousavi, A., Patel, A. B., & Baraniuk, R. G. (2015) · 2015 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton) · doi:10.1109/allerton.2015.7447163 · Cited by 355
Zhang, Z., Jung, T.-P., Makeig, S., & Rao, B. D. (2013) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2012.2226175 · Cited by 340
One Network to Solve Them All — Solving Linear Inverse Problems Using Deep Projection Models
Chang, J. H. R., Li, C.-L., Poczos, B., Vijaya Kumar, B. V. K., & Sankaranarayanan, A. C. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.627 · Cited by 327
On learning optimized reaction diffusion processes for effective image restoration
Chen, Y., Yu, W., & Pock, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299163 · Cited by 323
Learning to invert: Signal recovery via Deep Convolutional Networks
Mousavi, A., & Baraniuk, R. G. (2017) · 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2017.7952561 · Cited by 274
Robust Single Image Super-Resolution via Deep Networks With Sparse Prior
Liu, D., Wang, Z., Wen, B., Yang, J., Han, W., & Huang, T. S. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2564643 · Cited by 266
Application of Compressive Sensing in Cognitive Radio Communications: A Survey
Sharma, S. K., Lagunas, E., Chatzinotas, S., & Ottersten, B. (2016) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2016.2524443 · Cited by 241
Imaging With Nature: Compressive Imaging Using a Multiply Scattering Medium
Liutkus, A., Martina, D., Popoff, S., Chardon, G., Katz, O., Lerosey, G., Gigan, S., Daudet, L., & Carron, I. (2014) · Scientific Reports · doi:10.1038/srep05552 · Cited by 239
D3: Deep Dual-Domain Based Fast Restoration of JPEG-Compressed Images
Wang, Z., Liu, D., Chang, S., Ling, Q., Yang, Y., & Huang, T. S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.302 · Cited by 215
Deep fully-connected networks for video compressive sensing
Iliadis, M., Spinoulas, L., & Katsaggelos, A. K. (2018) · Digital Signal Processing · doi:10.1016/j.dsp.2017.09.010 · Cited by 210
Maximal Sparsity with Deep Networks?Preprint
Xin, B., Wang, Y.-Z., Gao, W., Wipf, D., & Wang, B. (2016) · Neural Information Processing Systems · doi:10.48550/arxiv.1605.01636 · Cited by 180
Image compressive sensing recovery using adaptively learned sparsifying basis via L0 minimization
Zhang, J., Zhao, C., Zhao, D., & Gao, W. (2014) · Signal Processing · doi:10.1016/j.sigpro.2013.09.025 · Cited by 170
Self-citationImage Compressive Sensing Recovery via Collaborative Sparsity
Zhang, J., Zhao, D., Zhao, C., Xiong, R., Ma, S., & Gao, W. (2012) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2012.2220391 · Cited by 162
Self-citationATGV-Net: Accurate Depth Super-Resolution
Riegler, G., Rüther, M., & Bischof, H. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46487-9_17 · Cited by 157
CS-MUVI: Video compressive sensing for spatial-multiplexing cameras
Sankaranarayanan, A. C., Studer, C., & Baraniuk, R. G. (2012) · IEEE International Conference on Computational Photography (ICCP) · doi:10.1109/iccphot.2012.6215212 · Cited by 152
Adaptive Basis Scan by Wavelet Prediction for Single-Pixel Imaging
Rousset, F., Ducros, N., Farina, A., Valentini, G., D’Andrea, C., & Peyrin, F. (2016) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2016.2637079 · Cited by 133
Learning Optimal Nonlinearities for Iterative Thresholding Algorithms
Kamilov, U. S., & Mansour, H. (2016) · IEEE Signal Processing Letters · doi:10.1109/lsp.2016.2548245 · Cited by 105
Compressed sensing using a Gaussian Scale Mixtures model in wavelet domain
Kim, Y. S., Nadar, M. S., & Bilgin, A. (2010) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2010.5652744 · Cited by 75
Proximal Deep Structured Models
Wang, S., Fidler, S., & Urtasun, R. (2016) · neural information processing systems · Cited by 68
A Deep Learning Approach to Block-based Compressed Sensing of ImagesPreprint
Adler, A., Boublil, D., Elad, M., & Zibulevsky, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.01519 · Cited by 49
Learning to Invert: Signal Recovery via Deep Convolutional NetworksPreprint
Mousavi, A., & Baraniuk, R. G. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.03891 · Cited by 45
Nonconvex Lp Nuclear Norm based ADMM Framework for Compressed Sensing
Zhao, C., Zhang, J., Ma, S., & Gao, W. (2016) · DCC · doi:10.1109/dcc.2016.104 · Cited by 38
Self-citation
Cited by
Plug-and-Play Image Restoration With Deep Denoiser Prior
Zhang, K., Li, Y., Zuo, W., Zhang, L., Van Gool, L., & Timofte, R. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3088914 · Cited by 1,113
Deep Learning on Image Denoising: An overview
Tian, C., Fei, L., Zheng, W., Xu, Y., Zuo, W., & Lin, C.-W. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.07.025 · Cited by 1,091
Deep Unfolding Network for Image Super-Resolution
Zhang, K., Van Gool, L., & Timofte, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00328 · Cited by 638
Image Compressed Sensing Using Convolutional Neural Network
Shi, W., Jiang, F., Liu, S., & Zhao, D. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2928136 · Cited by 440
Deep Magnetic Resonance Image Reconstruction: Inverse Problems Meet Neural Networks
Liang, D., Cheng, J., Ke, Z., & Ying, L. (2020) · IEEE Signal Processing Magazine · doi:10.1109/msp.2019.2950557 · Cited by 370
Metadata
- Authors
- Zhang, J., & Ghanem, B.
- Venue
- 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2018-06
- Pages
- 1828-1837
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2798559986
- Cited by
- 1,309
- References
- 53
- FWCI
- 129.36
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.