The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Imaging through glass diffusers using densely connected convolutional networks
Open accessAbstract
Computational imaging through scatter generally is accomplished by first characterizing the scattering medium so that its forward operator is obtained and then imposing additional priors in the form of regularizers on the reconstruction functional to improve the condition of the originally ill-posed inverse problem. In the functional, the forward operator and regularizer must be entered explicitly or parametrically (e.g., scattering matrices and dictionaries, respectively). However, the process of determining these representations is often incomplete, prone to errors, or infeasible. Recently, deep learning architectures have been proposed to instead learn both the forward operator and regularizer through examples. Here, we propose for the first time, to our knowledge, a convolutional neural network architecture called “IDiffNet” for the problem of imaging through diffuse media and demonstrate that IDiffNet has superior generalization capability through extensive tests with well-calibrated diffusers. We also introduce the negative Pearson correlation coefficient (NPCC) loss function for neural net training and show that the NPCC is more appropriate for spatially sparse objects and strong scattering conditions. Our results show that the convolutional architecture is robust to the choice of prior, as demonstrated by the use of multiple training and testing object databases, and capable of achieving higher space–bandwidth product reconstructions than previously reported.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
Badrinarayanan, V., Kendall, A., & Cipolla, R. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2644615 · Cited by 19,631
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Candes, E. J., Romberg, J., & Tao, T. (2006) · IEEE Transactions on Information Theory · doi:10.1109/tit.2005.862083 · Cited by 15,639
Two-photon laser scanning fluorescence microscopy
Denk, W., Strickler, J. H., & Webb, W. W. (1990) · Science · doi:10.1126/science.2321027 · Cited by 9,488
Hell, S. W., & Wichmann, J. (1994) · Optics Letters · doi:10.1364/ol.19.000780 · Cited by 6,065
Gustafsson, M. G. L. (2000) · Journal of Microscopy · doi:10.1046/j.1365-2818.2000.00710.x · Cited by 3,786
Deep Convolutional Neural Network for Inverse Problems in Imaging
Jin, K. H., McCann, M. T., Froustey, E., & Unser, M. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2713099 · Cited by 2,529
Popoff, S. M., Lerosey, G., Carminati, R., Fink, M., Boccara, A. C., & Gigan, S. (2010) · Physical Review Letters · doi:10.1103/physrevlett.104.100601 · Cited by 1,854
Reconstruction of an object from the modulus of its Fourier transform
Fienup, J. R. (1978) · Optics Letters · doi:10.1364/ol.3.000027 · Cited by 1,836
Non-invasive imaging through opaque scattering layers
Bertolotti, J., van Putten, E. G., Blum, C., Lagendijk, A., Vos, W. L., & Mosk, A. P. (2012) · Nature · doi:10.1038/nature11578 · Cited by 1,183
Katz, O., Heidmann, P., Fink, M., & Gigan, S. (2014) · Nature Photonics · doi:10.1038/nphoton.2014.189 · Cited by 1,157
Correlations and Fluctuations of Coherent Wave Transmission through Disordered Media
Feng, S., Kane, C., Lee, P. A., & Stone, A. D. (1988) · Physical Review Letters · doi:10.1103/physrevlett.61.834 · Cited by 851
Memory Effects in Propagation of Optical Waves through Disordered Media
Freund, I., Rosenbluh, M., & Feng, S. (1988) · Physical Review Letters · doi:10.1103/physrevlett.61.2328 · Cited by 803
Image transmission through an opaque material
Popoff, S., Lerosey, G., Fink, M., Boccara, A. C., & Gigan, S. (2010) · Nature Communications · doi:10.1038/ncomms1078 · Cited by 755
Lensless computational imaging through deep learning
Sinha, A., Lee, J., Li, S., & Barbastathis, G. (2017) · Optica · doi:10.1364/optica.4.001117 · Cited by 703
Self-citationDiffuserCam: lensless single-exposure 3D imaging
Antipa, N., Kuo, G., Heckel, R., Mildenhall, B., Bostan, E., Ng, R., & Waller, L. (2018) · Optica · doi:10.1364/optica.5.000001 · Cited by 626
Brady, D. J., Choi, K., Marks, D. L., Horisaki, R., & Lim, S. (2009) · Optics Express · doi:10.1364/oe.17.013040 · Cited by 509
Membrane imaging by second-harmonic generation microscopy
Moreaux, L., Sandre, O., & Mertz, J. (2000) · Journal of the Optical Society of America B · doi:10.1364/josab.17.001685 · Cited by 345
Drémeau, A., Antoine Liutkus, A., Martina, D., Katz, O., Schülke, C., Krząkała, F., Gigan, S., & Daudet, L. (2015) · Optics Express · doi:10.1364/oe.23.011898 · Cited by 300
Learning-based imaging through scattering media
Horisaki, R., Takagi, R., & Tanida, J. (2016) · Optics Express · doi:10.1364/oe.24.013738 · Cited by 225
Wide-field fluorescence sectioning with hybrid speckle and uniform-illumination microscopy
Lim, D., Chu, K. K., & Mertz, J. (2008) · Optics Letters · doi:10.1364/ol.33.001819 · Cited by 196
Object classification through scattering media with deep learning on time resolved measurement
Satat, G., Tancik, M., Gupta, O., Heshmat, B., & Raskar, R. (2017) · Optics Express · doi:10.1364/oe.25.017466 · Cited by 143
Widefield lensless imaging through a fiber bundle via speckle correlations
Porat, A., Andresen, E. R., Rigneault, H., Oron, D., Gigan, S., & Katz, O. (2016) · Optics Express · doi:10.1364/oe.24.016835 · Cited by 140
Single-shot diffuser-encoded light field imaging
Antipa, N., Sylvia, N., Ng, R., et al. (2016) · IEEE International Conference on Computational Photography (ICCP) · doi:10.1109/iccphot.2016.7492880 · Cited by 58
Optical sectioning in fluorescence microscopy
Wilson, T. (2010) · Journal of Microscopy · doi:10.1111/j.1365-2818.2010.03457.x · Cited by 54
Hierarchical classification of images by sparse approximation
Kim, B., Park, J. Y., Gilbert, A. C., & Savarese, S. (2013) · Image and Vision Computing · doi:10.1016/j.imavis.2013.10.005 · Cited by 9
Cited by
On the use of deep learning for computational imaging
Barbastathis, G., Ozcan, A., & Situ, G. (2019) · Optica · doi:10.1364/optica.6.000921 · Cited by 869
Self-citationDeep learning in optical metrology: a review
Zuo, C., Qian, J., Feng, S., Yin, W., Li, Y., Fan, P., Han, J., Qian, K., & Chen, Q. (2022) · Light: Science & Applications · doi:10.1038/s41377-022-00714-x · Cited by 711
Deep learning for tomographic image reconstruction
Wang, G., Ye, J. C., & De Man, B. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-00273-z · Cited by 531
Deep speckle correlation: a deep learning approach toward scalable imaging through scattering media
Li, Y., Xue, Y., & Tian, L. (2018) · Optica · doi:10.1364/optica.5.001181 · Cited by 527
Phase imaging with an untrained neural network
Wang, F., Bian, Y., Wang, H., Lyu, M., Pedrini, G., Osten, W., Barbastathis, G., & Situ, G. (2020) · Light: Science & Applications · doi:10.1038/s41377-020-0302-3 · Cited by 503
Self-citation
Metadata
- Authors
- Li, S., Deng, M., Lee, J., Sinha, A., & Barbastathis, G.
- Venue
- Optica
- Publisher
- Optica Publishing Group
- Published
- 2018-07-06
- Volume
- 5
- Issue
- 7
- Pages
- 803
- ISSN
- 2334-2536 (ISSN-L)
- OpenAlex
- W2963698847
- Cited by
- 435
- References
- 28
- FWCI
- 15.36
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.