The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Reliable deep-learning-based phase imaging with uncertainty quantification
Open accessAbstract
Emerging deep-learning (DL)-based techniques have significant potential to revolutionize biomedical imaging. However, one outstanding challenge is the lack of reliability assessment in the DL predictions, whose errors are commonly revealed only in hindsight. Here, we propose a new Bayesian convolutional neural network (BNN)-based framework that overcomes this issue by quantifying the uncertainty of DL predictions. Foremost, we show that BNN-predicted uncertainty maps provide surrogate estimates of the true error from the network model and measurement itself. The uncertainty maps characterize imperfections often unknown in real-world applications, such as noise, model error, incomplete training data, and out-of-distribution testing data. Quantifying this uncertainty provides a per-pixel estimate of the confidence level of the DL prediction as well as the quality of the model and data set. We demonstrate this framework in the application of large space-bandwidth product phase imaging using a physics-guided coded illumination scheme. From only five multiplexed illumination measurements, our BNN predicts gigapixel phase images in both static and dynamic biological samples with quantitative credibility assessment. Furthermore, we show that low-certainty regions can identify spatially and temporally rare biological phenomena. We believe our uncertainty learning framework is widely applicable to many DL-based biomedical imaging techniques for assessing the reliability of DL predictions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“LaBonte al. [686] | et | 2019 | 3D Bayesian | Segmentation | Material data (CT scans) | 2 | VI”
From A review of uncertainty quantification in deep learning: Techniques, applications and challenges (2021) · cites this paper as [686]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
(2014) · Cited by 33,419
Image-to-Image Translation with Conditional Adversarial Networks
Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.632 · Cited by 22,930
(2010) · Cited by 14,134
Advances in Neural Information Processing Systems 29
Teymur, O., Zygalakis, K., & Calderhead, B. (2016) · Cited by 13,881
Dropout as a bayesian approximation: Representing model uncertainty in deep learning
Gal, Y., & Ghahramani, Z. (2015) · arXiv · doi:10.48550/arxiv.1506.02142 · Cited by 6,471
Large-Scale Machine Learning with Stochastic Gradient Descent
Bottou, L. (2010) · Proceedings of COMPSTAT'2010 · doi:10.1007/978-3-7908-2604-3_16 · Cited by 5,795
Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles
Lakshminarayanan, B., Pritzel, A., & Blundell, C. (2016) · arXiv · doi:10.48550/arxiv.1612.01474 · Cited by 3,666
What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?
Kendall, A., & Gal, Y. (2017) · arXiv · doi:10.48550/arxiv.1703.04977 · Cited by 3,088
Aleatory or epistemic? Does it matter?
Kiureghian, A. D., & Ditlevsen, O. (2009) · Structural Safety · doi:10.1016/j.strusafe.2008.06.020 · Cited by 2,454
Probabilistic machine learning and artificial intelligence
Ghahramani, Z. (2015) · Nature · doi:10.1038/nature14541 · Cited by 1,995
Predicting good probabilities with supervised learning
Niculescu-Mizil, A., & Caruana, R. (2005) · Proceedings of the 22nd international conference on Machine learning - ICML '05 · doi:10.1145/1102351.1102430 · Cited by 1,884
Wide-field, high-resolution Fourier ptychographic microscopy
Zheng, G., Horstmeyer, R. W., & Yang, C. (2013) · Nature Photonics · doi:10.1038/nphoton.2013.187 · Cited by 1,846
Content-aware image restoration: pushing the limits of fluorescence microscopy
WEIGERT, M. G., Schmidt, U., Boothe, T., Müller, A., Dibrov, A., Jain, A., Wilhelm, B. G., Schmidt, D., Broaddus, C., Culley, S., et al. (2018) · Nature Methods · doi:10.1038/s41592-018-0216-7 · Cited by 1,208
Phase recovery and holographic image reconstruction using deep learning in neural networks
Rivenson, Y., Zhang, Y., Günaydın, H., Teng, D., & Özcan, A. (2017) · Light Science & Applications · doi:10.1038/lsa.2017.141 · Cited by 1,097
Ghiglia, D. C., & Romero, L. A. (1994) · Journal of the Optical Society of America A · doi:10.1364/josaa.11.000107 · Cited by 1,068
Lensless computational imaging through deep learning
Sinha, A., Lee, J. W., Li, S., & Barbastathis, G. (2017) · Optica · doi:10.1364/optica.4.001117 · Cited by 713
Multiplexed coded illumination for Fourier Ptychography with an LED array microscope
Tian, L., Li, X., Ramchandran, K., & Waller, L. (2014) · Biomedical Optics Express · doi:10.1364/boe.5.002376 · Cited by 589
Self-citationDeep speckle correlation: a deep learning approach toward scalable imaging through scattering media
Li, Y., Xue, Y., & Tian, L. (2018) · Optica · doi:10.1364/optica.5.001181 · Cited by 570
Self-citationLarge-Scale Machine Learning with Stochastic Gradient Descent
Bottou, L. (2011) · Chapman & Hall/CRC series in computer science & data analysis/Series in computer science and data analysis · doi:10.1201/b11429-4 · Cited by 536
Accurate Uncertainties for Deep Learning Using Calibrated RegressionPreprint
Kuleshov, V., Fenner, N., & Ermon, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.00263 · Cited by 455
Embedded pupil function recovery for Fourier ptychographic microscopy
Ou, X., Zheng, G., & Yang, C. (2014) · Optics Express · doi:10.1364/oe.22.004960 · Cited by 451
Imaging through glass diffusers using densely connected convolutional networks
Li, S., Deng, M., Lee, J. W., Sinha, A., & Barbastathis, G. (2018) · Optica · doi:10.1364/optica.5.000803 · Cited by 441
Space–bandwidth product of optical signals and systems
Lohmann, A. W., Dorsch, R. G., David Mendlovic, B., Ferreira, C., & Zalevsky, Z. (1996) · Journal of the Optical Society of America A · doi:10.1364/josaa.13.000470 · Cited by 400
Quantitative differential phase contrast imaging in an LED array microscope
Tian, L., & Waller, L. (2015) · Optics Express · doi:10.1364/oe.23.011394 · Cited by 399
Self-citationOptical Systems with Resolving Powers Exceeding the Classical Limit*
Lukosz, W. (1966) · Journal of the Optical Society of America · doi:10.1364/josa.56.001463 · Cited by 365
Experimental robustness of Fourier ptychography phase retrieval algorithms
Yeh, L.-H., Dong, J., Zhong, J., Tian, L., Chen, M., Tang, G., Soltanolkotabi, M., & Waller, L. (2015) · Optics Express · doi:10.1364/oe.23.033214 · Cited by 350
Self-citationComputational illumination for high-speed in vitro Fourier ptychographic microscopy
Tian, L., Liu, Z., Yeh, L.-H., Chen, M., Zhong, J., & Waller, L. (2015) · Optica · doi:10.1364/optica.2.000904 · Cited by 350
Self-citationWu, Y., Rivenson, Y., Zhang, Y., Wei, Z., Günaydin, H., Lin, X., & Özcan, A. (2018) · Optica · doi:10.1364/optica.5.000704 · Cited by 350
Optical Systems with Resolving Powers Exceeding the Classical Limit II
Lukosz, W. (1967) · Journal of the Optical Society of America · doi:10.1364/josa.57.000932 · Cited by 332
Deep learning approach for Fourier ptychography microscopy
Nguyen, T., Xue, Y., Li, Y., Tian, L., & Nehmetallah, G. (2018) · Optics Express · doi:10.1364/oe.26.026470 · Cited by 293
Self-citationMehta, S. B., & Sheppard, C. J. R. (2009) · Optics Letters · doi:10.1364/ol.34.001924 · Cited by 226
Efficient positional misalignment correction method for Fourier ptychographic microscopy
Sun, J., Chen, Q., Zhang, Y., & Zuo, C. (2016) · Biomedical Optics Express · doi:10.1364/boe.7.001336 · Cited by 192
Lohmann, A. W. (1989) · Applied Optics · doi:10.1364/ao.28.004996 · Cited by 181
Hillman, T. R., Gutzler, T., Alexandrov, S., & Sampson, D. D. (2009) · Optics Express · doi:10.1364/oe.17.007873 · Cited by 162
Physics-Based Learned Design: Optimized Coded-Illumination for Quantitative Phase Imaging
Kellman, M., Bostan, E., Repina, N. A., & Waller, L. (2019) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2019.2905434 · Cited by 160
Content-Aware Image Restoration: Pushing the Limits of Fluorescence MicroscopyPreprint
WEIGERT, M. G., Schmidt, U., Boothe, T., et al. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/236463 · Cited by 156
Efficient illumination angle self-calibration in Fourier ptychography
Eckert, R., Phillips, Z. F., & Waller, L. (2018) · Applied Optics · doi:10.1364/ao.57.005434 · Cited by 120
High-throughput intensity diffraction tomography with a computational microscope
Ling, R., Tahir, W., Lin, H.-Y., Lee, H., & Tian, L. (2018) · Biomedical Optics Express · doi:10.1364/boe.9.002130 · Cited by 119
Self-citationEfficient illumination angle self-calibration in Fourier ptychography
Eckert, R. F., Phillips, Z. F., & Waller, L. (n.d.) · UC Berkeley · Cited by 114
Optimal illumination scheme for isotropic quantitative differential phase contrast microscopy
Fan, Y., Sun, J., Chen, Q., Pan, X., Tian, L., & Zuo, C. (2019) · Photonics Research · doi:10.1364/prj.7.000890 · Cited by 96
Self-citationResolving a misconception about structured illumination
Wicker, K., & Heintzmann, R. (2014) · Nature Photonics · doi:10.1038/nphoton.2014.88 · Cited by 92
Convolutional neural networks that teach microscopes how to imagePreprint
Horstmeyer, R. W., Chen, R. Y., Kappes, B., & Judkewitz, B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.07223 · Cited by 55
Using machine-learning to optimize phase contrast in a low-cost cellphone microscope
Diederich, B., Wartmann, R., Schadwinkel, H., & Heintzmann, R. (2018) · PLoS ONE · doi:10.1371/journal.pone.0192937 · Cited by 40
Optimal physical preprocessing for example-based super-resolution
Robey, A., & Ganapati, V. (2018) · Optics Express · doi:10.1364/oe.26.031333 · Cited by 22
Accelerated Wirtinger Flow for Multiplexed Fourier Ptychographic Microscopy
Bostan, E., Soltanolkotabi, M., Ren, D., & Waller, L. (2018) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2018.8451437 · Cited by 20
Coded aperture ptychography: uniqueness and reconstruction
Chen, P., & Fannjiang, A. (2017) · Inverse Problems · doi:10.1088/1361-6420/aa9ef4 · Cited by 15
Probabilistic Machine Learning and Artificial Intelligence
Kapoor, M. (2024) · Spectrum of Emerging Sciences · doi:10.55878/ses2023-3-2-5 · Cited by 12
Optimal illumination scheme for isotropic quantitative differential phase contrast microscopyPreprint
Fan, Y., Sun, J., Chen, Q., Pan, X., Tian, L., & Zuo, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.10718 · Cited by 3
Self-citation
Research works printed but not linked: 1
- Srivastava, 2014, J. Mach. Learn. Res., 15, 1929
Cited by
Sorted by citations
A review of uncertainty quantification in deep learning: Techniques, applications and challenges
Abdar, M., Pourpanah, F., Hussain, S., Rezazadegan, D., Liu, L., Ghavamzadeh, M., Fieguth, P., Cao, X., Khosravi, A., Acharya, U. R., et al. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.05.008 · Cited by 3,111
Phase imaging with an untrained neural network
Wang, F., Bian, Y., Wang, H., Lyu, M., Pedrini, G., Osten, W., Barbastathis, G., & Situ, G. (2020) · Light Science & Applications · doi:10.1038/s41377-020-0302-3 · Cited by 508
Concept, implementations and applications of Fourier ptychography
Zheng, G., Shen, C., Jiang, S., Song, P., & Yang, C. (2021) · Nature Reviews Physics · doi:10.1038/s42254-021-00280-y · Cited by 424
Şahin, E., Arslan, N. N., & Özdemir, D. (2024) · Neural Computing and Applications · doi:10.1007/s00521-024-10437-2 · Cited by 358
DeepCGH: 3D computer-generated holography using deep learning
Eybposh, M. H., Caira, N. W., Atisa, M., Chakravarthula, P., & Pégard, N. C. (2020) · Optics Express · doi:10.1364/oe.399624 · Cited by 263
Metadata
- Authors
- Xue, Y., Cheng, S., Li, Y., & Tian, L.
- Affiliations
- Boston University (US)
- Corresponding author
- Tian, Lei
- Venue
- Optica
- Publisher
- Optica Publishing Group
- Published
- 2019-05-07
- Volume
- 6
- Issue
- 5
- Pages
- 618
- ISSN
- 2334-2536 (ISSN-L)
- PMC
- PMC8329751
- OpenAlex
- W2909560691
- Cited by
- 198
- References
- 48
- Citations by year
- 2026: 13 · 2025: 28 · 2024: 23 · 2023: 21 · 2022: 32 · 2021: 41 · 2020: 30 · 2019: 10
- FWCI
- 12.44
- Type
- journal article
- Language
- en
- Update notices
- correction (2020-04-09)
- Open access
- gold
- doi.org
- Locations
- Optica (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- arXiv (Cornell University) (submittedVersion)
- OpenBU (Boston University) (submittedVersion)
- Figshare (submittedVersion, cc-by)
- arXiv (Cornell University)
- Funders
- National Science Foundation (1813848)
- National Institutes of Health (R21GM128020)
- Topics
- Physical Sciences › Physics and Astronomy › Atomic and Molecular Physics, and Optics › Digital Holography and Microscopy
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Optical measurement and interference techniques
- Physical Sciences › Physics and Astronomy › Atomic and Molecular Physics, and Optics › Random lasers and scattering media
- Keywords
- phase imaging, uncertainty quantification, Bayesian convolutional neural network, coded illumination, confidence map, out-of-distribution prediction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
