The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Deep learning approach for Fourier ptychography microscopy
Open accessAbstract
Convolutional neural networks (CNNs) have gained tremendous success in solving complex inverse problems. The aim of this work is to develop a novel CNN framework to reconstruct video sequences of dynamic live cells captured using a computational microscopy technique, Fourier ptychographic microscopy (FPM). The unique feature of the FPM is its capability to reconstruct images with both wide field-of-view (FOV) and high resolution, i.e. a large space-bandwidth-product (SBP), by taking a series of low resolution intensity images. For live cell imaging, a single FPM frame contains thousands of cell samples with different morphological features. Our idea is to fully exploit the statistical information provided by these large spatial ensembles so as to make predictions in a sequential measurement, without using any additional temporal dataset. Specifically, we show that it is possible to reconstruct high-SBP dynamic cell videos by a CNN trained only on the first FPM dataset captured at the beginning of a time-series experiment. Our CNN approach reconstructs a 12800×10800 pixel phase image using only ∼25 seconds, a 50× speedup compared to the model-based FPM algorithm. In addition, the CNN further reduces the required number of images in each time frame by ∼ 6×. Overall, this significantly improves the imaging throughput by reducing both the acquisition and computational times. The proposed CNN is based on the conditional generative adversarial network (cGAN) framework. We further propose a mixed loss function that combines the standard image domain loss and a weighted Fourier domain loss, which leads to improved reconstruction of the high frequency information. Additionally, we also exploit transfer learning so that our pre-trained CNN can be further optimized to image other cell types. Our technique demonstrates a promising deep learning approach to continuously monitor large live-cell populations over an extended time and gather useful spatial and temporal information with sub-cellular resolution.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
Boyd, S., Parikh, N., Chu, E., Peleato, B., & Eckstein, J. (2011) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000016 · Cited by 17,075
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
Beck, A., & Teboulle, M. (2009) · SIAM Journal on Imaging Sciences · doi:10.1137/080716542 · Cited by 11,952
Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising
Zhang, K., Zuo, W., Chen, Y., Meng, D., & Zhang, L. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2662206 · Cited by 8,983
Deep Convolutional Neural Network for Inverse Problems in Imaging
Jin, K. H., McCann, M. T., Froustey, E., & Unser, M. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2713099 · Cited by 2,529
Wide-field, high-resolution Fourier ptychographic microscopy
Zheng, G., Horstmeyer, R., & Yang, C. (2013) · Nature Photonics · doi:10.1038/nphoton.2013.187 · Cited by 1,829
Fast Image Recovery Using Variable Splitting and Constrained Optimization
Afonso, M. V., Bioucas-Dias, J. M., & Figueiredo, M. A. T. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2047910 · Cited by 1,223
Light Microscopy Techniques for Live Cell Imaging
Stephens, D. J., & Allan, V. J. (2003) · Science · doi:10.1126/science.1082160 · Cited by 1,179
Yang, G., Yu, S., Dong, H., Slabaugh, G., Dragotti, P. L., Ye, X., Liu, F., Arridge, S., Keegan, J., Guo, Y., et al. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2785879 · Cited by 1,081
Phase recovery and holographic image reconstruction using deep learning in neural networks
Rivenson, Y., Zhang, Y., Günaydın, H., Teng, D., & Ozcan, A. (2017) · Light: Science & Applications · doi:10.1038/lsa.2017.141 · Cited by 1,059
Lensless computational imaging through deep learning
Sinha, A., Lee, J., Li, S., & Barbastathis, G. (2017) · Optica · doi:10.1364/optica.4.001117 · Cited by 703
Video Super-Resolution With Convolutional Neural Networks
Kappeler, A., Yoo, S., Dai, Q., & Katsaggelos, A. K. (2016) · IEEE Transactions on Computational Imaging · doi:10.1109/tci.2016.2532323 · Cited by 647
Rivenson, Y., Göröcs, Z., Günaydin, H., Zhang, Y., Wang, H., & Ozcan, A. (2017) · Optica · doi:10.1364/optica.4.001437 · Cited by 643
In Silico Labeling: Predicting Fluorescent Labels in Unlabeled Images
Christiansen, E. M., Yang, S. J., Ando, D. M., Javaherian, A., Skibinski, G., Lipnick, S., Mount, E., O’Neil, A., Shah, K., Lee, A. K., et al. (2018) · Cell · doi:10.1016/j.cell.2018.03.040 · Cited by 635
Deep-STORM: super-resolution single-molecule microscopy by deep learning
Nehme, E., Weiss, L. E., Michaeli, T., & Shechtman, Y. (2018) · Optica · doi:10.1364/optica.5.000458 · Cited by 604
Using Deep Neural Networks for Inverse Problems in Imaging: Beyond Analytical Methods
Lucas, A., Iliadis, M., Molina, R., & Katsaggelos, A. K. (2018) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2760358 · Cited by 586
Multiplexed coded illumination for Fourier Ptychography with an LED array microscope
Tian, L., Li, X., Ramchandran, K., & Waller, L. (2014) · Biomedical Optics Express · doi:10.1364/boe.5.002376 · Cited by 584
Self-citationImaging through glass diffusers using densely connected convolutional networks
Li, S., Deng, M., Lee, J., Sinha, A., & Barbastathis, G. (2018) · Optica · doi:10.1364/optica.5.000803 · Cited by 435
Experimental robustness of Fourier ptychography phase retrieval algorithms
Yeh, L.-H., Dong, J., Zhong, J., Tian, L., Chen, M., Tang, G., Soltanolkotabi, M., & Waller, L. (2015) · Optics Express · doi:10.1364/oe.23.033214 · Cited by 320
Self-citationComputational illumination for high-speed in vitro Fourier ptychographic microscopy
Tian, L., Liu, Z., Yeh, L.-H., Chen, M., Zhong, J., & Waller, L. (2015) · Optica · doi:10.1364/optica.2.000904 · Cited by 317
Self-citationLearning-based nonparametric autofocusing for digital holography
Ren, Z., Xu, Z., & Lam, E. Y. (2018) · Optica · doi:10.1364/optica.5.000337 · Cited by 274
Nguyen, T., Bui, V., Lam, V., Raub, C. B., Chang, L.-C., & Nehmetallah, G. (2017) · Optics Express · doi:10.1364/oe.25.015043 · Cited by 221
Self-citationImage Sharpness Measure for Blurred Images in Frequency Domain
De, K., & Masilamani, V. (2013) · Procedia Engineering · doi:10.1016/j.proeng.2013.09.086 · Cited by 156
Learning from Weak and Noisy Labels for Semantic Segmentation
Lu, Z., Fu, Z., Xiang, T., Han, P., Wang, L., & Gao, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2552172 · Cited by 115
Multi-Contrast Imaging and Digital Refocusing on a Mobile Microscope with a Domed LED Array
Phillips, Z. F., D’Ambrosio, M. V., Tian, L., Rulison, J. J., Patel, H. S., Sadras, N., Gande, A. V., Switz, N. A., Fletcher, D. A., & Waller, L. (2015) · PLoS ONE · doi:10.1371/journal.pone.0124938 · Cited by 104
Self-citationOptical lithography of three-dimensional magnetophotonic microdevices
Nguyen, D. T. T., Guercio, O. D., Au, T. H., Trinh, D. T., Mai, N. P. T., & Lai, N. D. (2018) · Optical Engineering · doi:10.1117/1.oe.57.4.041406 · Cited by 26
Cited by
On the use of deep learning for computational imaging
Barbastathis, G., Ozcan, A., & Situ, G. (2019) · Optica · doi:10.1364/optica.6.000921 · Cited by 869
Deep learning for tomographic image reconstruction
Wang, G., Ye, J. C., & De Man, B. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-00273-z · Cited by 531
Concept, implementations and applications of Fourier ptychography
Zheng, G., Shen, C., Jiang, S., Song, P., & Yang, C. (2021) · Nature Reviews Physics · doi:10.1038/s42254-021-00280-y · Cited by 416
DeepSTORM3D: dense 3D localization microscopy and PSF design by deep learning
Nehme, E., Freedman, D., Gordon, R., Ferdman, B., Weiss, L. E., Alalouf, O., Naor, T., Orange, R., Michaeli, T., & Shechtman, Y. (2020) · Nature Methods · doi:10.1038/s41592-020-0853-5 · Cited by 311
Reliable deep-learning-based phase imaging with uncertainty quantification
Xue, Y., Cheng, S., Li, Y., & Tian, L. (2019) · Optica · doi:10.1364/optica.6.000618 · Cited by 198
Self-citation
Metadata
- Authors
- Nguyen, T., Xue, Y., Li, Y., Tian, L., & Nehmetallah, G.
- Venue
- Optics Express
- Publisher
- Optica Publishing Group
- Published
- 2018-09-26
- Volume
- 26
- Issue
- 20
- Pages
- 26470
- ISSN
- 1094-4087 (ISSN-L)
- OpenAlex
- W2884332829
- Cited by
- 261
- References
- 29
- FWCI
- 11.68
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.