The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Deep-STORM: super-resolution single-molecule microscopy by deep learning
Open accessAbstract
We present an ultra-fast, precise, parameter-free method, which we term Deep-STORM, for obtaining super-resolution images from stochastically-blinking emitters, such as fluorescent molecules used for localization microscopy. Deep-STORM uses a deep convolutional neural network that can be trained on simulated data or experimental measurements, both of which are demonstrated. The method achieves state-of-the-art resolution under challenging signal-to-noise conditions and high emitter densities, and is significantly faster than existing approaches. Additionally, no prior information on the shape of the underlying structure is required, making the method applicable to any blinking data-set. We validate our approach by super-resolution image reconstruction of simulated and experimentally obtained data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Fiji: an open-source platform for biological-image analysis
Schindelin, J., Arganda-Carreras, I., Frise, E., Kaynig, V., Longair, M., Pietzsch, T., Preibisch, S., Rueden, C., Saalfeld, S., Schmid, B., et al. (2012) · Nature Methods · doi:10.1038/nmeth.2019 · Cited by 66,890
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
Proceedings of IEEE International Conference on Computer Vision
(1995) · Proceedings of IEEE International Conference on Computer Vision · doi:10.1109/iccv.1995.466933 · Cited by 12,860
Proceedings of the 24th international conference on Machine learning
(2007) · doi:10.1145/1273496 · Cited by 11,630
Image Super-Resolution Using Deep Convolutional Networks
Dong, C., Loy, C. C., He, K., & Tang, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2439281 · Cited by 10,105
Imaging Intracellular Fluorescent Proteins at Nanometer Resolution
Betzig, E., Patterson, G. H., Sougrat, R., Lindwasser, O. W., Olenych, S., Bonifacino, J. S., Davidson, M. W., Lippincott-Schwartz, J., & Hess, H. F. (2006) · Science · doi:10.1126/science.1127344 · Cited by 8,772
Sub-diffraction-limit imaging by stochastic optical reconstruction microscopy (STORM)
Rust, M. J., Bates, M., & Zhuang, X. (2006) · Nature Methods · doi:10.1038/nmeth929 · Cited by 8,078
Accurate Image Super-Resolution Using Very Deep Convolutional Networks
Kim, J., Lee, J. K., & Lee, K. M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.182 · Cited by 7,870
Hell, S. W., & Wichmann, J. (1994) · Optics Letters · doi:10.1364/ol.19.000780 · Cited by 6,065
ImageJ2: ImageJ for the next generation of scientific image data
Rueden, C. T., Schindelin, J., Hiner, M. C., DeZonia, B. E., Walter, A. E., Arena, E. T., & Eliceiri, K. W. (2017) · BMC Bioinformatics · doi:10.1186/s12859-017-1934-z · Cited by 5,980
Learning Deconvolution Network for Semantic Segmentation
Noh, H., Hong, S., & Han, B. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.178 · Cited by 4,422
Gustafsson, M. G. L. (2000) · Journal of Microscopy · doi:10.1046/j.1365-2818.2000.00710.x · Cited by 3,786
Ultra-High Resolution Imaging by Fluorescence Photoactivation Localization Microscopy
Hess, S. T., Girirajan, T. P. K., & Mason, M. D. (2006) · Biophysical Journal · doi:10.1529/biophysj.106.091116 · Cited by 3,605
Ovesný, M., Křížek, P., Borkovec, J., Švindrych, Z., & Hagen, G. M. (2014) · Bioinformatics · doi:10.1093/bioinformatics/btu202 · Cited by 1,506
Mao, X.-J., Shen, C., & Yang, Y.-B. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.09056 · Cited by 1,263
Method of obtaining optical sectioning by using structured light in a conventional microscope
Neil, M. A. A., Juškaitis, R., & Wilson, T. (1997) · Optics Letters · doi:10.1364/ol.22.001905 · Cited by 1,143
Fast, background-free, 3D super-resolution optical fluctuation imaging (SOFI)
Dertinger, T., Colyer, R., Iyer, G., Weiss, S., & Enderlein, J. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0907866106 · Cited by 1,130
Subdiffraction resolution in far-field fluorescence microscopy
Klar, T. A., & Hell, S. W. (1999) · Optics Letters · doi:10.1364/ol.24.000954 · Cited by 864
Deep Networks for Image Super-Resolution with Sparse Prior
Wang, Z., Liu, D., Yang, J., Han, W., & Huang, T. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.50 · Cited by 784
Rivenson, Y., Göröcs, Z., Günaydin, H., Zhang, Y., Wang, H., & Ozcan, A. (2017) · Optica · doi:10.1364/optica.4.001437 · Cited by 643
Dynamic multiple-target tracing to probe spatiotemporal cartography of cell membranes
Sergé, A., Bertaux, N., Rigneault, H., & Marguet, D. (2008) · Nature Methods · doi:10.1038/nmeth.1233 · Cited by 632
Gustafsson, N., Culley, S., Ashdown, G., Owen, D. M., Pereira, P. M., & Henriques, R. (2016) · Nature Communications · doi:10.1038/ncomms12471 · Cited by 626
Computer Vision and Pattern Recognition: CVPR 92
Brill, M. H. (1992) · Color Research & Application · doi:10.1002/col.5080170616 · Cited by 572
Faster STORM using compressed sensing
Zhu, L., Zhang, W., Elnatan, D., & Huang, B. (2012) · Nature Methods · doi:10.1038/nmeth.1978 · Cited by 518
Microscopy cell counting and detection with fully convolutional regression networks
Xie, W., Noble, J. A., & Zisserman, A. (2018) · Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization · doi:10.1080/21681163.2016.1149104 · Cited by 450
DAOSTORM: an algorithm for high- density super-resolution microscopy
Holden, S. J., Uphoff, S., & Kapanidis, A. N. (2011) · Nature Methods · doi:10.1038/nmeth0411-279 · Cited by 440
Bayesian localization microscopy reveals nanoscale podosome dynamics
Cox, S., Rosten, E., Monypenny, J., Jovanović‐Talisman, T., Burnette, D. T., Lippincott‐Schwartz, J., Jones, G. E., & Heintzmann, R. (2011) · Nature Methods · doi:10.1038/nmeth.1812 · Cited by 432
Quantitative evaluation of software packages for single-molecule localization microscopy
Sage, D., Kirshner, H., Pengo, T., Stuurman, N., Min, J., Manley, S., & Unser, M. (2015) · Nature Methods · doi:10.1038/nmeth.3442 · Cited by 396
Single-molecule high-resolution imaging with photobleaching
Gordon, M. P., Ha, T., & Selvin, P. R. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0401638101 · Cited by 372
Simultaneous multiple-emitter fitting for single molecule super-resolution imaging
Huang, F., Schwartz, S. L., Byars, J. M., & Lidke, K. A. (2011) · Biomedical Optics Express · doi:10.1364/boe.2.001377 · Cited by 311
Nanometer-localized multiple single-molecule fluorescence microscopy
Qu, X., Wu, D., Mets, L., & Scherer, N. F. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0402155101 · Cited by 304
Super-resolution fluorescence imaging with single molecules
Sahl, S. J., & Moerner, W. E. (2013) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2013.07.010 · Cited by 157
FALCON: fast and unbiased reconstruction of high-density super-resolution microscopy data
Min, J., Vonesch, C., Kirshner, H., Carlini, L., Olivier, N., Holden, S. J., Manley, S., Ye, J. C., & Unser, M. A. (2014) · Scientific Reports · doi:10.1038/srep04577 · Cited by 153
2014 Conference on Lasers and Electro-Optics (CLEO 2014)Preprint
Mahler, D. H., Rozema, L. A., Bonsma-Fisher, K., Vermeyden, L., Resch, K. J., Braverman, B., Wiseman, H. M., & Steinberg, A. M. (2015) · arXiv (Cornell University) · Cited by 124
Sparse deconvolution of high-density super-resolution images
Hugelier, S., de Rooi, J. J., Bernex, R., et al. (2016) · Scientific Reports · doi:10.1038/srep21413 · Cited by 78
Three-dimensional super-resolution and localization of dense clusters of single molecules
Barsic, A. J., Grover, G., & Piestun, R. (2014) · Scientific Reports · doi:10.1038/srep05388 · Cited by 46
SPARCOM: Sparsity Based Super-resolution Correlation Microscopy
Solomon, O., Eldar, Y. C., Mutzafi, M., & Segev, M. (2019) · SIAM Journal on Imaging Sciences · doi:10.1137/18m1174921 · Cited by 37
Cited by
Super-resolution microscopy demystified
Schermelleh, L., Ferrand, A., Huser, T., Eggeling, C., Sauer, M., Biehlmaier, O., & Drummen, G. P. C. (2019) · Nature Cell Biology · doi:10.1038/s41556-018-0251-8 · Cited by 1,211
Content-aware image restoration: pushing the limits of fluorescence microscopy
Weigert, M., Schmidt, U., Boothe, T., Müller, A., Dibrov, A., Jain, A., Wilhelm, B., Schmidt, D., Broaddus, C., Culley, S., et al. (2018) · Nature Methods · doi:10.1038/s41592-018-0216-7 · Cited by 1,197
Inference in artificial intelligence with deep optics and photonics
Wetzstein, G., Ozcan, A., Gigan, S., Fan, S., Englund, D., Soljačić, M., Denz, C., Miller, D. A. B., & Psaltis, D. (2020) · Nature · doi:10.1038/s41586-020-2973-6 · Cited by 1,031
On the use of deep learning for computational imaging
Barbastathis, G., Ozcan, A., & Situ, G. (2019) · Optica · doi:10.1364/optica.6.000921 · Cited by 869
Deep learning enables cross-modality super-resolution in fluorescence microscopy
Wang, H., Rivenson, Y., Jin, Y., Wei, Z., Gao, R., Günaydın, H., Bentolila, L. A., Kural, C., & Ozcan, A. (2019) · Nature Methods · doi:10.1038/s41592-018-0239-0 · Cited by 782
Metadata
- Authors
- Nehme, E., Weiss, L. E., Michaeli, T., & Shechtman, Y.
- Venue
- Optica
- Publisher
- Optica Publishing Group
- Published
- 2018-04-12
- Volume
- 5
- Issue
- 4
- Pages
- 458
- ISSN
- 2334-2536 (ISSN-L)
- OpenAlex
- W2787020583
- Cited by
- 604
- References
- 42
- FWCI
- 34.38
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.