The DOI matches its Crossref record; 72 of the 72 references it cites were found in a registry or an index.
Quantitative Comparison of Spot Detection Methods in Fluorescence Microscopy
Abstract
Quantitative analysis of biological image data generally involves the detection of many subresolution spots. Especially in live cell imaging, for which fluorescence microscopy is often used, the signal-to-noise ratio (SNR) can be extremely low, making automated spot detection a very challenging task. In the past, many methods have been proposed to perform this task, but a thorough quantitative evaluation and comparison of these methods is lacking in the literature. In this paper, we evaluate the performance of the most frequently used detection methods for this purpose. These include seven unsupervised and two supervised methods. We perform experiments on synthetic images of three different types, for which the ground truth was available, as well as on real image data sets acquired for two different biological studies, for which we obtained expert manual annotations to compare with. The results from both types of experiments suggest that for very low SNRs ( approximately 2), the supervised (machine learning) methods perform best overall. Of the unsupervised methods, the detectors based on the so-called h -dome transform from mathematical morphology or the multiscale variance-stabilizing transform perform comparably, and have the advantage that they do not require a cumbersome learning stage. At high SNRs ( > 5), the difference in performance of all considered detectors becomes negligible.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rapid object detection using a boosted cascade of simple features
Viola, P., & Jones, M. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990517 · Cited by 18,300
A Wavelet Tour of Signal Processing
(1999) · Elsevier eBooks · doi:10.1016/b978-0-12-466606-1.x5000-4 · Cited by 16,227
Abràmoff, M. D., Magalhães, P. J., & Ram, S. J. (2004) · Utrecht University Repository (Utrecht University) · Cited by 15,104
Scale-space and edge detection using anisotropic diffusion
Perona, P., & Malik, J. (1990) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.56205 · Cited by 12,119
A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking
Arulampalam, M. S., Maskell, S., Gordon, N., & Clapp, T. (2002) · IEEE Transactions on Signal Processing · doi:10.1109/78.978374 · Cited by 11,502
Mean shift: a robust approach toward feature space analysis
Comaniciu, D., & Meer, P. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.1000236 · Cited by 11,305
Bilateral Filtering for Gray and Color Images
Tomasi, C., & Manduchi, R. (2002) · Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271) · doi:10.1109/iccv.1998.710815 · Cited by 8,177 · cited 1×
“3) Patch-Based Denoising: Noise can also be reduced to some extent while preserving object appearance by using median filtering [39], maximum homogeneity neighbor (MHN) filtering [46], bilateral filtering [47], mean-shift filtering [48], and anisotropic diffusion [49].”
BackgroundImage analysis and mathematical morphology
(1982) · Computer Graphics and Image Processing · doi:10.1016/0146-664x(82)90078-8 · Cited by 8,151
(1986) · Cited by 3,616
Morphological Image Analysis: Principles and Applications
(2000) · Sensor Review · doi:10.1108/sr.2000.08720cae.001 · Cited by 3,537
An extended set of Haar-like features for rapid object detection
Lienhart, R., & Maydt, J. (2003) · Proceedings. International Conference on Image Processing · doi:10.1109/icip.2002.1038171 · Cited by 2,977 · cited 1×
“The first one is the AdaBoost algorith m [60], which is frequently used for object detection in computer vision [60]–[62], and was recently sh own to perform well also for spot detection in molecular bioimaging [32].”
MethodDiscriminant Analysis and Statistical Pattern Recognition.
Hawkins, D. M., & McLachlan, G. J. (1993) · Journal of the American Statistical Association · doi:10.2307/2290355 · Cited by 2,633
Feature detection with automatic scale selection
Lindeberg, T. (1998) · International Journal of Computer Vision · doi:10.1023/a:1008045108935 · Cited by 2,541 · cited 1×
“where the curvature at each pixel of is given by the determinant of the Hessian matrix [35], which itself is known to be a good blob detector [59], where”
BackgroundRobust single-particle tracking in live-cell time-lapse sequences
Jaqaman, K., Loerke, D., Mettlen, M., Kuwata, H., Grinstein, S., Schmid, S. L., & Danuser, G. (2008) · Nature Methods · doi:10.1038/nmeth.1237 · Cited by 1,970
Morphological grayscale reconstruction in image analysis: applications and efficient algorithms
Vincent, L. (1993) · IEEE Transactions on Image Processing · doi:10.1109/83.217222 · Cited by 1,923
Image processing, analysis and machine vision
Saarinen, K. (1994) · Signal Processing · doi:10.1016/0165-1684(94)90202-x · Cited by 1,498
A general framework for object detection
Papageorgiou, C. P., Oren, M., & Poggio, T. (2002) · Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271) · doi:10.1109/iccv.1998.710772 · Cited by 1,438
Feature point tracking and trajectory analysis for video imaging in cell biology
Sbalzarini, I. F., & Koumoutsakos, P. (2005) · Journal of Structural Biology · doi:10.1016/j.jsb.2005.06.002 · Cited by 1,392
The transformation of poisson, binomial and negative-binomial data
ANSCOMBE, F. J. (1948) · Biometrika · doi:10.1093/biomet/35.3-4.246 · Cited by 1,300
An introduction to matched filters
Turin, G. (1960) · IEEE Transactions on Information Theory · doi:10.1109/tit.1960.1057571 · Cited by 1,254
Cell Biology: a Laboratory Handbook
Harris, A. (1995) · Journal of Medical Genetics · doi:10.1136/jmg.32.9.759 · Cited by 1,225
Light Microscopy Techniques for Live Cell Imaging
Stephens, D. J., & Allan, V. J. (2003) · Science · doi:10.1126/science.1082160 · Cited by 1,179
Development and Use of Fluorescent Protein Markers in Living Cells
Lippincott-Schwartz, J., & Patterson, G. H. (2003) · Science · doi:10.1126/science.1082520 · Cited by 992
Discriminant Analysis and Statistical Pattern Recognition
Sapatinas, T. (2005) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2005.00368_10.x · Cited by 942
Quantitative Comparison of Algorithms for Tracking Single Fluorescent Particles
Cheezum, M. K., Walker, W. F., & Guilford, W. H. (2001) · Biophysical Journal · doi:10.1016/s0006-3495(01)75884-5 · Cited by 896
Stepanova, T., Slemmer, J., Hoogenraad, C. C., Lansbergen, G., Dortland, B., De Zeeuw, C. I., Grosveld, F., van Cappellen, G., Akhmanova, A., & Galjart, N. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-07-02655.2003 · Cited by 698
ImageJ: Image processing and analysis in Java
Rasband, W. S. (2012) · Astrophysics Source Code Library · Cited by 566
Extraction of spots in biological images using multiscale products
Olivo-Marin, J.-C. (2002) · Pattern Recognition · doi:10.1016/s0031-3203(01)00127-3 · Cited by 539
The Undecimated Wavelet Decomposition and its Reconstruction
Starck, J.-L., Fadili, J., & Murtagh, F. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.887733 · Cited by 530
Gaussian approximations of fluorescence microscope point-spread function models
Zhang, B., Zerubia, J., & Olivo-Marin, J.-C. (2007) · Applied Optics · doi:10.1364/ao.46.001819 · Cited by 504
Photobleaching and photoactivation: following protein dynamics in living cells.
Lippincott‐Schwartz, J., Altan‐Bonnet, N., & Patterson, G. H. (2003) · PubMed · Cited by 481
Image Processing and Data Analysis, The Multiscale Approach
Seymour, L., Starck, J. L., Murtagh, F., & Bijaoui, A. (1999) · Journal of the American Statistical Association · doi:10.2307/2669962 · Cited by 467
Sage, D., Neumann, F. R., Hediger, F., Gasser, S. M., & Unser, M. (2005) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.852787 · Cited by 456
Redundant Multiscale Transforms and Their Application for Morphological Component Separation
Starck, J.-L., Elad, M., & Donoho, D. (2004) · Advances in Imaging and Electron Physics · doi:10.1016/s1076-5670(04)32006-9 · Cited by 443
High-throughput fluorescence microscopy for systems biology
Pepperkok, R., & Ellenberg, J. (2006) · Nature Reviews Molecular Cell Biology · doi:10.1038/nrm1979 · Cited by 412
High-throughput RNAi screening by time-lapse imaging of live human cells
Neumann, B., Held, M., Liebel, U., Erfle, H., Rogers, P., Pepperkok, R., & Ellenberg, J. (2006) · Nature Methods · doi:10.1038/nmeth876 · Cited by 379
Free-response methodology: alternate analysis and a new observer-performance experiment.
Chakraborty, D. P., & Winter, L. H. (1990) · Radiology · doi:10.1148/radiology.174.3.2305073 · Cited by 363
Rab6 regulates transport and targeting of exocytotic carriers
Grigoriev, I., Splinter, D., Keijzer, N., Wulf, P. S., Demmers, J., Ohtsuka, T., Modesti, M., Maly, I. V., Grosveld, F., Hoogenraad, C. C., et al. (2007) · Developmental Cell · doi:10.1016/j.devcel.2007.06.010 · Cited by 361
The Transformation of Poisson, Binomial and Negative-Binomial Data
Anscombe, F. J. (1948) · Biometrika · doi:10.2307/2332343 · Cited by 304
Concepts for nanoscale resolution in fluorescence microscopy
Hell, S. W., Dyba, M., & Jakobs, S. (2004) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2004.08.015 · Cited by 288
Microtubule Plus End: A Hub of Cellular Activities
Lansbergen, G., & Akhmanova, A. (2006) · Traffic · doi:10.1111/j.1600-0854.2006.00400.x · Cited by 238
Wavelet-based image estimation: an empirical Bayes approach using Jeffrey's noninformative prior
Figueiredo, M. A. T., & Nowak, R. D. (2001) · IEEE Transactions on Image Processing · doi:10.1109/83.941856 · Cited by 235
Tsien, R. Y. (2003) · PubMed · Cited by 228
Lighting up cells: labelling proteins with fluorophores.
Miyawaki, A., Sakaue-Sawano, A., & Kogure, T. (2003) · PubMed · Cited by 211
Tracking in molecular bioimaging
Meijering, E., Smal, I., & Danuser, G. (2006) · IEEE Signal Processing Magazine · doi:10.1109/msp.2006.1628877 · Cited by 207
Self-citationThomann, D., Rines, D. R., Sorger, P. K., & Danuser, G. (2002) · Journal of Microscopy · doi:10.1046/j.1365-2818.2002.01066.x · Cited by 202
Maximum likelihood analysis of free‐response receiver operating characteristic (FROC) data
Chakraborty, D. P. (1989) · Medical Physics · doi:10.1118/1.596358 · Cited by 202
Genovesio, A., Liedl, T., Emiliani, V., Parak, W. J., Coppey-Moisan, M., & Olivo-Marin, J.-C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.872323 · Cited by 200
Smal, I., Draegestein, K., Galjart, N., Niessen, W., & Meijering, E. (2008) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2008.916964 · Cited by 181
Self-citationComputational imaging in cell biology
Eils, R., & Athale, C. A. (2003) · The Journal of Cell Biology · doi:10.1083/jcb.200302097 · Cited by 166
From micro to nano: recent advances in high-resolution microscopy
Garini, Y., Vermolen, B. J., & Young, I. T. (2005) · Current Opinion in Biotechnology · doi:10.1016/j.copbio.2005.01.003 · Cited by 158
Bonneau, S., Dahan, M., & Cohen, L. D. (2005) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.852794 · Cited by 153
Tracking single particles: a user-friendly quantitative evaluation
Carter, B. C., Shubeita, G. T., & Gross, S. P. (2005) · Physical Biology · doi:10.1088/1478-3967/2/1/008 · Cited by 152
Space-Time Adaptation for Patch-Based Image Sequence Restoration
Boulanger, J., Charles Kervrann, A., & Bouthémy, P. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1064 · Cited by 119
Informatics challenges of high-throughput microscopy
Zhou, X., & Wong, S. T. C. (2006) · IEEE Signal Processing Magazine · doi:10.1109/msp.2006.1628879 · Cited by 114
Multiple object tracking in molecular bioimaging by Rao-Blackwellized marginal particle filtering
Smal, I., Meijering, E. H. W., Draegestein, K., Galjart, N., Grigoriev, I., Akhmanova, A. S., van Royen, M. E., Houtsmuller, A. B., & Niessen, W. J. (2008) · Medical Image Analysis · doi:10.1016/j.media.2008.03.004 · Cited by 94
Self-citation4D imaging to assay complex dynamics in live specimens.
Gerlich, D. W., & Ellenberg, J. (2003) · PubMed · Cited by 88
Two‐dimensional top hat filter for extracting spots and spheres from digital images
Bright, D. S., & Steel, E. B. (1987) · Journal of Microscopy · doi:10.1111/j.1365-2818.1987.tb01340.x · Cited by 75
Bächer, C., Reichenzeller, M., Athale, C. A., Herrmann, H. O., & Eils, R. (2004) · BMC Cell Biology · doi:10.1186/1471-2121-5-45 · Cited by 70
ImageJ as an Image Processing Tool and Library
Abràmoff, M. D. (2007) · Microscopy and Microanalysis · doi:10.1017/s1431927607079652 · Cited by 68
Astronomical image and signal processing: looking at noise, information and scale
Starck, J., & Murtagh, F. D. (2001) · IEEE Signal Processing Magazine · doi:10.1109/79.916319 · Cited by 63
Computational Processing and Analysis of Dynamic Fluorescence Image Data
Dorn, J. F., Danuser, G. M., & Yang, G. (2008) · Methods in cell biology · doi:10.1016/s0091-679x(08)85022-4 · Cited by 60
Intracellular objects tracking
Kalaidzidis, Y. L. (2007) · European Journal of Cell Biology · doi:10.1016/j.ejcb.2007.05.005 · Cited by 59
Detection of molecular particles in live cells via machine learning
Jiang, S., Zhou, X., Kirchhausen, T. L., & Wong, S. T. C. (2007) · Cytometry Part A · doi:10.1002/cyto.a.20404 · Cited by 55
Nowak, J. A., Malowitz, J., Girgenrath, M., Kostek, C. A., Kravetz, A. J., Dominov, J. A., & Miller, J. B. (2004) · BMC Cell Biology · doi:10.1186/1471-2121-5-1 · Cited by 50
Drubin, D. A., Garakani, A., & Silver, P. A. (2006) · BMC Cell Biology · doi:10.1186/1471-2121-7-19 · Cited by 43
Non-parametric regression for patch-based fluorescence microscopy image sequence denoising
Boulanger, J., Sibarita, J., Kervrann, C., & Bouthémy, P. (2008) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2008.4541104 · Cited by 41
Meijering, E. H. W., Smal, I., Dzyubachyk, O., & Olivo‐Marín, J. (2008) · Elsevier eBooks · doi:10.1016/b978-0-12-372578-3.00015-5 · Cited by 40
Self-citationBoulanger, J., Kervrann, C., & Bouthémy, P. (2008) · Medical Image Analysis · doi:10.1016/j.media.2008.06.017 · Cited by 32
Tracking molecular particles in live cells using fuzzy rule‐based system
Jiang, S., Zhou, X., Kirchhausen, T. L., & Wong, S. T. C. (2007) · Cytometry Part A · doi:10.1002/cyto.a.20411 · Cited by 18
Ahmed, W. M., Leavesley, S. J., Rajwa, B. P., Ayyaz, M., Ghafoor, A., & Robinson, J. P. (2008) · Proceedings of the IEEE · doi:10.1109/jproc.2007.913556 · Cited by 16
(1996)
Cited by
Methods for Cell and Particle Tracking
Meijering, E., Dzyubachyk, O., & Smal, I. (2012) · Methods in Enzymology · doi:10.1016/b978-0-12-391857-4.00009-4 · Cited by 1,400
Self-citationObjective comparison of particle tracking methods
Chenouard, N., Smal, I., de Chaumont, F., Maška, M., Sbalzarini, I. F., Gong, Y., Cardinale, J., Carthel, C., Coraluppi, S., Winter, M., et al. (2014) · Nature Methods · doi:10.1038/nmeth.2808 · Cited by 894
Self-citationSingle Particle Tracking: From Theory to Biophysical Applications
Shen, H., Tauzin, L. J., Baiyasi, R., Wang, W., Moringo, N., Shuang, B., & Landes, C. F. (2017) · Chemical Reviews · doi:10.1021/acs.chemrev.6b00815 · Cited by 536
Stem cell migration and mechanotransduction on linear stiffness gradient hydrogels
Hadden, W. J., Young, J. L., Holle, A. W., McFetridge, M. L., Kim, D. Y., Wijesinghe, P., Taylor-Weiner, H., Wen, J. H., Lee, A. R., Bieback, K., et al. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1618239114 · Cited by 479
A bird's-eye view of deep learning in bioimage analysis
Meijering, E. (2020) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2020.08.003 · Cited by 126
Self-citation
Metadata
- Authors
- Smal, I., Loog, M., Niessen, W., & Meijering, E.
- Venue
- IEEE Transactions on Medical Imaging
- Published
- 2010-02
- Volume
- 29
- Issue
- 2
- Pages
- 282-301
- ISSN
- 0278-0062 (ISSN-L)
- 1558-254X
- OpenAlex
- W2168237413
- Cited by
- 255
- References
- 72
- FWCI
- 6.56
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.