Avoiding a replication crisis in deep-learning-based bioimage analysis
Open accessThe DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Deep learning algorithms are powerful tools for analyzing, restoring and transforming bioimaging data. One promise of deep learning is parameter-free one-click image analysis with expert-level performance in a fraction of the time previously required. However, as with most emerging technologies, the potential for inappropriate use is raising concerns among the research community. In this Comment, we discuss key concepts that we believe are important for researchers to consider when using deep learning for their microscopy studies. We describe how results obtained using deep learning can be validated and propose what should, in our view, be considered when choosing a suitable tool. We also suggest what aspects of a deep learning analysis should be reported in publications to ensure reproducibility. We hope this perspective will foster further discussion among developers, image analysis specialists, users and journal editors to define adequate guidelines and ensure the appropriate use of this transformative technology.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Image quality assessment: from error visibility to structural similarity
Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004) · IEEE Transactions on Image Processing · doi:10.1109/tip.2003.819861 · Cited by 57,892
The MIQE guidelines: minimum information for publication of quantitative real-time PCR experiments
Bustin, S. A., Benes, V., Garson, J. A., Hellemans, J., Huggett, J., Kubista, M., Mueller, R., Nolan, T., Pfaffl, M. W., Shipley, G. L., et al. (2009) · Clinical Chemistry · doi:10.1373/clinchem.2008.112797 · Cited by 16,303
A survey on Image Data Augmentation for Deep Learning
Shorten, C., & Khoshgoftaar, T. M. (2019) · Journal of Big Data · doi:10.1186/s40537-019-0197-0 · Cited by 13,203 · cited 1×
“…op e P M C F und e r s A u t ho r M a nu s c r i p t s E u r op e P M C F und e r s A u t ho r M a nu s c r i p t s diversity using, for instance, data augmentation 44,45 or using strategies such as reducing the model complexity, adding regularisation (L1, L2) or early stopping during training 46 .”
MethodGuidelines for the use and interpretation of assays for monitoring autophagy (3rd edition).
Klionsky, D. J., Abdelmohsen, K., Abe, A., Abedin, M. J., Abeliovich, H., Acevedo Arozena, A., Adachi, H., Adams, C. M., Adams, P. D., Adeli, K., et al. (2016) · Autophagy · doi:10.1080/15548627.2015.1100356 · Cited by 5,894
Cellpose: a generalist algorithm for cellular segmentation
Stringer, C., Wang, T., Michaelos, M., & Pachitariu, M. (2021) · Nature Methods · doi:10.1038/s41592-020-01018-x · Cited by 4,369 · cited 3×
“For example, popular nuclei or cell segmentation models have been released 29,31,32 (Figure 2).”
BackgroundMethodHe, K., Gkioxari, G., Dollar, P., & Girshick, R. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2844175 · Cited by 3,457
A review of uncertainty quantification in deep learning: Techniques, applications and challenges
Abdar, M., Pourpanah, F., Hussain, S., Rezazadegan, D., Liu, L., Ghavamzadeh, M., Fieguth, P., Cao, X., Khosravi, A., Acharya, U. R., et al. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.05.008 · Cited by 3,111
Cell Detection with Star-Convex Polygons
Schmidt, U., Weigert, M., Broaddus, C., & Myers, G. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00934-2_30 · Cited by 1,826 · cited 1×
“For example, popular nuclei or cell segmentation models have been released 29,31,32 (Figure 2).”
BackgroundNiftyNet: a deep-learning platform for medical imaging
Gibson, E., Li, W., Sudre, C., Fidon, L., Shakir, D. I., Wang, G., Eaton-Rosen, Z., Gray, R., Doel, T., Hu, Y., et al. (2018) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2018.01.025 · Cited by 552
He, K., Gkioxari, G., Dollár, P., & Girshick, R. (2017) · arXiv · doi:10.48550/arxiv.1703.06870 · Cited by 406
Cited by
Omnipose: a high-precision morphology-independent solution for bacterial cell segmentation
Cutler, K. J., Stringer, C., Lo, T. W., Rappez, L., Stroustrup, N., Brook Peterson, S., Wiggins, P. A., & Mougous, J. D. (2022) · Nature Methods · doi:10.1038/s41592-022-01639-4 · Cited by 374
Jelli, E., Ohmura, T., Netter, N., Abt, M., Jiménez‐Siebert, E., Neuhaus, K., Rode, D. K. H., Nadell, C. D., & Drescher, K. (2023) · Molecular Microbiology · doi:10.1111/mmi.15064 · Cited by 48
Priessner, M., Gaboriau, D. C. A., Sheridan, A., Lenn, T., Garzon-Coral, C., Dunn, A. R., Chubb, J. R., Tousley, A. M., Majzner, R. G., Manor, U., et al. (2024) · Nature Methods · doi:10.1038/s41592-023-02138-w · Cited by 35
Self-citationLiu, T., Liu, J., Li, D., & Tan, S. (2025) · Nature Communications · doi:10.1038/s41467-025-60093-w · Cited by 35
Zhang, J., Wang, Y., Donarski, E. D., Toma, T. T., Miles, M. T., Acton, S. T., & Gahlmann, A. (2022) · npj Biofilms and Microbiomes · doi:10.1038/s41522-022-00362-4 · Cited by 22
Metadata
- Authors
- Laine, R. F., Arganda-Carreras, I., Henriques, R., & Jacquemet, G.
- Venue
- Nature Methods
- Published
- 2021-10
- Volume
- 18
- Issue
- 10
- Pages
- 1136-1144
- ISSN
- 1548-7091 (ISSN-L)
- 1548-7105
- OpenAlex
- W3201812816
- Cited by
- 113
- References
- 14
- FWCI
- 8.52
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Avoiding a replication crisis in deep-learning-based bioimage analysis. https://app.cochat.ai/papers/10.1038/s41592-021-01284-3
- The paper
- Laine, R. F., Arganda-Carreras, I., Henriques, R., & Jacquemet, G. (2021). Avoiding a replication crisis in deep-learning-based bioimage analysis. Nature Methods. https://doi.org/10.1038/s41592-021-01284-3
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.