The DOI matches its Crossref record; 9 of the 10 references it cites were found in a registry or an index.
Reproducibility: A tragedy of errors
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This usually stems from inappropriate study design or baseline comparisons, and miscalculation.”
From Artificial Intelligence in Detecting Statistical Errors: Implications for Authors, Reviewers, and Editors (2025) · cites this paper as [19]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Sometimes, reproducibility is not feasible given a vague description of the methodology.19”
From Artificial Intelligence in Detecting Statistical Errors: Implications for Authors, Reviewers, and Editors (2025) · cites this paper as [19]
Experimental — accuracy not yet measuredIn the citing paper
“Similar errors continue today, are sometimes severe enough to call entire studies into question (11), and may occur with nontrivial frequency (12–14).”
From Issues with data and analyses: Errors, underlying themes, and potential solutions (2018) · cites this paper as [11]
In the citing paper
“Unfortunately, correction of errors often requires an arduous process that highlights limitations of the self-correcting nature of science (11).”
From Issues with data and analyses: Errors, underlying themes, and potential solutions (2018) · cites this paper as [11]
In the citing paper
“As we reported elsewhere (11), the process of getting errors corrected, even when going through proper channels with journals, is often some combination of absurdly slow, inept, confusing, costly, time-intensive, and unsatisfying.”
From Issues with data and analyses: Errors, underlying themes, and potential solutions (2018) · cites this paper as [11]
In the citing paper
“Experience indicates that the handling of such errors (both purported and confirmed) is haphazard, unduly slow, inconsistent, and often markedly socially inappropriate (11, 80, 81).”
From Issues with data and analyses: Errors, underlying themes, and potential solutions (2018) · cites this paper as [11]
In the citing paper
“Much of the difficulty to achieve the desirable clinical translation may stem from lack of reproducibility and from biases in the early stages of the translational pipeline3,4.”
From How to design preclinical studies in nanomedicine and cell therapy to maximize the prospects of clinical translation (2018) · cites this paper as [4]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
- Retracted
Bland, M., & Altman, D. G. (2015) · American Journal of Clinical Nutrition · doi:10.3945/ajcn.115.119768 · Cited by 136
Brown, A. W., Li, P., Brown, M. M. B., Kaiser, K. A., Keith, S. W., Oakes, J. M., & Allison, D. B. (2015) · American Journal of Clinical Nutrition · doi:10.3945/ajcn.114.105072 · Cited by 93
Self-citationLi, P., Brown, A. W., Dawson, J. A., Kaiser, K. A., Bohan Brown, M. M., Keith, S. W., Oakes, J. M., & Allison, D. B. (2015) · Obesity Facts · doi:10.1159/000381434 · Cited by 8
Self-citationThomas, D. M., Brown, A. W., Thomas, D. M., Brown, A. W., Dawson, J., Li, P., Heymsfield, S. B., & Allison, D. B. (2015) · 世界针灸杂志：英文版 · doi:10.1016/s1003-5257(15)30019-2 · Cited by 8
Self-citationErrors in statistical analysis and questionable randomization lead to unreliable conclusions.
George, B. J., Brown, A. W., & Allison, D. B. (2015) · Archives of Advances in Biosciences · doi:10.22037/jps.v6i3.10273 · Cited by 8
Self-citationOrder of Magnitude Misestimation of Weight Effects of Children's Meal Policy Proposals
Brown, A. W., Hall, K. D., Thomas, D. M., Dhurandhar, N. V., Heymsfield, S. B., & Allison, D. B. (2014) · Childhood Obesity · doi:10.1089/chi.2014.0081 · Cited by 6
Self-citationHauner, H. (2015) · Obesity Facts · doi:10.1159/000381481 · Cited by 3
George, B., Goldsby, T. U., Brown, A. W., Li, P., & Allison, D. (2015) · International Journal of Yoga · doi:10.4103/0973-6131.171726 · Cited by 3
Self-citation
Flagged first, then by citations
1 of the 10 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- George, B. J., Brown, A. W. & Allison, D. B. J. Paramedical Sci. 6, 153–154 (2015).
- George, B. J. et al. Obesity (in the press).
Cited by
Sorted by citations
Items 201–256 of 256
El consenso sobre el origen humano del cambio del clima no ha sido demostrado aún
Hidalgo, J. C. G. (2017) · Cuadernos de Investigación Geográfica · doi:10.18172/cig.3368
What’s Responsible for the Retraction Boom?
Marcus, A., & Oransky, I. (2017) · Springer eBooks · doi:10.1007/978-3-658-12909-5_3
Research Integrity in Public Health
Gorman, D. M. (2018) · Oxford University Press eBooks · doi:10.1093/obo/9780199756797-0189
Sleep, dietary patterns and metabolic health in UK adults
Potter, G. D. (2018) · White Rose eTheses Online (University of Leeds, The University of Sheffield, University of York)
International Guidelines - Effects causing different recommendations
Hennes-Bruns, D., & Manzini, G. (2019) · Journal of Evidence-Based Healthcare · doi:10.17267/2675-021xevidence.v1i1.2264
Improving the Reproducibility of LaTeX Documents by Enriching Figures with Embedded Scripts and Data
Jacobs, C. T. (2020) · International Journal of Digital Curation · doi:10.2218/ijdc.v14i1.656
Helliwell, J. R. (2020) · Journal of Applied Crystallography · doi:10.1107/s1600576720005646
Teaching Metrology and Examinology in Chemistry at the University
da Silva, R. J. N. B. (2020) · Eurachem Workshop on Quality Assurance for Analytical Laboratories in the University Curriculum · doi:10.3390/proceedings2020055011
Scheuer, K. S., Hanlon, B. M., Dresel, J. W., Nolan, E. D., Davis, J. C., & Loewe, L. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/099192
Machanick, P. (2020) · South African Computer Journal · doi:10.18489/sacj.v32i2.916
On the Value of Biomedical Research and Medical Care
Catillon, M. (2020) · Digital Access to Scholarship at Harvard (DASH) (Harvard University)
Behind the Façade of Self-Correcting Science
Franzen, S. (2021) · Springer eBooks · doi:10.1007/978-3-030-68063-3_8
Beigrezaei, S., & Salehi‐Abargouei, A. (2021) · British Journal Of Nutrition · doi:10.1017/s0007114521003846
Mazloomi, S. M., Shafiee, M., & Babajafari, S. (2022) · Cytokine · doi:10.1016/j.cyto.2021.155505
Ngẫm về hai tấn bi kịch lớnPreprint
Ho, T. M., & Long, N. T. (2021) · doi:10.31219/osf.io/3967j
Initial thoughts on Greene’s the tragedy of commonsense moralityPreprint
Ho, T. M. (2020) · doi:10.31219/osf.io/mwt2k
Vogsen, M., Jensen, J. D., Gerke, O., Jylling, A. M. B., Asmussen, J. T., Braad, P., Thye‐Rønn, P., Søe, K. L., Ewertz, M., & Hildebrandt, M. G. (2021) · Research Square · doi:10.21203/rs.3.rs-571795/v1
Initial thoughts on Greene’s the tragedy of commonsense moralityPreprint
Ho, T. M. (2020) · doi:10.31219/osf.io/rv7d5
Are female scientists underrepresented in self-correcting science for honest error?Preprint
Ribeiro, M., Mena‐Chalco, J. P., Rocha, K., Pedrotti, M., Menezes, P. R., & Vasconcelos, S. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.10.11.511375
REFLEXÕES EDUCATIVAS SOBRE A CRISE DE REPRODUTIBILIDADE DAS PESQUISAS BIOMÉDICAS
Ferrari, C. K. B. (2023) · LEOPOLDIANUM · doi:10.58422/releo2023.e1399
Becerra-Garcia, L.-E., Cohen, A. D., Chen, X., Dickinson, S., Macagno, A. L. M., & Allison, D. B. (2023) · Nutrition and Health · doi:10.1177/02601060231194653
Self-citationRetractedData Drift for Automatic FAIR-compliant Dataset Versioning in Large Repositories
González–Cebrián, A., Ciolacu, I., Bradford, M., Dobre, C., & González–Vélez, H. (2024) · IEEE International Conference on eScience · doi:10.1109/e-science62913.2024.10678667
Krauß, A. (2024) · Oxford University Press eBooks · doi:10.1093/9780198937401.003.0010
Krauß, A. (2024) · Oxford University Press eBooks · doi:10.1093/9780198937401.003.0003
Krauß, A. (2024) · Oxford University Press eBooks · doi:10.1093/9780198937401.003.0007
The Limits of Science: Grounded in the Boundaries of Our Methods and Mind
Krauß, A. (2024) · Oxford University Press eBooks · doi:10.1093/9780198937401.003.0020
Krauß, A. (2024) · Oxford University Press eBooks · doi:10.1093/9780198937401.003.0015 · Cited by 1
Science of Science: An Integrated Field Grounded in the New-Methods-Drive-Science Theory
Krauß, A. (2024) · Oxford University Press eBooks · doi:10.1093/9780198937401.003.0018
Statistics and Mathematics of Science
Krauß, A. (2024) · Oxford University Press eBooks · doi:10.1093/9780198937401.003.0014
Krauß, A. (2024) · Oxford University Press eBooks · doi:10.1093/9780198937401.005.0001
Krauß, A. (2024) · Oxford University Press eBooks · doi:10.1093/9780198937401.003.0016 · Cited by 1
The Limits of Science: Expanding the Limits by Expanding Our Methodological Toolbox
Krauß, A. (2024) · Oxford University Press eBooks · doi:10.1093/9780198937401.003.0021
Krauß, A. (2024) · Oxford University Press eBooks · doi:10.1093/9780198937401.003.0006
Krauß, A. (2024) · Oxford University Press eBooks · doi:10.1093/9780198937401.003.0002
Krauß, A. (2024) · Oxford University Press eBooks · doi:10.1093/9780198937401.003.0008
Krauß, A. (2024) · Oxford University Press eBooks · doi:10.1093/9780198937401.003.0022
Krauß, A. (2024) · Oxford University Press eBooks · doi:10.1093/9780198937401.003.0011
Krauß, A. (2024) · Oxford University Press eBooks · doi:10.1093/9780198937401.003.0004
The Limits of Science: An Overview
Krauß, A. (2024) · Oxford University Press eBooks · doi:10.1093/9780198937401.003.0019
Scientometrics and Network Science
Krauß, A. (2024) · Oxford University Press eBooks · doi:10.1093/9780198937401.003.0012
Fabrication, Falsification and Spin
Crombie, I. (2021) · Wiley eBooks · doi:10.1002/9781394322183.ch6
Farabough, M. (2021) · University of North Texas Digital Library (University of North Texas) · doi:10.12794/metadc1873807
Statistical Methods in Aging Research: Improving Current Practices and Embracing Emerging Approaches
Thapa, D. K., Parker, E. S., Kandukuri, M., Wang, X. (., Mokalla, T. R., Robertson, O. C., Najam, W., Teschendorff, A. E., Brown, A. W., Speakman, J. R., et al. (2025) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-042324-060005
Self-citationGompers, A. D., Olivier, M. T., & Maney, D. L. (2024) · Figshare · doi:10.6084/m9.figshare.26701696
Gompers, A. D., Olivier, M. T., & Maney, D. L. (2024) · Figshare · doi:10.6084/m9.figshare.26701708
Gompers, A. D., Olivier, M. T., & Maney, D. L. (2024) · Figshare · doi:10.6084/m9.figshare.26701702
Gompers, A. D., Olivier, M. T., & Maney, D. L. (2024) · Figshare · doi:10.6084/m9.figshare.26701705
Gompers, A. D., Olivier, M. T., & Maney, D. L. (2024) · Figshare · doi:10.6084/m9.figshare.26701699
Vogsen, M., Jensen, J. D., Gerke, O., Jylling, A. M. B., Asmussen, J. T., Christensen, I. Y., Braad, P.-E., Thye‐Rønn, P., Søe, K. L., Ewertz, M., et al. (2021) · Figshare · doi:10.6084/m9.figshare.16664567
Gompers, A. D., Olivier, M. T., & Maney, D. L. (2024) · Figshare · doi:10.6084/m9.figshare.26701711
Additional file 1 of From insight network to open policy practice: practical experiences
Tuomisto, J. T., Pohjola, M., & Rintala, T. J. (2020) · Figshare · doi:10.6084/m9.figshare.12082665
Spitz, R. W., Thapa, D. K., Mokalla, T. R., Najam, W., Brown, A. W., & Allison, D. B. (2026) · Nutrients · doi:10.3390/nu18010170
Self-citationLa subjectivité dans les méthodes quantitatives. Une étude des pratiques en Sciences de Gestion
Luu, P. (2019) · theses.fr (ABES) · doi:10.70675/28aac975z27bez4985zb8beze8c42385180f
Fine-scale modelling of the dynamics of phytoplankton communities
Picoche, C. (2022) · theses.fr (ABES) · doi:10.70675/fc1722e4z6066z40f0z8fdaz93eab2f9c461 · Cited by 1
A comprehensive quality assessment of John Hattie's Visible Learning
Bruns, A. K., Dietrichson, J., Håkansson, J., Edyburn, D. L., Nordström, T., & Carlsson, R. (2026) · Educational Research Review · doi:10.1016/j.edurev.2026.100865 · Cited by 1
Metadata
- Authors
- Allison, D. B., Brown, A. W., George, B. J., & Kaiser, K. A.
- Affiliations
- University of Alabama at Birmingham (US)
- Corresponding author
- Allison, David B.
- Venue
- Nature
- Published
- 2016-02-03
- Volume
- 530
- Issue
- 7588
- Pages
- 27-29
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- PMC
- PMC4831566
- OpenAlex
- W2263593861
- Cited by
- 255
- References
- 10
- Citations by year
- 2026: 7 · 2025: 10 · 2024: 48 · 2023: 19 · 2022: 11 · 2021: 29 · 2020: 30 · 2019: 27 · 2018: 25 · 2017: 26 · 2016: 22
- FWCI
- 175.39
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- RePEc: Research Papers in Economics (acceptedVersion)
- Funders
- National Institute of Diabetes and Digestive and Kidney Diseases (P30DK056336)
- Topics
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Library and Information Sciences › Publishing and Scholarly Communication
- Keywords
- reproducibility, research errors, peer review, scholarly publishing, research integrity, error correction
- MeSH terms
- Humans, Periodicals as Topic, Research Design, Retraction of Publication as Topic, Reproducibility of Results, Peer Review, Research, Access to Information, Editorial Policies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
