The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
The fickle P value generates irreproducible results
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
The New Statistics: Why and How
Cumming, G. (2014) · Psychological Science · doi:10.1177/0956797613504966 · Cited by 3,200
Scientific method: Statistical errors
Nuzzo, R. (2014) · Nature · doi:10.1038/506150a · Cited by 1,536
Revised standards for statistical evidence
Johnson, V. E. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1313476110 · Cited by 808
Sample Size Planning for Statistical Power and Accuracy in Parameter Estimation
Maxwell, S. E., Kelley, K., & Rausch, J. R. (2008) · Annual Review of Psychology · doi:10.1146/annurev.psych.59.103006.093735 · Cited by 542
Cumming, G. (2008) · Perspectives on Psychological Science · doi:10.1111/j.1745-6924.2008.00079.x · Cited by 451
Cited by
A brief introduction to mixed effects modelling and multi-model inference in ecology
Harrison, X. A., Donaldson, L., Correa-Cano, M. E., Evans, J., Fisher, D. N., Goodwin, C. E. D., Robinson, B. S., Hodgson, D. J., & Inger, R. (2018) · PeerJ · doi:10.7717/peerj.4794 · Cited by 2,094
Moving beyond P values: data analysis with estimation graphics
Ho, J., Tumkaya, T., Aryal, S., Choi, H., & Claridge-Chang, A. (2019) · Nature Methods · doi:10.1038/s41592-019-0470-3 · Cited by 1,758
Bayesian inference for psychology. Part I: Theoretical advantages and practical ramifications
Wagenmakers, E.-J., Marsman, M., Jamil, T., Ly, A., Verhagen, J., Love, J., Selker, R., Gronau, Q. F., Šmíra, M., Epskamp, S., et al. (2018) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1343-3 · Cited by 1,627
Power Analysis and Effect Size in Mixed Effects Models: A Tutorial
Brysbaert, M., & Stevens, M. (2018) · Journal of Cognition · doi:10.5334/joc.10 · Cited by 1,420
A protocol for conducting and presenting results of regression‐type analyses
Zuur, A. F., & Ieno, E. N. (2016) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12577 · Cited by 834
Big-Data Science in Porous Materials: Materials Genomics and Machine Learning
Jablonka, K. M., Ongari, D., Moosavi, S. M., & Smit, B. (2020) · Chemical Reviews · doi:10.1021/acs.chemrev.0c00004 · Cited by 599
Amrhein, V., Trafimow, D., & Greenland, S. (2019) · The American Statistician · doi:10.1080/00031305.2018.1543137 · Cited by 425
Understanding and interpreting confidence and credible intervals around effect estimates
Hespanhol, L., Vallio, C. S., Costa, L. M., & Saragiotto, B. T. (2019) · Brazilian Journal of Physical Therapy · doi:10.1016/j.bjpt.2018.12.006 · Cited by 390
Halsey, L. G. (2019) · Biology Letters · doi:10.1098/rsbl.2019.0174 · Cited by 357
Self-citationIt's all relative: analyzing microbiome data as compositions
Gloor, G. B., Wu, J. R., Pawlowsky-Glahn, V., & Egozcue, J. J. (2016) · Annals of Epidemiology · doi:10.1016/j.annepidem.2016.03.003 · Cited by 323
The earth is flat ( p > 0.05): significance thresholds and the crisis of unreplicable research
Amrhein, V., Korner-Nievergelt, F., & Roth, T. (2017) · PeerJ · doi:10.7717/peerj.3544 · Cited by 308
Application of the Hierarchical Bootstrap to Multi-Level Data in Neuroscience
Saravanan, V., Berman, G. J., & Sober, S. J. (2019) · doi:10.1101/819334 · Cited by 170
Daisley, B. A., Chanyi, R. M., Abdur-Rashid, K., Al, K. F., Gibbons, S., Chmiel, J. A., Wilcox, H., Reid, G., Anderson, A., Dewar, M., et al. (2020) · Nature Communications · doi:10.1038/s41467-020-18649-5 · Cited by 128
Irreproducibility in Preclinical Biomedical Research: Perceptions, Uncertainties, and Knowledge Gaps
Jarvis, M. F., & Williams, M. (2016) · Trends in Pharmacological Sciences · doi:10.1016/j.tips.2015.12.001 · Cited by 129
Michel, M. C., Murphy, T. J., & Motulsky, H. J. (2020) · Molecular Pharmacology · doi:10.1124/mol.119.118927 · Cited by 127
Reveal, Don’t Conceal: Transforming Data Visualization to Improve Transparency
Weissgerber, T. L., Winham, S. J., Heinzen, E. P., Milin-Lazovic, J. S., Garcia-Valencia, O., Bukumiric, Z., Savic, M. D., Garovic, V. D., & Milic, N. M. (2019) · Circulation · doi:10.1161/circulationaha.118.037777 · Cited by 101
Working memory updating and binding training: Bayesian evidence supporting the absence of transfer.
De Simoni, C., & von Bastian, C. C. (2018) · Journal of Experimental Psychology: General · doi:10.1037/xge0000453 · Cited by 84
Sex and STEM Occupation Predict Autism-Spectrum Quotient (AQ) Scores in Half a Million People
Ruzich, E., Allison, C., Chakrabarti, B., Smith, P., Musto, H., Ring, H., & Baron-Cohen, S. (2015) · PLOS ONE · doi:10.1371/journal.pone.0141229 · Cited by 79
Alexithymia may explain the relationship between autistic traits and eating disorder psychopathology
Vuillier, L., Carter, Z., Teixeira, A. R., & Moseley, R. L. (2020) · Molecular Autism · doi:10.1186/s13229-020-00364-z · Cited by 48
Analysing the impact of ChatGPT in research
Picazo-Sanchez, P., & Ortiz-Martin, L. (2024) · Applied Intelligence · doi:10.1007/s10489-024-05298-0 · Cited by 46
Loss, C. M., Melleu, F. F., Domingues, K., Lino-de-Oliveira, C., & Viola, G. G. (2021) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2021.763428 · Cited by 44
Küper, K., & Karbach, J. (2016) · Journal of Cognitive Psychology · doi:10.1080/20445911.2015.1118106 · Cited by 33
Amphetamine alters an EEG marker of reward processing in humans and mice
Cavanagh, J. F., Olguin, S. L., Talledo, J. A., Kotz, J. E., Roberts, B. Z., Nungaray, J. A., Sprock, J., Gregg, D., Bhakta, S. G., Light, G. A., et al. (2022) · Psychopharmacology · doi:10.1007/s00213-022-06082-z · Cited by 32
Application of the hierarchical bootstrap to multi-level data in neuroscience
Saravanan, V., Berman, G. J., & Sober, S. J. (2020) · arXiv · doi:10.48550/arxiv.2007.07797 · Cited by 26
Wu, C., Beattie, Z., Mattek, N., Sharma, N., Kaye, J., & Dodge, H. H. (2021) · Alzheimer's & Dementia: Translational Research & Clinical Interventions · doi:10.1002/trc2.12220 · Cited by 18
Artificial Intelligence in Medicine: Validation and Study Design
Oakden-Rayner, L., & Palmer, L. J. (2019) · Artificial Intelligence in Medical Imaging · doi:10.1007/978-3-319-94878-2_8 · Cited by 14
Vuong, Q.-H., Le, T.-T., La, V.-P., Vuong, T.-T., & Nguyen, M.-H. (2023) · Urban Science · doi:10.3390/urbansci7020059 · Cited by 9
Souza, J., Caballero, I., Vasco Santos, J., Lobo, M., Pinto, A., Viana, J., Sáez, C., Lopes, F., & Freitas, A. (2022) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2022.104242 · Cited by 7
A reckless guide to P-values: local evidence, global errors
Lew, M. J. (2019) · arXiv · doi:10.48550/arxiv.1910.02042 · Cited by 2
Metadata
- Authors
- Halsey, L. G., Curran-Everett, D., Vowler, S. L., & Drummond, G. B.
- Venue
- Nature Methods
- Published
- 2015-02-26
- Volume
- 12
- Issue
- 3
- Pages
- 179-185
- ISSN
- 1548-7091 (ISSN-L)
- 1548-7105
- OpenAlex
- W2075418882
- Cited by
- 765
- References
- 7
- FWCI
- 77.44
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
