Scientists rise up against statistical significance
Open accessIntegrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The 95% CIs calculated are therefore only approximate because it is not known which patients had multiple events.
“The 95 % CIs[13,14] calculated are therefore only approximate because we do not know which patients had multiple events.”
From Serious adverse events of special interest following mRNA COVID-19 vaccination in randomized trials in adults (2022) · cites this paper as [13]
Cited by
Sorted by citations
Pillinger, T., McCutcheon, R. A., Vano, L., Mizuno, Y., Arumuham, A., Hindley, G., Beck, K., Natesan, S., Efthimiou, O., Cipriani, A., et al. (2020) · The Lancet Psychiatry · doi:10.1016/s2215-0366(19)30416-x · Cited by 1,090 · see citing works
Indices of Effect Existence and Significance in the Bayesian Framework
Makowski, D., Ben-Shachar, M. S., Chen, S. H. A., & Lüdecke, D. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02767 · Cited by 983 · see citing works
Richardson, T. G., Sanderson, E., Palmer, T. M., Ala-Korpela, M., Ference, B. A., Davey Smith, G., & Holmes, M. V. (2020) · PLOS Medicine · doi:10.1371/journal.pmed.1003062 · Cited by 843 · see citing works
Low-dose metformin targets the lysosomal AMPK pathway through PEN2
Ma, T., Tian, X., Zhang, B., Li, M., Wang, Y., Yang, C., Wu, J., Wei, X., Qu, Q., Yu, Y., et al. (2022) · Nature · doi:10.1038/s41586-022-04431-8 · Cited by 644 · see citing works
Rafi, Z., & Greenland, S. (2020) · BMC Medical Research Methodology · doi:10.1186/s12874-020-01105-9 · Cited by 243 · see citing works
Self-citationFraiman, J., Erviti, J., Jones, M., Greenland, S., Whelan, P., Kaplan, R. M., & Doshi, P. (2022) · Vaccine · doi:10.1016/j.vaccine.2022.08.036 · Cited by 228 · see citing works
“The 95 % CIs[13,14] calculated are therefore only approximate because we do not know which patients had multiple events.”
BackgroundSelf-citationMultipleTesting.com: A tool for life science researchers for multiple hypothesis testing correction
Menyhart, O., Weltz, B., & Győrffy, B. (2021) · PLOS ONE · doi:10.1371/journal.pone.0245824 · Cited by 216 · see citing works
Weuve, J., Bennett, E. E., Ranker, L., Gianattasio, K. Z., Pedde, M., Adar, S. D., Yanosky, J. D., & Power, M. C. (2021) · Environmental Health Perspectives · doi:10.1289/ehp8716 · Cited by 209 · see citing works
Rosoff, D. B., Smith, G. D., & Lohoff, F. W. (2021) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2020.3554 · Cited by 186 · see citing works
Blake, K. R., & Gangestad, S. (2020) · Personality and Social Psychology Bulletin · doi:10.1177/0146167220913363 · Cited by 159 · see citing works
Fetit, R., Hillary, R. F., Price, D. J., & Lawrie, S. M. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.07.014 · Cited by 148 · see citing works
Mendelian Randomization Study of PCSK9 and HMG-CoA Reductase Inhibition and Cognitive Function
Rosoff, D. B., Bell, A. S., Jung, J., Wagner, J., Mavromatis, L. A., & Lohoff, F. W. (2022) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2022.05.041 · Cited by 126 · see citing works
The drive to eat in homo sapiens: Energy expenditure drives energy intake
Blundell, J. E., Gibbons, C., Beaulieu, K., Casanova, N., Duarte, C., Finlayson, G., Stubbs, R. J., & Hopkins, M. (2020) · Physiology & Behavior · doi:10.1016/j.physbeh.2020.112846 · Cited by 115 · see citing works
Khader, F., Müller-Franzes, G., Wang, T., Han, T., Tayebi Arasteh, S., Haarburger, C., Stegmaier, J., Bressem, K., Kuhl, C., Nebelung, S., et al. (2023) · Radiology · doi:10.1148/radiol.230806 · Cited by 107 · see citing works
Walking Green: Developing an Evidence Base for Nature Prescriptions
Koselka, E. P. D., Weidner, L. C., Minasov, A., Berman, M. G., Leonard, W. R., Santoso, M. V., de Brito, J. N., Pope, Z. C., Pereira, M. A., & Horton, T. H. (2019) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph16224338 · Cited by 89 · see citing works
Brown, L., Rando, A. A., Eichel, K., Van Dam, N. T., Celano, C. M., Huffman, J. C., & Morris, M. E. (2021) · Psychosomatic Medicine · doi:10.1097/psy.0000000000000900 · Cited by 93 · see citing works
Halperin, I., Malleron, T., Har-Nir, I., Androulakis-Korakakis, P., Wolf, M., Fisher, J., & Steele, J. (2022) · Sports Medicine · doi:10.1007/s40279-021-01559-x · Cited by 76 · see citing works
SIRT2 regulates extracellular vesicle-mediated liver-bone communication
Lin, L., Guo, Z., He, E., Long, X., Wang, D., Zhang, Y., Guo, W., Wei, Q., He, W., Wu, W., et al. (2023) · Nature Metabolism · doi:10.1038/s42255-023-00803-0 · Cited by 88 · see citing works
How education empowers women in developing countries
Le, K., & Nguyen, M. (2021) · The B.E. Journal of Economic Analysis & Policy · doi:10.1515/bejeap-2020-0046 · Cited by 74 · see citing works
Courtney, D. B., Watson, P., Krause, K. R., Chan, B. W. C., Bennett, K., Gunlicks-Stoessel, M., Rodak, T., Neprily, K., Zentner, T., & Szatmari, P. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.46331 · Cited by 63 · see citing works
Truthiness, the illusory truth effect, and the role of need for cognition
Newman, E. J., Jalbert, M. C., Schwarz, N., & Ly, D. P. (2020) · Consciousness and Cognition · doi:10.1016/j.concog.2019.102866 · Cited by 64 · see citing works
Robinson, Z. P., Pelland, J. C., Remmert, J. F., Refalo, M. C., Jukic, I., Steele, J., & Zourdos, M. C. (2024) · Sports Medicine · doi:10.1007/s40279-024-02069-2 · Cited by 63 · see citing works
Putting GLP-1 RAs and Thyroid Cancer in Context: Additional Evidence and Remaining Doubts
Thompson, C. A., & Stürmer, T. (2023) · Diabetes Care · doi:10.2337/dci22-0052 · Cited by 51 · see citing works
The Registered Reports Revolution Lessons in Cultural Reform
Chambers, C. (2019) · Significance · doi:10.1111/j.1740-9713.2019.01299.x · Cited by 43 · see citing works
Saber, M., Giordano, K. R., Hur, Y., Ortiz, J. B., Morrison, H., Godbout, J. P., Murphy, S. M., Lifshitz, J., & Rowe, R. K. (2020) · European Journal of Neuroscience · doi:10.1111/ejn.14611 · Cited by 46 · see citing works
Ethics of quantification: illumination, obfuscation and performative legitimation
Sareen, S., Saltelli, A., & Rommetveit, K. (2020) · Palgrave Communications · doi:10.1057/s41599-020-0396-5 · Cited by 45 · see citing works
Causal Evidence and Dispositions in Medicine and Public Health
Rocca, E., & Anjum, R. L. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17061813 · Cited by 27 · see citing works
Mueller, J., Richards, R., Jones, R. A., Whittle, F., Woolston, J., Stubbings, M., Sharp, S. J., Griffin, S. J., Bostock, J., Hughes, C. A., et al. (2022) · Obesity Facts · doi:10.1159/000524031 · Cited by 24 · see citing works
Social Workers in Israel: Daily Stressors, Work Benefits, Burnout and Well-Being
Savaya, R., Levin, L., & Roziner, I. (2021) · The British Journal of Social Work · doi:10.1093/bjsw/bcaa087 · Cited by 20 · see citing works
Olgiati, P., & Serretti, A. (2022) · International Clinical Psychopharmacology · doi:10.1097/yic.0000000000000416 · Cited by 20 · see citing works
Brennand, E. A., Scime, N. V., Huang, B., Edwards, A. D., Kim-Fine, S., Hall, J., Birch, C., Robert, M., & Carter Ramirez, A. (2025) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2024.10.021 · Cited by 18 · see citing works
Machine Learning assisted systematic reviewing in orthopaedics
Pijls, B. G. (2024) · Journal of Orthopaedics · doi:10.1016/j.jor.2023.11.051 · Cited by 16 · see citing works
Barchfeld, D. C., Vagi, R.-K., Lüdtke, K., Schieffer, E., Güler, F., Einecke, G., Jäger, B., de Zwaan, M., & Nöhre, M. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1071705 · Cited by 10 · see citing works
“To prevent non-significant results from being falsely diminished in their relevance, several authors recommend concentrating on and reporting effect sizes, since they do not depend on factors such as sample size (42, 43).”
BackgroundThe Medical Outreach Team of the Drug Information Association Bayesian Scientific Working Group, Bray, R., Hartley, A., Wenkert, D., Muehlemann, N., Natanegara, F., Harrell, F. E., Wang, F., & Clark, J. (2023) · Therapeutic Innovation & Regulatory Science · doi:10.1007/s43441-022-00482-1 · Cited by 9 · see citing works
Gates, M., Gates, A., Pieper, D., Fernandes, R., Tricco, A., Moher, D., Brennan, S. E., Li, T., Pollock, M., Lunny, C., et al. (2022) · doi:10.31222/osf.io/23b6j · Cited by 3 · see citing works
- Authors
- Amrhein, V., Greenland, S., & McShane, B.
- Affiliations
- University of Basel (CH)
- University of California, Los Angeles (US)
- Corresponding author
- Amrhein, Valentin
- Venue
- Nature
- Published
- 2019-03-20
- Volume
- 567
- Issue
- 7748
- Pages
- 305-307
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2924950986
- Cited by
- 2,983
- References
- 0
- Citations by year
- 2026: 252 · 2025: 308 · 2024: 311 · 2023: 343 · 2022: 429 · 2021: 481 · 2020: 531 · 2019: 322 · 2018: 4
- FWCI
- 282.92
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- edoc (University of Basel) (acceptedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Decision Sciences › Information Systems and Management › Academic Publishing and Open Access
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- statistical significance, p-values, research integrity, publication bias, hypothesis testing, scientific claims
- MeSH terms
- Anti-Inflammatory Agents, Atrial Fibrillation, Humans, Probability, Research Design, Statistics as Topic, Models, Statistical, Confidence Intervals
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
