Cited by 182Benford’s Law and Fraud DetectionMeta-analysis and systematic reviewsStatistical Methods in Epidemiology

The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.

Incongruence between test statistics and P values in medical papers

Open access

García-Berthou, Emili, Alcaraz, Carles·2004·BMC Medical Research Methodology

Open this paper in CoChat — free account Open PDF

Abstract

BACKGROUND: Given an observed test statistic and its degrees of freedom, one may compute the observed P value with most statistical packages. It is unknown to what extent test statistics and P values are congruent in published medical papers. METHODS: We checked the congruence of statistical results reported in all the papers of volumes 409-412 of Nature (2001) and a random sample of 63 results from volumes 322-323 of BMJ (2001). We also tested whether the frequencies of the last digit of a sample of 610 test statistics deviated from a uniform distribution (i.e., equally probable digits). RESULTS: 11.6% (21 of 181) and 11.1% (7 of 63) of the statistical results published in Nature and BMJ respectively during 2001 were incongruent, probably mostly due to rounding, transcription, or type-setting errors. At least one such error appeared in 38% and 25% of the papers of Nature and BMJ, respectively. In 12% of the cases, the significance level might change one or more orders of magnitude. The frequencies of the last digit of statistics deviated from the uniform distribution and suggested digit preference in rounding and reporting. CONCLUSIONS: This incongruence of test statistics and P values is another example that statistical practice is generally poor, even in the most renowned scientific journals, and that quality of papers should be more controlled and valued.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1186/1471-2288-4-13

Cites

33 of 33 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration
Altman, D. G., Schulz, K. F., Moher, D., Egger, M., Davidoff, F., Elbourne, D., Gøtzsche, P. C., Lang, T., & for the CONSORT Group (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-8-200104170-00012 · Cited by 3,835
The scandal of poor medical research.
Altman, D. G. (1994) · BMJ · doi:10.1136/bmj.308.6924.283 · Cited by 897
Statistical guidelines for contributors to medical journals.
Altman, D. G., Gore, S. M., Gardner, M. J., & Pocock, S. (1983) · BMJ · doi:10.1136/bmj.286.6376.1489 · Cited by 662
Comparison of pregnancy dating by last menstrual period, ultrasound scanning, and their combination
Savitz, D. A., Terry, J. W., Dole, N., Thorp, J. M., Siega-Riz, A. M., & Herring, A. H. (2002) · American Journal of Obstetrics and Gynecology · doi:10.1067/mob.2002.127601 · Cited by 437
Guidelines for Statistical Reporting in Articles for Medical Journals
Bailar, J. C., & MOSTELLER, F. (1988) · Annals of Internal Medicine · doi:10.7326/0003-4819-108-2-266 · Cited by 387
On the accuracy of statistical procedures in Microsoft Excel 2003
McCullough, B., & Wilson, B. K. (1999) · Computational Statistics & Data Analysis · doi:10.1016/s0167-9473(99)00004-3 · Cited by 299
Statistics in medical journals: developments in the 1980s.
Altman, D. (1991) · Statistics in Medicine · doi:10.1002/sim.4780101206 · Cited by 267
On the accuracy of statistical procedures in Microsoft Excel 2010
Mélard, G. (2014) · Computational Statistics · doi:10.1007/s00180-014-0482-5 · Cited by 238
On the accuracy of statistical procedures in Microsoft Excel 2007
McCullough, B. D., & Heiser, D. A. (2008) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2008.03.004 · Cited by 238
Statistics in medical journals
Altman, D. G. (1982) · Statistics in Medicine · doi:10.1002/sim.4780010109 · Cited by 227

Show all 31 references

Research works printed but not linked: 1

Benford F: The Law of Anomalous Numbers. Proc Amer Phil Soc. 1938, 78: 551-572.

Sorted by citations

Increasing value and reducing waste in research design, conduct, and analysis
Ioannidis, J. P. A., Greenland, S., Hlatky, M. A., Khoury, M. J., Macleod, M. R., Moher, D., Schulz, K. F., & Tibshirani, R. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62227-8 · Cited by 1,597
Sample size, power and effect size revisited: simplified and practical approaches in pre-clinical, clinical and laboratory studies
Serdar, C. C., Cihan, M., Yücel, D., & Serdar, M. A. (2020) · Biochemia Medica · doi:10.11613/bm.2021.010502 · Cited by 1,868
A dirty dozen: twelve p-value misconceptions.
Goodman, S. (2008) · Seminars in hematology (Print) · doi:10.1053/j.seminhematol.2008.04.003 · Cited by 694
The prevalence of statistical reporting errors in psychology (1985–2013)
Nuijten, M. B., Hartgerink, C. H. J., van Assen, M. A. L. M., Epskamp, S., & Wicherts, J. M. (2016) · Behavior Research Methods · doi:10.3758/s13428-015-0664-2 · Cited by 510
Psychology's Renaissance
Nelson, L. D., Simmons, J., & Simonsohn, U. (2018) · Annual Review of Psychology · doi:10.1146/annurev-psych-122216-011836 · Cited by 548
Willingness to Share Research Data Is Related to the Strength of the Evidence and the Quality of Reporting of Statistical Results
Wicherts, J. M., Bakker, M., & Molenaar, D. (2011) · PLoS ONE · doi:10.1371/journal.pone.0026828 · Cited by 424
Computation of measures of effect size for neuroscience data sets
Hentschke, H., & Stüttgen, M. C. (2011) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2011.07902.x · Cited by 421
The problem of pseudoreplication in neuroscientific studies: is it affecting your analysis?
Lazic, S. E. (2010) · BMC Neuroscience · doi:10.1186/1471-2202-11-5 · Cited by 381
Scientific Utopia: I. Opening Scientific Communication
Nosek, B. A., & Bar‐Anan, Y. (2012) · Psychological Inquiry · doi:10.1080/1047840x.2012.692215 · Cited by 387
The (mis)reporting of statistical results in psychology journals
Bakker, M., & Wicherts, J. M. (2011) · Behavior Research Methods · doi:10.3758/s13428-011-0089-5 · Cited by 356
Effect of using reporting guidelines during peer review on quality of final manuscripts submitted to a biomedical journal: masked randomised trial
Cobo, E., Cortes, J., Ribera, J. M., Cardellach, F., Selva-O'Callaghan, A., Kostov, B., Garcia, L., Cirugeda, L., Altman, D. G., Gonzalez, J. A., et al. (2011) · BMJ · doi:10.1136/bmj.d6783 · Cited by 290
What to use to express the variability of data: Standard deviation or standard error of mean?
Barde, P. J., & Barde, M. (2012) · Perspectives in Clinical Research · doi:10.4103/2229-3485.100662 · Cited by 288
Dirty Dozen: Twelve P-Value Misconceptions
Goodman, T. (2008) · Cited by 238
Power Analysis, Sample Size, and Assessment of Statistical Assumptions—Improving the Evidential Value of Lighting Research
Uttley, J. (2019) · LEUKOS The Journal of the Illuminating Engineering Society of North America · doi:10.1080/15502724.2018.1533851 · Cited by 217
Psychology's Replication Crisis and Clinical Psychological Science
Tackett, J. L., Brandes, C. M., King, K. M., & Markon, K. E. (2019) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050718-095710 · Cited by 221
Is there a credibility crisis in strategic management research? Evidence on the reproducibility of study findings
Bergh, D. D., Sharp, B. M., Aguinis, H., & Li, M. (2017) · Strategic Organization · doi:10.1177/1476127017701076 · Cited by 193
Scientific Utopia III: Crowdsourcing Science
Uhlmann, E. L., Ebersole, C. R., Chartier, C. R., Errington, T. M., Kidwell, M. C., Lai, C. K., McCarthy, R. J., Riegelman, A., Silberzahn, R., & Nosek, B. A. (2019) · Perspectives on Psychological Science · doi:10.1177/1745691619850561 · Cited by 191
Statistical errors in medical research - a review of common pitfalls
Strasak, A. M., Zaman, Q., Pfeiffer, K. P., Göbel, G., & Ulmer, H. (2007) · Swiss Medical Weekly · doi:10.4414/smw.2007.11587 · Cited by 162
Methodological Rigor in Preclinical Cardiovascular Studies: Targets to Enhance Reproducibility and Promote Research Translation
Ramirez, F. D., Motazedian, P., Jung, R. G., Di Santo, P., MacDonald, Z. D., Moreland, R., Simard, T., Clancy, A. A., Russo, J. J., Welch, V. A., et al. (2017) · Circulation Research · doi:10.1161/circresaha.117.310628 · Cited by 138
Prior specification in Bayesian statistics: Three cautionary tales
Dongen, S. V. (2006) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2006.02.002 · Cited by 134
Concentration of the Most-Cited Papers in the Scientific Literature: Analysis of Journal Ecosystems
Ioannidis, J. P. A. (2006) · PLoS ONE · doi:10.1371/journal.pone.0000005 · Cited by 122
The Use of Statistics in Medical Research
Strasak, A. M., Zaman, Q., Marinell, G., Pfeiffer, K. P., & Ulmer, H. (2007) · The American Statistician · doi:10.1198/000313007x170242 · Cited by 104
Addressing the problems with life-science databases for traditional uses and systems biology
Philippi, S., & Köhler, J. (2006) · Nature Reviews Genetics · doi:10.1038/nrg1872 · Cited by 90
Distributions of p -values smaller than .05 in psychology: what is going on?
Hartgerink, C. H. J., van Aert, R. C. M., Nuijten, M. B., Wicherts, J. M., & van Assen, M. A. L. M. (2016) · PeerJ · doi:10.7717/peerj.1935 · Cited by 90
Putting the Self in Self-Correction: Findings From the Loss-of-Confidence Project
Rohrer, J. M., Tierney, W., Uhlmann, E. L., DeBruine, L. M., Heyman, T., Jones, B. C., Schmukle, S. C., Silberzahn, R., Willén, R. M., Carlsson, R., et al. (2021) · Perspectives on Psychological Science · doi:10.1177/1745691620964106 · Cited by 87
Journal Data Sharing Policies and Statistical Reporting Inconsistencies in Psychology
Nuijten, M. B., Borghuis, J., Veldkamp, C. L. S., Dominguez-Alvarez, L., van Assen, M. A. L. M., & Wicherts, J. M. (2017) · Collabra: Psychology · doi:10.1525/collabra.102 · Cited by 79
Self-medication of migraine and tension-type headache: summary of the evidence-based recommendations of the Deutsche Migräne und Kopfschmerzgesellschaft (DMKG), the Deutsche Gesellschaft für Neurologie (DGN), the Österreichische Kopfschmerzgesellschaft (ÖKSG) and the Schweizerische Kopfwehgesellschaft (SKG)
Haag, G., Diener, H.-C., May, A., Meyer, C., Morck, H., Straube, A., Wessely, P., & Evers, S. (2011) · The Journal of Headache and Pain · doi:10.1007/s10194-010-0266-4 · Cited by 78
Applied statistics in ecology: common pitfalls and simple solutions
Steel, E. A., Kennedy, M. C., Cunningham, P. G., & Stanovick, J. S. (2013) · Ecosphere · doi:10.1890/es13-00160.1 · Cited by 78
An analysis of general medical and specialist journals that endorse CONSORT found that reporting was not enforced consistently
Mills, E. J., Wu, P., Gagnier, J. J., Heels‐Ansdell, D., & Montori, V. M. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.01.004 · Cited by 76
Progesterone for premenstrual syndrome
Ford, O., Lethaby, A. E., Roberts, H., & Mol, B. W. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003415.pub3 · Cited by 73
Probing the improbable: methodological challenges for risks with low probabilities and high stakes
Ord, T., Hillerbrand, R., & Sandberg, A. (2010) · Journal of Risk Research · doi:10.1080/13669870903126267 · Cited by 72
Statistical Reporting Errors and Collaboration on Statistical Analyses in Psychological Science
Veldkamp, C. L. S., Nuijten, M. B., Dominguez-Alvarez, L., van Assen, M. A. L. M., & Wicherts, J. M. (2014) · PLoS ONE · doi:10.1371/journal.pone.0114876 · Cited by 69
Progesterone for premenstrual syndrome
Ford, O., Lethaby, A. E., Roberts, H., & Mol, B. W. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003415.pub4 · Cited by 69
Reinventing Biostatistics Education for Basic Scientists
Weissgerber, T. L., Garovic, V. D., Milin-Lazovic, J. S., Winham, S. J., Zoran Obradovic, A., Trzeciakowski, J. P., & Milic, N. M. (2016) · PLoS Biology · doi:10.1371/journal.pbio.1002430 · Cited by 73
The reproducibility of statistical results in psychological research: An investigation using unpublished raw data.
Artner, R., Verliefde, T., Steegen, S., Gomes, S. L. B. T., Traets, F., Tuerlinckx, F., & Vanpaemel, W. (2020) · Psychological Methods · doi:10.1037/met0000365 · Cited by 77
Letting the daylight in: Reviewing the reviewers and other ways to maximize transparency in science
Wicherts, J. M., Kievit, R., Bakker, M., & Borsboom, D. (2012) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2012.00020 · Cited by 64
Systematic Survey of the Design, Statistical Analysis, and Reporting of Studies Published in the 2008 Volume of the Journal of Cerebral Blood Flow and Metabolism
Vesterinen, H. M., Egan, K. J., Deister, A., Schlattmann, P., Macleod, M. R., & Dirnagl, U. (2010) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.2010.217 · Cited by 63
The Weak Spots in Contemporary Science (and How to Fix Them)
Wicherts, J. M. (2017) · Animals · doi:10.3390/ani7120090 · Cited by 56
How Modeling Standards, Software, and Initiatives Support Reproducibility in Systems Biology and Systems Medicine
Waltemath, D., & Wolkenhauer, O. (2016) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2016.2555481 · Cited by 49
Discussion: Difficulties in making inferences about scientific truth from distributions of published p-values
Gelman, A., & O'Rourke, K. (2013) · Biostatistics · doi:10.1093/biostatistics/kxt034 · Cited by 49
ANALYTIC WEBS SUPPORT THE SYNTHESIS OF ECOLOGICAL DATA SETS
Ellison, A. M., Osterweil, L. J., Clarke, L. A., Hadley, J. L., Wise, A., Boose, E. R., Foster, D. R., Hanson, A. R., Jensen, D. D., Kuzeja, P., et al. (2006) · Ecology · doi:10.1890/0012-9658(2006)87[1345:awstso]2.0.co;2 · Cited by 44
Blinded by the Light: How a Focus on Statistical “Significance” May Causep-Value Misreporting and an Excess ofp-Values Just Below .05 in Communication Science
Vermeulen, I., Beukeboom, C. J., Batenburg, A., Avrămiea, A.-E., Stoyanov, D. S., van de Velde, B., & Oegema, D. (2015) · Communication Methods and Measures · doi:10.1080/19312458.2015.1096333 · Cited by 44
Inconsistencies between reported test statistics and p‐values in two psychiatry journals
Berle, D., & Starcevic, V. (2007) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.225 · Cited by 38
Research Misconduct—Definitions, Manifestations and Extent
Bornmann, L. (2013) · Publications · doi:10.3390/publications1030087 · Cited by 36
Statistical Literacy for Readers ofPediatrics: A Moving Target
Hellems, M. A., Gurka, M. J., & Hayden, G. F. (2007) · PEDIATRICS · doi:10.1542/peds.2006-2330 · Cited by 36
An unexpected influence of widely used significance thresholds on the distribution of reported P‐values
Ridley, J., Kolm, N., FRECKELTON, R. P., & Gage, M. J. G. (2007) · Journal of Evolutionary Biology · doi:10.1111/j.1420-9101.2006.01291.x · Cited by 34
Assessments of Research Competencies for Clinical Investigators: A Systematic Review
Ianni, P. A., Samuels, E. M., Eakin, B. L., Perorazio, T. E., & Ellingrod, V. L. (2019) · Evaluation & the Health Professions · doi:10.1177/0163278719896392 · Cited by 39
Progesterone for premenstrual syndrome
Ford, O., Lethaby, A. E., & Roberts, H. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003415.pub2 · Cited by 33
Transparent reporting for reproducible science
Weissgerber, T. L., Garovic, V. D., Winham, S. J., Milic, N. M., & Prager, E. M. (2016) · Journal of Neuroscience Research · doi:10.1002/jnr.23785 · Cited by 33
Paper-like Polyphenylene Sulfide/Aramid Fiber Electrode with Excellent Areal Capacitance and Flame-Retardant Performance
Yu, Y. M., Pan, D., Zhao, L., Huang, S., Lin, P., Wang, Z., Jia, Y., Wang, H., & Wang, L. (2022) · Advanced Fiber Materials · doi:10.1007/s42765-022-00176-1 · Cited by 33
Common errors in disease mapping
Ocaña‐Riola, R. (2010) · Geospatial health · doi:10.4081/gh.2010.196 · Cited by 32
Evidence appraisal: a scoping review, conceptual framework, and research agenda
Goldstein, A., Venker, E., & Weng, C. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocx050 · Cited by 30
Evidence-based burn care—An assessment of the methodological quality of research published in burn care journals from 1982 to 2008
Al‐Benna, S., Alzoubaidi, D., & Al-Ajam, Y. (2010) · Burns · doi:10.1016/j.burns.2010.03.011 · Cited by 29
Use of reproducible research practices in public health: A survey of public health analysts
Harris, J. K., Johnson, K. J., Carothers, B. J., Combs, T., Luke, D. A., & Wang, X. (2018) · PLoS ONE · doi:10.1371/journal.pone.0202447 · Cited by 33
Using implementation science to close the gap between the optimal and typical practice of quantitative methods in clinical science.
King, K. M., Pullmann, M. D., Lyon, A. R., Dorsey, S., & Lewis, C. C. (2019) · Journal of Abnormal Psychology · doi:10.1037/abn0000417 · Cited by 36
A Retrospective Survey of Research Design and Statistical Analyses in Selected Chinese Medical Journals in 1998 and 2008
Jin, Z., Yu, D., Zhang, L., Meng, H., Lu, J., Gao, Q.-B., Cao, Y., Ma, X., Wu, C.-C., He, Q., et al. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010822 · Cited by 27
Double trouble? The communication dimension of the reproducibility crisis in experimental psychology and neuroscience
Hensel, W. M. (2020) · European Journal for Philosophy of Science · doi:10.1007/s13194-020-00317-6 · Cited by 28
Statistical errors in articles published in radiology journals
Karadeniz, P. G., UZABACI, E., Atış, S., KESİN, F. K., Can, F. E., Seçil, M., & Ercan, İ. (2018) · Diagnostic and Interventional Radiology · doi:10.5152/dir.2018.18148 · Cited by 26
Basics, common errors and essentials of statistical tools and techniques in anesthesiology research
Bajwa, S. J. (2015) · Journal of Anaesthesiology Clinical Pharmacology · doi:10.4103/0970-9185.169087 · Cited by 24
Consistency errors in p-values reported in Spanish psychology journals
Caperos, J., & Pardo, A. (2013) · Psicothema · doi:10.7334/psicothema2012.207 · Cited by 23
Reporting and transparent research practices in sports medicine and orthopaedic clinical trials: a meta-research study
Schulz, R., Langen, G., Prill, R., Cassel, M., & Weissgerber, T. L. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-059347 · Cited by 23
Efficacy of acupuncture in management of premenstrual syndrome: A systematic review
Cho, S., & Kim, J. (2010) · Complementary Therapies in Medicine · doi:10.1016/j.ctim.2009.12.001 · Cited by 22
Anticipating consequences of sharing raw data and code and of awarding badges for sharing
Ioannidis, J. P. A. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.04.015 · Cited by 25
Re: The Charité cesarean birth: a family-orientated approach of cesarean section
Armbrust, R., & Henrich, W. (2016) · The Journal of Maternal-Fetal & Neonatal Medicine · doi:10.3109/14767058.2016.1153028 · Cited by 21
Statistical errors in immunologic research
Murphy, J. R. (2004) · Journal of Allergy and Clinical Immunology · doi:10.1016/j.jaci.2004.09.023 · Cited by 20
Statistically significant
Cerejeira, A. (2005) · Nature Medicine · doi:10.1038/nm0105-1 · Cited by 20
Research Design and Statistical Methods in Indian Medical Journals: A Retrospective Survey
Hassan, S., Yellur, R., Subramani, P., Adiga, P., Gokhale, M., Iyer, M. S., & Mayya, S. S. (2015) · PLoS ONE · doi:10.1371/journal.pone.0121268 · Cited by 19
Statistical Errors in Medical Journals (A Critical Appraisal)
Hanif, A., & Ajmal, T. (2011) · Annals of King Edward Medical University · doi:10.21649/akemu.v17i2.295 · Cited by 19
The Use of Statistics in Health Sciences: Situation Analysis and Perspective
Ocaña‐Riola, R. (2016) · Statistics in Biosciences · doi:10.1007/s12561-015-9138-4 · Cited by 19
Indicators of questionable research practices were identified in 163,129 randomized controlled trials
Damen, J. A., Heus, P., Lamberink, H. J., Tijdink, J. K., Bouter, L. M., Glasziou, P., Moher, D., Otte, W. M., Vinkers, C. H., & Hooft, L. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2022.11.020 · Cited by 20
Management of Thyroid Cancer and Related Nodular Disease
Mcdougall, I., & Berry, G. (2005) · Springer eBooks · doi:10.1007/b136168 · Cited by 13
Error in statistical tests of error in statistical tests
Jeng, M. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-45 · Cited by 17
Building bridges: knowledge production, publication and use. Commentary on Tonelli (2006), Integrating evidence into clinical practice: an alternative to evidence‐based approaches. Journal of Evaluation in Clinical Practice 12, 248–256
Geanellos, R., & Wilson, C. (2006) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2006.00592.x · Cited by 16
Majority Vote and Other Problems when using Computational Tools
Vihinen, M. (2014) · Human Mutation · doi:10.1002/humu.22600 · Cited by 15
A Call for the Reporting of Effect Sizes in Research Reports to Enhance Critical Appraisal and Evidence‐Based Practice
Mays, M. Z., & Melnyk, B. M. (2009) · Worldviews on Evidence-Based Nursing · doi:10.1111/j.1741-6787.2009.00166.x · Cited by 15
An auction market for journal articles
Prüfer, J., & Zetland, D. (2009) · Public Choice · doi:10.1007/s11127-009-9571-3 · Cited by 15
Sharing is caring: Ethical implications of transparent research in psychology.
Bosma, C. M., & Granger, A. M. (2022) · American Psychologist · doi:10.1037/amp0001002 · Cited by 19
Poor quality in the reporting and use of statistical methods in public health – the case of unemployment and health
Norström, F. (2015) · Archives of Public Health · doi:10.1186/s13690-015-0096-6 · Cited by 15
Pathways to evidence-based knowledge in orthopaedic surgery: an international survey of AO course participants
Goldhahn, S., Audigé, L., Helfet, D. L., & Hanson, B. (2005) · International Orthopaedics · doi:10.1007/s00264-004-0617-3 · Cited by 14
Discrepancies between Conference Abstracts and Published Manuscripts in Plastic Surgery Studies: A Retrospective Review
Dagi, A. F., Parry, G. J., Labow, B. I., & Taghinia, A. H. (2021) · Plastic & Reconstructive Surgery Global Open · doi:10.1097/gox.0000000000003828 · Cited by 13
Statistical errors in microleakage studies in operative dentistry. A survey of the literature 2001-2009
Lucena, C., López, J. M., Ábalos, C., Gijón, V. R., & Pulgar, R. (2011) · European Journal Of Oral Sciences · doi:10.1111/j.1600-0722.2011.00892.x · Cited by 12
Intervention Effectiveness Research in Adolescent Health Psychology: Methodological Issues and Strategies
Constantine, N. A. (2013) · Springer eBooks · doi:10.1007/978-1-4614-6633-8_20 · Cited by 12
Statistical methods and errors in family medicine articles between 2010 and 2014-Suez Canal University, Egypt: A cross-sectional study
Nour-Eldein, H. (2016) · Journal of Family Medicine and Primary Care · doi:10.4103/2249-4863.184619 · Cited by 11
Selbstmedikation bei Migräne und beim Kopfschmerz vom Spannungstyp
Diener, H., May, A., Meyer, C., MORCK, H., Straube, A., Wessely, P., Evers, S., & Haag, G. (2009) · Nervenheilkunde · doi:10.1055/s-0038-1628650 · Cited by 11
Psychology’s Replication Crisis and Clinical Psychological SciencePreprint
Tackett, J. L., Brandes, C. M., King, K. M., & Markon, K. E. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/kc8xt · Cited by 16
Evaluation of Large-scale Data to Detect Irregularity in Payment for Medical Services
Park, J. A., Yoon, S., & Kim, M. (2016) · Methods of Information in Medicine · doi:10.3414/me15-01-0076 · Cited by 10
Balanced resuscitation and earlier mortality end points: bayesian post hoc analysis of the PROPPR trial
Lammers, D. T., Rokayak, O. A., Uhlich, R. M., Sensing, T., Baird, E., Richman, J., Holcomb, J. B., & Jansen, J. O. (2023) · Trauma Surgery & Acute Care Open · doi:10.1136/tsaco-2023-001091 · Cited by 10
A new neurometric dissection of the area-under-curve-associated jiggle of the motor evoked potential induced by transcranial magnetic stimulation.
Leon-Sarmiento, F. E., Rizzo-Sierra, C. V., León-Ariza, J. S., Leon-Ariza, D. S., Sobota, R., & Prada, D. (2015) · Physiology and Behavior · doi:10.1016/j.physbeh.2015.01.014 · Cited by 7
Inference in Forensic Pathology
Oliver, W. R. (2011) · Academic Forensic Pathology · doi:10.23907/2011.037 · Cited by 10
Understanding the literature: Complexity of statistical methods used in high-impact cardiothoracic surgery research
Gritti, M. N., Jegatheeswaran, A., Yissar, D., Harris, M. A., & McCrindle, B. W. (2020) · Journal of Thoracic and Cardiovascular Surgery · doi:10.1016/j.jtcvs.2020.10.144 · Cited by 9
Profile of research methodology and statistics training of undergraduate medical students at South African universities
Dommisse, J., & Joubert, G. (2009) · South African Family Practice · doi:10.1080/20786204.2009.10873833 · Cited by 9
Reforms in Academic Publishing: Should Behavioral Disorders and Special Education Journals Embrace Them?
Cook, B. G. (2016) · Behavioral Disorders · doi:10.17988/0198-7429-41.3.161 · Cited by 9
Laparoscopic versus open transhiatal approach for adenocarcinoma of the esophagogastric junction: A systematic review and meta-analysis
Chen, X., He, F., Liao, M.-S., & Mi, C. (2020) · European Journal of Surgical Oncology · doi:10.1016/j.ejso.2020.10.022 · Cited by 8
Supracondylar humerus fractures in children
Pescatori, E., Memeo, A., Brivio, A., Trapletti, A., Camurri, S., Pedretti, L., & Albisetti, W. (2011) · Journal of Pediatric Orthopaedics B · doi:10.1097/bpb.0b013e32834f805b · Cited by 8
Application of statistics in biomedical research
Padhee, S., & Ahmed, S. (2024) · Journal of Integrative Medicine and Research · doi:10.4103/jimr.jimr_1_24 · Cited by 7
Errores conceptuales de estadística más comunes en publicaciones científicas
Chile, U. S. T. , Pinel, R. A. M., Márquez, A. C., & de Caldas, U. (2017) · CES Medicina Veterinaria y Zootecnia · doi:10.21615/cesmvz.12.3.4 · Cited by 7
Forensic Psychology, Psychological Injuries and the Law
Kane, A. W. (2008) · Psychological Injury and Law · doi:10.1007/s12207-007-9000-1 · Cited by 7
Government regulation is needed to prevent biased under-reporting of clinical trials
Chalmers, I. (2004) · BMJ · doi:10.1136/bmj.329.7463.462-a · Cited by 7
THE (NON‐)SIGNIFICANCE OF REPORTING ERRORS IN ECONOMICS: EVIDENCE FROM THREE TOP JOURNALS
Pütz, P., & Bruns, S. B. (2020) · Journal of Economic Surveys · doi:10.1111/joes.12397 · Cited by 6
Examining the Reproducibility of 6 Published Studies in Public Health Services and Systems Research
Harris, J. K., Wondmeneh, S. B., Zhao, Y., & Leider, J. P. (2018) · Journal of Public Health Management and Practice · doi:10.1097/phh.0000000000000694 · Cited by 6

Authors: García-Berthou, E., & Alcaraz, C.
Venue: BMC Medical Research Methodology
Publisher: Springer Science and Business Media LLC
Published: 2004-05-28
Volume: 4
Issue: 1
Pages: 13-13
ISSN: 1471-2288 (ISSN-L)
DOI: 10.1186/1471-2288-4-13
PMC: PMC443510
OpenAlex: W2162929498
Cited by: 181
References: 31
Citations by year: 2026: 4 · 2025: 2 · 2024: 6 · 2023: 5 · 2022: 5 · 2021: 5 · 2020: 10 · 2019: 11 · 2018: 6 · 2017: 12 · 2016: 17 · 2015: 9 · 2014: 4 · 2013: 10 · 2012: 8
FWCI: 12.49
Type: journal article
Language: en
Open access: gold
doi.org
Licence: www.springer.com/tdm (unspecified)
Locations: BMC Medical Research Methodology (publishedVersion)
PubMed Central (publishedVersion, other-oa)
PubMed (publishedVersion)
LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) (submittedVersion, cc-by)
DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Universitat de Girona Digital Repository (Universitat de Girona) (submittedVersion, cc-by)
Repositori UJI (Universitat Jaume I) (submittedVersion, other-oa)
RECERCAT (Consorci de Serveis Universitaris de Catalunya) (submittedVersion, cc-by)
Topics: Physical Sciences › Mathematics › Statistics and Probability › Benford’s Law and Fraud Detection
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
Keywords: test statistics, p-values, statistical reporting errors, rounding errors, digit preference, medical research papers, nature, British Medical Journal
MeSH terms: Data Interpretation, Statistical, Humans, Periodicals as Topic, Quality Control, Confidence Intervals

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Incongruence between test statistics and P values in medical papers

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks