The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
Common statistical and research design problems in manuscripts submitted to high-impact medical journals.
Open accessAbstract
BACKGROUND: To assist educators and researchers in improving the quality of medical research, we surveyed the editors and statistical reviewers of high-impact medical journals to ascertain the most frequent and critical statistical errors in submitted manuscripts. FINDINGS: The Editors-in-Chief and statistical reviewers of the 38 medical journals with the highest impact factor in the 2007 Science Journal Citation Report and the 2007 Social Science Journal Citation Report were invited to complete an online survey about the statistical and design problems they most frequently found in manuscripts. Content analysis of the responses identified major issues. Editors and statistical reviewers (n = 25) from 20 journals responded. Respondents described problems that we classified into two, broad themes: A. statistical and sampling issues and B. inadequate reporting clarity or completeness. Problems included in the first theme were (1) inappropriate or incomplete analysis, including violations of model assumptions and analysis errors, (2) uninformed use of propensity scores, (3) failing to account for clustering in data analysis, (4) improperly addressing missing data, and (5) power/sample size concerns. Issues subsumed under the second theme were (1) Inadequate description of the methods and analysis and (2) Misstatement of results, including undue emphasis on p-values and incorrect inferences and interpretations. CONCLUSIONS: The scientific quality of submitted manuscripts would increase if researchers addressed these common design, analytical, and reporting issues. Improving the application and presentation of quantitative methods in scholarly manuscripts is essential to advancing medical research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Arithmetic and calculation errors were considered an important and common mistake by medical journal editors. 30”
From Automated detection of over- and under-dispersion in baseline tables in randomised controlled trials. (2022) · cites this paper as [30]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology · doi:10.2307/2075823 · Cited by 18,724
Introductory Econometrics: A Modern Approach
Wooldridge, J. M. (1999) · Cited by 14,451
Hierarchical Linear Models: Applications and Data Analysis Methods
Davidian, M. (2003) · Journal of the American Statistical Association · doi:10.1198/jasa.2003.s288 · Cited by 13,723
(2002) · Cited by 13,211
Missing data: our view of the state of the art
Schafer, J. L., & Graham, J. W. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.2.147 · Cited by 11,638
Applied Longitudinal Data Analysis: Modeling Change and Event Occurrence
Singer, J. D., & Willett, J. B. (2003) · doi:10.1093/acprof:oso/9780195152968.001.0001 · Cited by 10,647
RUBIN, D. B. (1976) · Biometrika · doi:10.1093/biomet/63.3.581 · Cited by 9,925
Grading quality of evidence and strength of recommendations
(2004) · BMJ · doi:10.1136/bmj.328.7454.1490 · Cited by 8,477
(2001) · Statistics for Psychologists · doi:10.4324/9781410605542-11 · Cited by 6,877
Nonparametric Statistical Methods
(1999) · Technometrics · doi:10.1080/00401706.1999.10485954 · Cited by 6,090
Research works printed but not linked: 3
- Institute for Scientific Information: Journal Citation Report. 2007, Thompson Scientific
- Snijders T, Bosker RJ: Multilevel Analysis. 1999, Thousand Oaks: Sage Publications, Inc
- Institute of Medicine: The Learning Healthcare System: Workshop Summary (IOM Roundtable on Evidence-Based Medicine). 2007, Washington, DC: National Academies Press
Cited by
Un sistema de clasificación de los diseños de investigación en psicología
Ato, M., López-García, J. J., & Benavente, A. (2013) · Anales de Psicología · doi:10.6018/analesps.29.3.178511 · Cited by 2,254
To test or not to test: Preliminary assessment of normality when comparing two independent samples
Rochon, J., Gondan, M., & Kieser, M. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-81 · Cited by 296
Statistical methodology in oral and dental research: Pitfalls and recommendations
Hannigan, A., & Lynch, C. D. (2013) · Journal of Dentistry · doi:10.1016/j.jdent.2013.02.013 · Cited by 200
Dean, J., Wong, K. H., Welsh, L. C., Jones, A.-B., Schick, U., Newbold, K. L., Bhide, S. A., Harrington, K. J., Nutting, C. M., & Gulliford, S. (2016) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2016.05.015 · Cited by 124
Multiple imputation of multiple multi-item scales when a full imputation model is infeasible
Plumpton, C. O., Morris, T., Hughes, D. A., & White, I. R. (2016) · BMC Research Notes · doi:10.1186/s13104-016-1853-5 · Cited by 76
“Poor handling and reporting of missing data may result in misleading conclusions and are one of the main reasons for publication rejections [28, 29].”
Background
Metadata
- Authors
- Fernandes-Taylor, S., Hyun, J. K., Reeder, R. N., & Harris, A. H.
- Affiliations
- VA Palo Alto Health Care System (US)
- ORCID
- Harris, Alex HS
- Venue
- BMC Research Notes
- Published
- 2011-08-19
- Volume
- 4
- Issue
- 1
- Pages
- 304-304
- ISSN
- 1756-0500 (ISSN-L)
- PMC
- PMC3224575
- OpenAlex
- W1994930505
- Cited by
- 75
- References
- 67
- Citations by year
- 2026: 3 · 2025: 8 · 2024: 3 · 2023: 3 · 2022: 8 · 2021: 6 · 2020: 5 · 2019: 4 · 2018: 9 · 2017: 3 · 2016: 5 · 2015: 4 · 2014: 3 · 2013: 7 · 2012: 4
- FWCI
- 4.79
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/2.0 (tdm)
- Locations
- BMC Research Notes (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- U.S. Department of Veterans Affairs
- Office of Research and Development
- Health Services Research and Development
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- statistical errors, study design flaws, medical research quality, propensity score, missing data, sample size and power, model assumption violation, p-values
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Common statistical and research design problems in manuscripts submitted to high-impact medical journals. https://app.cochat.ai/papers/10.1186/1756-0500-4-304
- The paper
- Fernandes-Taylor, S., Hyun, J. K., Reeder, R. N., & Harris, A. H. (2011). Common statistical and research design problems in manuscripts submitted to high-impact medical journals. BMC Research Notes. https://doi.org/10.1186/1756-0500-4-304
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.