The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Medicine Residents' Understanding of the Biostatistics and Results in the Medical Literature
Abstract
CONTEXT: Physicians depend on the medical literature to keep current with clinical information. Little is known about residents' ability to understand statistical methods or how to appropriately interpret research outcomes. OBJECTIVE: To evaluate residents' understanding of biostatistics and interpretation of research results. DESIGN, SETTING, AND PARTICIPANTS: Multiprogram cross-sectional survey of internal medicine residents. MAIN OUTCOME MEASURE: Percentage of questions correct on a biostatistics/study design multiple-choice knowledge test. RESULTS: The survey was completed by 277 of 367 residents (75.5%) in 11 residency programs. The overall mean percentage correct on statistical knowledge and interpretation of results was 41.4% (95% confidence interval [CI], 39.7%-43.3%) vs 71.5% (95% CI, 57.5%-85.5%) for fellows and general medicine faculty with research training (P < .001). Higher scores in residents were associated with additional advanced degrees (50.0% [95% CI, 44.5%-55.5%] vs 40.1% [95% CI, 38.3%-42.0%]; P < .001); prior biostatistics training (45.2% [95% CI, 42.7%-47.8%] vs 37.9% [95% CI, 35.4%-40.3%]; P = .001); enrollment in a university-based training program (43.0% [95% CI, 41.0%-45.1%] vs 36.3% [95% CI, 32.6%-40.0%]; P = .002); and male sex (44.0% [95% CI, 41.4%-46.7%] vs 38.8% [95% CI, 36.4%-41.1%]; P = .004). On individual knowledge questions, 81.6% correctly interpreted a relative risk. Residents were less likely to know how to interpret an adjusted odds ratio from a multivariate regression analysis (37.4%) or the results of a Kaplan-Meier analysis (10.5%). Seventy-five percent indicated they did not understand all of the statistics they encountered in journal articles, but 95% felt it was important to understand these concepts to be an intelligent reader of the literature. CONCLUSIONS: Most residents in this study lacked the knowledge in biostatistics needed to interpret many of the results in published clinical research. Residency programs should include more effective biostatistics training in their curricula to successfully prepare residents for this important lifelong learning skill.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
General practitioners' perceptions of the route to evidence based medicine: a questionnaire survey
McColl, A., Smith, H., White, P., & Field, J. (1998) · BMJ · doi:10.1136/bmj.316.7128.361 · Cited by 888
Coomarasamy, A., & Khan, K. S. (2004) · BMJ · doi:10.1136/bmj.329.7473.1017 · Cited by 715
Instruments for Evaluating Education in Evidence-Based Practice: A Systematic Review
Shaneyfelt, T., Baum, K. D., Bell, D., Feldstein, D., Houston, T. K., Kaatz, S., Whelan, C., & Green, M. (2006) · JAMA · doi:10.1001/jama.296.9.1116 · Cited by 427
Self-citationA hierarchy of effective teaching and learning to acquire competence in evidenced-based medicine
Khan, K. S., & Coomarasamy, A. (2006) · BMC Medical Education · doi:10.1186/1472-6920-6-59 · Cited by 263
Norman, G. R., & Shannon, S. (1998) · Europe PMC (PubMed Central) · Cited by 253
Teaching critical appraisal skills in healthcare settings
Horsley, T., Hyde, C., Santesso, N., Parkes, J., Milne, R., & Stewart, R. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001270.pub2 · Cited by 247
Evidence‐based medicine in general practice: beliefs and barriers among Australian GPs
Young, J. M., & Ward, J. E. (2001) · Journal of Evaluation in Clinical Practice · doi:10.1046/j.1365-2753.2001.00294.x · Cited by 247
Haynes, B. (2007) · Evidence Based Nursing · doi:10.1136/ebn.10.1.6 · Cited by 239
A review of journal clubs in postgraduate medical education
Alguire, P. C. (1998) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.1998.00102.x · Cited by 207
A systematic review of the effectiveness of critical appraisal skills training for clinicians
Taylor, R., Reeves, B., Ewings, P., Binns, S., Keast, J., & Mears, R. (2000) · Medical Education · doi:10.1046/j.1365-2923.2000.00574.x · Cited by 182
Cited by
A Dirty Dozen: Twelve P-Value Misconceptions
Goodman, S. (2008) · Seminars in Hematology · doi:10.1053/j.seminhematol.2008.04.003 · Cited by 680
Marrie, R. A., Dawson, N. V., & Garland, A. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.05.015 · Cited by 330
Gore, A., Kadam, Y., Chavan, P., & Dhumale, G. (2012) · International Journal of Applied and Basic Medical Research · doi:10.4103/2229-516x.96792 · Cited by 28
Metadata
- Authors
- Windish, D. M., Huot, S. J., & Green, M. L.
- Venue
- JAMA
- Publisher
- American Medical Association (AMA)
- Published
- 2007-09-05
- Volume
- 298
- Issue
- 9
- Pages
- 1010
- ISSN
- 0002-9955 (ISSN-L)
- 0098-7484
- OpenAlex
- W2103638447
- Cited by
- 423
- References
- 24
- FWCI
- 24.63
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Medicine Residents' Understanding of the Biostatistics and Results in the Medical Literature. https://app.cochat.ai/papers/10.1001/jama.298.9.1010
- The paper
- Windish, D. M., Huot, S. J., & Green, M. L. (2007). Medicine Residents' Understanding of the Biostatistics and Results in the Medical Literature. JAMA. https://doi.org/10.1001/jama.298.9.1010
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.