Accuracy of Published Medical Reference Citations
Abstract
Among 2, 195 reference citations, published during 1975 in ten major US medical journals, 634 (29%) were found to be erroneous on direct checking of the original source. The percentage of error within individual journals ranged from 14 to 50 per cent. Such a high error rate would seem to seriously diminish the usefulness of published reference lists and, possibly, raise questions about the accuracy of other portions of the literature also.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The prevalence of errors of citation found in this study compares closely with the prevalences found by Goodrich and Roland in 1977.
“These figures compare closely with the prevalences of error found by Goodrich and Roland in their report in 1977 assessing 10 different medical journals.5”
From How accurate are quotations and references in medical journals? (1985) · cites this paper as [5]
Cites
Still being checked.
Cited by
Sorted by citations
How accurate are quotations and references in medical journals?
de Lacey, G., Record, C., & Wade, J. (1985) · BMJ · doi:10.1136/bmj.291.6499.884 · Cited by 160 · see citing works
Eichorn, P., & Yankauer, A. (1987) · American Journal of Public Health · doi:10.2105/ajph.77.8.1011 · Cited by 114 · see citing works
Risk factors for citation errors in peer‐reviewed nursing journals
Lok, C. K. W., Chan, M. T. V., & Martinson, I. M. (2001) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2001.01748.x · Cited by 73 · see citing works
Pseudo-understanding: an analysis of the dilution of value in healthcare
Fredriksson, J. J., Ebbevi, D., & Savage, C. (2015) · BMJ Quality & Safety · doi:10.1136/bmjqs-2014-003803 · Cited by 73 · see citing works
Technical editing of research reports in biomedical journals
Wager, E., & Middleton, P. (2008) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000002.pub3 · Cited by 68 · see citing works
Errors in Bibliographic Citations: A Continuing Problem
Sweetland, J. H. (1989) · The Library Quarterly · doi:10.1086/602160 · Cited by 64 · see citing works
Journal-to-journal citation data: Issues of validity and reliability
Rice, R. E., Borgman, C. L., Bednarski, D., & Hart, P. (1989) · Scientometrics · doi:10.1007/bf02017202 · Cited by 60 · see citing works
Reference accuracy in peer-reviewed pediatric orthopaedic literature
Davids, J. R., Weigl, D. M., Edmonds, J. P., & Blackhurst, D. W. (2010) · The Journal of Bone and Joint Surgery-American Volume · doi:10.2106/jbjs.i.00063 · Cited by 55 · see citing works
Reference accuracy in the emergency medicine literature
Goldberg, R., Newton, E., Cameron, J., Jacobson, R., Chan, L., Bukata, W. R., & Rakab, A. (1993) · Annals of Emergency Medicine · doi:10.1016/s0196-0644(05)81995-x · Cited by 49 · see citing works
Reference accuracy in the dermatologic literature
George, P. M., & Robbins, K. (1994) · Journal of the American Academy of Dermatology · doi:10.1016/s0190-9622(94)70136-9 · Cited by 45 · see citing works
A Survey of Reference Accuracy in Five National Dental Journals
Doms, C. (1989) · Journal of Dental Research · doi:10.1177/00220345890680030101 · Cited by 42 · see citing works
Quotation Accuracy in Review Articles
Neihouse, P. F., & Priske, S. C. (1989) · DICP · doi:10.1177/1060028089023007-813 · Cited by 29 · see citing works
Technical editing of research reports in biomedical journals
Wager, E., & Middleton, P. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000002.pub2 · Cited by 20 · see citing works
Accuracy of References in<i>Research Quarterly for Exercise and Sport</i>
Stull, G. A., Christina, R. W., & Quinn, S. A. (1991) · Research Quarterly for Exercise and Sport · doi:10.1080/02701367.1991.10608720 · Cited by 19 · see citing works
Tymvios, N., Hardison, D., Behm, M., Hallowell, M. R., & Gambatese, J. (2020) · Safety Science · doi:10.1016/j.ssci.2020.104927 · Cited by 19 · see citing works
Accuracy of References in Ten Library Science Journals
Colyar, N. N. (1992) · Cited by 18 · see citing works
Citation Errors in Two Journals of Psychiatry: A Retrospective Analysis
Wyles, D. F. (2004) · Behavioral & Social Sciences Librarian · doi:10.1300/j103v22n02_02 · Cited by 13 · see citing works
Accuracy of Reference Citations in Five Entomology Journals
Kristof, C. (1997) · American Entomologist · doi:10.1093/ae/43.4.246 · Cited by 13 · see citing works
Accuracy of references in psychiatric literature: a survey of three journals
Lawson, L. A., & Fosker, R. (1999) · Psychiatric Bulletin · doi:10.1192/pb.23.4.221 · Cited by 12 · see citing works
Reference Inaccuracies in Two Counseling Journals
White, A. J. (1987) · Counselor Education and Supervision · doi:10.1002/j.1556-6978.1987.tb00730.x · Cited by 10 · see citing works
Reference accuracy of primary studies about reference accuracy: A descriptive study
Logan, S. W., Hussong-Christian, U., Case, L., & Noregaard, S. (2024) · Journal of Librarianship and Information Science · doi:10.1177/09610006231224437 · Cited by 6 · see citing works
Reference List Inaccuracies: A Four‐Decade Comparison
White, A. J. (1987) · Journal of Counseling & Development · doi:10.1002/j.1556-6676.1987.tb00846.x · Cited by 6 · see citing works
Logan, S. W., Hussong-Christian, U., Case, L., & Noregaard, S. (2024) · Journal of Librarianship and Information Science · doi:10.1177/09610006231177715 · Cited by 6 · see citing works
Verify Your Citations: Accuracy of Reference Citations in Twelve Business and Economics Journals
O'Connor, L. G., & Kristof, C. (2001) · Journal of Business & Finance Librarianship · doi:10.1300/j109v06n04_03 · Cited by 10 · see citing works
Accuracy of References in Journal Literature of Medical Sciences: A Review
Gupta, V. K., & Babel, P. (2018) · IRA-International Journal of Management & Social Sciences (ISSN 2455-2267) · doi:10.21013/jmss.v12.n3.p2 · Cited by 5 · see citing works
Guraya, S. Y., & Arabia, S. (2014) · Cited by 6 · see citing works
Infusing Lesbigay Research into the Counseling Research Classroom
Erwin, T. M. (2006) · Journal of Homosexuality · doi:10.1300/j082v51n03_07 · Cited by 5 · see citing works
Pass It On: Errors in Direct Quotes in a Sample of Scholarly Journal Articles
Hernandez, N. R., & White, A. J. (1989) · Journal of Counseling & Development · doi:10.1002/j.1556-6676.1989.tb02132.x · Cited by 4 · see citing works
Giving Credit: How Well Do Librarians Cite and Quote Their Sources?
Genzinger, P., & Wills, D. (2017) · Reference & User Services Quarterly · doi:10.5860/rusq.57.1.6440 · Cited by 3 · see citing works
Reference inaccuracy: are articles cited without being read?
Navarro, F. A. (1999) · Journal of Information Science · doi:10.1177/016555159902500509 · Cited by 2 · see citing works
A Model for Technical Communication
Hamlin, D. M., & Harkins, C. (1983) · Journal of Technical Writing and Communication · doi:10.1177/004728168301300105 · Cited by 2 · see citing works
Kaestner, J. (1984) · BIBLIOTHEK Forschung und Praxis · doi:10.1515/bfup.1984.8.3.203 · Cited by 1 · see citing works
Research on Technical and Scientific Communication in Canada: A Bibliographical Odyssey
Connor, J. J. (1994) · Journal of Technical Writing and Communication · doi:10.2190/qdb6-rmlm-0l93-46ed
Documentation: A Functional Rationale
Allen, J. W. (1978) · Journal of Technical Writing and Communication · doi:10.2190/xx4v-f875-c9kc-n42l
- Authors
- Goodrich, J. E., & Roland, C. G.
- Affiliations
- Mayo Clinic (US)
- Corresponding author
- Roland, Charles G.
- Venue
- Journal of Technical Writing and Communication
- Publisher
- SAGE Publications
- Published
- 1977-01
- Volume
- 7
- Issue
- 1
- Pages
- 15-19
- ISSN
- 0047-2816 (ISSN-L)
- 1541-3780
- OpenAlex
- W2313083288
- Cited by
- 34
- References
- 0
- Citations by year
- 2024: 1 · 2023: 1 · 2020: 1 · 2018: 1 · 2017: 1 · 2015: 1 · 2014: 1
- FWCI
- 3.55
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Technical Writing and Communication (publishedVersion)
- Topics
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Academic Writing and Publishing
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › scientometrics and bibliometrics research
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Publishing and Scholarly Communication
- Keywords
- citation errors, medical journals, works cited, citation verification, medical literature
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review