The DOI matches its Crossref record; 8 of the 10 references it cites were found in a registry or an index.
Reference accuracy in the emergency medicine literature
Abstract
Study objective To determine the incidence and nature of errors in the citation and quotation of references contained in the emergency medicine literature. Design A retrospective analysis of a random sample of articles and references found in the three major emergency medicine journals. Setting A university/county hospital. Methods We examined single issues of three emergency medicine journals: Annals of Emergency Medicine, Journal of Emergency Medicine, and American Journal of Emergency Medicine. Interventions None. Measurements Four independent reviewers assessed 145 references from 46 referring authors for citational and quotational accuracy. Main results Major and minor citation errors were found in 10.3% and 17.2% of reference listings, respectively. Qualitative quotational errors were found in 35.2% of references. Eighty-two percent of these errors were considered to be major. Quantitative quotational errors were found in 47% of references reviewed. Secondary rather than primary reference sources were used in 41.4% of references reviewed. Conclusion This study demonstrates a substantial error rate in the citation and quotation of reference sources in the emergency medicine literature. In addition, verification of primary source material was not done by a large percentage of the authors reviewed. Recommendations for improving the accuracy of the emergency medicine literature are offered.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Seven studies presented agreement figures of error assessment by raters for an average kappa of 0.73 (range: 0.61–0.96) [33, 42, 43, 46, 52, 56, 63], indicating good interrater-agreement.”
From Systematic review and meta-analysis of quotation inaccuracy in medicine (2025) · cites this paper as [46]
In the citing paper
“Generally, each assertion was evaluated by multiple experts and the classification of quotation error was determined by consensus.[19, 20, 22, 27, 31, 32]”
From Accuracy of cited "facts" in medical research articles: A review of study methodology and recalculation of quotation error rate (2017) · cites this paper as [27]
In the citing paper
“Yet, several studies also noted some degree of difficulty,[20, 27, 31] subjectivity,[31, 32] and disagreement[19, 22, 27, 31] among the authors while evaluating assertions.”
From Accuracy of cited "facts" in medical research articles: A review of study methodology and recalculation of quotation error rate (2017) · cites this paper as [27]
In the citing paper
“Among the studies that provided the frequency of inter-rater agreement, a good to excellent agreement between experts was reported at 83.3%–87.5%,[27] 87.9%,[22] and 90.4%.[31]”
From Accuracy of cited "facts" in medical research articles: A review of study methodology and recalculation of quotation error rate (2017) · cites this paper as [27]
In the citing paper
“Unclear 27.5% Author, year published”
From Reference accuracy of primary studies published in peer-reviewed scholarly journals: A scoping review (2024) · cites this paper as Goldberg et al. (1993)
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
UNIFORM REQUIREMENTS FOR MANUSCRIPTS SUBMITTED TO BIOMEDICAL JOURNALS
Davidoff, F., Godlee, F., Hoey, J., Glass, R. M., Overbeke, J., Utiger, R. D., Nicholls, M. G., Horton, R. C., Nylenna, M., Højgaard, L., et al. (1988) · Indian Journal of Pharmacology · doi:10.4103/ijpha_2003355_330 · Cited by 303
How accurate are quotations and references in medical journals?
de Lacey, G., Record, C., & Wade, J. (1985) · BMJ · doi:10.1136/bmj.291.6499.884 · Cited by 160
Quotational and Reference Accuracy in Surgical Journals: A Continuing Peer Review Problem
Evans, J. T. (1990) · JAMA · doi:10.1001/jama.1990.03440100059009 · Cited by 129
Eichorn, P., & Yankauer, A. (1987) · American Journal of Public Health · doi:10.2105/ajph.77.8.1011 · Cited by 114
An investigation of the validity of bibliographic citations
Broadus, R. N. (1983) · Journal of the American Society for Information Science · doi:10.1002/asi.4630340206 · Cited by 63
(1977) · PubMed · Cited by 44
Accuracy of Published Medical Reference Citations
Goodrich, J. E., & Roland, C. G. (1977) · Journal of Technical Writing and Communication · doi:10.2190/2b2a-f34l-0txg-wnq7 · Cited by 34
Thoughts About Medical Writing XXXVII. Verify Your References
Roland, C. G. (1976) · Anesthesia & Analgesia · doi:10.1213/00000539-197609000-00023 · Cited by 9
Research works printed but not linked: 1
- International Committee of Medical Journal Editors, 1988, Uniform requirements for manuscripts submitted for medical journals, Ann Intern Med, 108, 258, 10.7326/0003-4819-108-2-258 · doi:10.7326/0003-4819-108-2-258
Cited by
Fostering integrity in research: Definitions, current knowledge, and future directions
Steneck, N. H. (2006) · Science and Engineering Ethics · doi:10.1007/pl00022268 · Cited by 407
“Typically, checks of the accuracy of citations (citational errors) turn up error rates in the range of 30%-50% or higher.(63-79) Less commonly, but still in the 10%-30% range, researchers make substantive errors when quoting other publications—errors commonly labeled “quotational errors.”
BackgroundA case for a duty to feed the hungry: GM plants and the third world
Carter, L. (2007) · Science and Engineering Ethics · doi:10.1007/s11948-006-0006-y · Cited by 265
Quotation accuracy in medical journal articles—a systematic review and meta-analysis
Jergas, H., & Baethge, C. (2015) · PeerJ · doi:10.7717/peerj.1364 · Cited by 88
“76—if reported (Goldberg et al., 1993; Schulmeister, 1998; Reddy et al., 2008; Buijze et al., 2012; Luo et al., 2013)— the interrater reliability is sufficient according to the criteria of Landis & Koch (1977).”
BackgroundMethodInfluentialHidden dangers of a ‘citation culture’
Todd, P., & Ladle, R. J. (2008) · Ethics in Science and Environmental Politics · doi:10.3354/esep00091 · Cited by 88
“For example, the number of miscitations (also called misquotations) in the biomedical literature varies between 6% in radiology journals (Hansen & McIntire 1994) and 35.2% in emergency medicine journals (Goldberg et al. 1993).”
BackgroundInfluentialMogull, S. A. (2017) · PLoS ONE · doi:10.1371/journal.pone.0184727 · Cited by 75
Metadata
- Authors
- Goldberg, R., Newton, E., Cameron, J., Jacobson, R., Chan, L., Bukata, W. R., & Rakab, A.
- Affiliations
- University of Southern California (US)
- University of California, Irvine Medical Center (US)
- Venue
- Annals of Emergency Medicine
- Publisher
- Elsevier BV
- Published
- 1993-09
- Volume
- 22
- Issue
- 9
- Pages
- 1450-1454
- ISSN
- 0196-0644 (ISSN-L)
- OpenAlex
- W2020956308
- Cited by
- 49
- References
- 10
- Citations by year
- 2025: 2 · 2023: 2 · 2022: 1 · 2021: 3 · 2020: 2 · 2019: 1 · 2018: 2 · 2017: 3 · 2016: 1 · 2015: 1 · 2014: 1 · 2013: 4 · 2012: 1
- FWCI
- 2.89
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- Locations
- Annals of Emergency Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Library and Information Sciences › Publishing and Scholarly Communication
- Keywords
- citation errors, citation accuracy, emergency medicine literature, quotation errors, bibliographic errors, scientific integrity, emergency medicine journal
- MeSH terms
- Bibliographies as Topic, Classification, Emergency Medicine, Evaluation Studies as Topic, Periodicals as Topic, Random Allocation, Bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Reference accuracy in the emergency medicine literature. https://app.cochat.ai/papers/10.1016/s0196-0644(05)81995-x
- The paper
- Goldberg, R., Newton, E., Cameron, J., Jacobson, R., Chan, L., Bukata, W. R., & Rakab, A. (1993). Reference accuracy in the emergency medicine literature. Annals of Emergency Medicine. https://doi.org/10.1016/s0196-0644(05)81995-x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.