The DOI matches its Crossref record.
Reference citations in radiology: accuracy and appropriateness of use in two major journals.
Abstract
OBJECTIVE: Errors in reference citation and use are common in the medical and scientific literature. The prevalence of such errors in the radiology literature has not been reported. We did a study to assess the accuracy and appropriateness of use of references cited in two general radiology journals. MATERIALS AND METHODS: All references cited in the June 1993 issues of the American Journal of Roentgenology and Radiology were numbered consecutively. Fifty references were chosen at random from each journal, and copies of the original publications were obtained from the medical library at our institution or through interlibrary loan. Each reference was studied for accuracy and appropriateness of its citation in the June 1993 journal article (the "index article"). Errors were classified as major or minor in each category. Data were analyzed with the SAS statistical package. RESULTS: Forty-seven (94%) of 50 references were obtained from AJR, and 48 (96%) of 50 from Radiology. Of the 47 from the AJR, one (2%) had a major error and 21 (45%) had a minor error in accuracy. Of the 48 from Radiology, two (4%) had a major error and 11 (23%) had a minor error in accuracy. These values were significantly different for minor errors (p = .0188), but not for major ones (p = 1.000). When we adjusted for index article type, error rates for the two journals were not significantly different (p = .0612). We found four major errors (9%) and two minor errors (4%) in appropriateness of citation in the AJR references we studied. Three references (6%) from Radiology contained major errors in appropriateness of use; we found no minor errors of that type. These values were not significantly different (p = .232 for minor errors; p = .709 for major errors). One error in accuracy prevented location of the original reference. Errors were not related to the number of references cited in an index article (p = .528 for accuracy; p = .092 for appropriateness). CONCLUSION: The rate of minor errors in accuracy of references is fairly high in the two journals studied and is comparable to rates previously reported for other types of journals. The rate of major errors in accuracy of references is slightly lower than rates for other types of journals. The percentage of cited references that could not be located was also smaller than in previous reports. Errors in citation appropriateness were less common as well. Given the small number of errors that prevented references from being located, significant expenditure of time and money by journal staff members in checking references is probably not justified. However, authors should be encouraged to exercise greater care in checking all of their references for both accuracy and appropriateness of use. Differences in error rates between AJR and Radiology may have resulted in part from the random sampling method, which produced different mixtures of index articles for the two journals.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Five studies provided numbers, for a mean factor of 1.15 errors per index quotation error [17, 30, 58, 60], but many reported merely the first error of a quotation.”
From Systematic review and meta-analysis of quotation inaccuracy in medicine (2025) · cites this paper as [60]
In the citing paper
“Yet, some of the lowest rates of quotation errors (at 4.1%,[29] 4.7%,[32] and 5.7%[28]) might indicate that a much lower overall baseline error rate is feasible.”
From Accuracy of cited "facts" in medical research articles: A review of study methodology and recalculation of quotation error rate (2017) · cites this paper as [28]
In the citing paper
“In some cases, inclusion of inappropriate citations might be due to citation manipulation in which the authors intend to increase citation counts of unrelated articles.[26, 28]”
From Accuracy of cited "facts" in medical research articles: A review of study methodology and recalculation of quotation error rate (2017) · cites this paper as [28]
In the citing paper
“Unclear 36.0%Major: 8.6% Minor: 91.4%”
From Reference accuracy of primary studies published in peer-reviewed scholarly journals: A scoping review (2024) · cites this paper as Hansen and McIntire (1994)
Citations
Cites
Still being checked.
Cited by
Fostering integrity in research: Definitions, current knowledge, and future directions
Steneck, N. H. (2006) · Science and Engineering Ethics · doi:10.1007/pl00022268 · Cited by 407
A case for a duty to feed the hungry: GM plants and the third world
Carter, L. (2007) · Science and Engineering Ethics · doi:10.1007/s11948-006-0006-y · Cited by 265
Quotation accuracy in medical journal articles—a systematic review and meta-analysis
Jergas, H., & Baethge, C. (2015) · PeerJ · doi:10.7717/peerj.1364 · Cited by 88
“Further, we removed all studies one by one from the main analysis in order to test the robustness of results.”
BackgroundMethodInfluentialHidden dangers of a ‘citation culture’
Todd, P., & Ladle, R. J. (2008) · Ethics in Science and Environmental Politics · doi:10.3354/esep00091 · Cited by 88
Mogull, S. A. (2017) · PLoS ONE · doi:10.1371/journal.pone.0184727 · Cited by 75
Metadata
- Authors
- Hansen, M. E., & McIntire, D. D.
- Affiliations
- The University of Texas Southwestern Medical Center (US)
- Venue
- American Journal of Roentgenology
- Publisher
- American Roentgen Ray Society
- Published
- 1994-09
- Volume
- 163
- Issue
- 3
- Pages
- 719-723
- ISSN
- 0002-9580 (ISSN-L)
- 0361-803X
- 1546-3141
- OpenAlex
- W2041599160
- Cited by
- 46
- References
- 0
- Citations by year
- 2025: 1 · 2024: 1 · 2023: 1 · 2021: 2 · 2017: 3 · 2016: 1 · 2015: 1 · 2013: 3 · 2012: 1
- FWCI
- 2.58
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Journal of Roentgenology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiology practices and education
- Keywords
- citation errors, radiology literature, radiology journals, reference verification, bibliographic databases, reference management software
- MeSH terms
- Bibliographies as Topic, Data Interpretation, Statistical, Evaluation Studies as Topic, Humans, Periodicals as Topic, Publishing, Radiology, Random Allocation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Reference citations in radiology: accuracy and appropriateness of use in two major journals. https://app.cochat.ai/papers/10.2214/ajr.163.3.8079876
- The paper
- Hansen, M. E., & McIntire, D. D. (1994). Reference citations in radiology: accuracy and appropriateness of use in two major journals. American Journal of Roentgenology. https://doi.org/10.2214/ajr.163.3.8079876
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.