The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Reference Errors in Otolaryngology–Head and Neck Surgery Literature
Abstract
Objective: Proper use of citation and quotation is crucial to the integrity of the medical literature. The purpose of this study was to determine the prevalence of quotation and citation errors in otolaryngology–head and neck surgery (OHNS) journals and how they have changed over time. Study Design: Literature review. Methods: Fifty references were randomly selected from the first published issue of 2017 for 8 leading OHNS journals. These were analyzed for errors in citation (data elements by which the article is referenced) and quotation (factual inaccuracies of the reference). Citation errors were categorized as major, intermediate, or minor. Quotation errors were categorized as major or minor. Results were compared with data from 1997 articles. Results: Citation errors occurred in 17% of all references studied, with 34% classified as major. Quotation errors occurred in 9%, with 69% classified as major. There was no association between journal impact factor and total number of errors (r = −0.33, P =. 42). This compares with a 37% citation error rate (32% major) and 17% quotation error rate (65% major) from 1997. Conclusion: Citation and quotation errors are still prevalent in the OHNS literature albeit decreased from previously reported data. Improvement in citation errors may be due to technological improvements in reference management. However, it is the continued responsibility of the authors, reviewers, and editors to further reduce error rates to maintain the integrity of our publications.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In studies done before the emergence of large language models, citation error rates averaged between 20% to 30% with about half of those being errors in the actual quotations”
From Adding a simple log to in-text citations to strengthen information literacy and argumentation while blocking casual misuse of generative AI (2026) · cites this paper as Armstrong et al., 2018
In the citing paper
“Reference accuracy is critical for timely access to knowledge about results of medical studies because human lives may depend on it (Wyles, 2004) and contributes to the development of evidence-based medicine (Armstrong et al., 2018).”
From Reference accuracy of primary studies published in peer-reviewed scholarly journals: A scoping review (2024) · cites this paper as Armstrong et al., 2018
In the citing paper
“These findings have been demonstrated in other surgical specialties and subspecialties, with a quotation error rate of 7.8% to 18.6%10,17-19.”
From Quotation Errors in High-Impact-Factor Orthopaedic and Sports Medicine Journals (2021) · cites this paper as [18]
In the citing paper
“the current sample size is in line with previous literature on the topic2,10,18,19.”
From Quotation Errors in High-Impact-Factor Orthopaedic and Sports Medicine Journals (2021) · cites this paper as [18]
Citations
Cites
Kulkarni, A. V. (2009) · JAMA · doi:10.1001/jama.2009.1307 · Cited by 817
Quotational and Reference Accuracy in Surgical Journals: A Continuing Peer Review Problem
Evans, J. T. (1990) · JAMA · doi:10.1001/jama.1990.03440100059009 · Cited by 129
The accuracy of citation and quotation in otolaryngology/head and neck surgery journals
Fenton, J. E., Brazier, H., Souza, A., Hughes, J. P., & McShane, D. P. (2000) · Clinical Otolaryngology · doi:10.1046/j.1365-2273.2000.00322.x · Cited by 94
Self-citationQuotation accuracy in medical journal articles—a systematic review and meta-analysis
Jergas, H., & Baethge, C. (2015) · PeerJ · doi:10.7717/peerj.1364 · Cited by 88 · cited 2×
“4%.(10) In 1997, Fenton et al reported overall citation and quotation error rates of 37% and 17%, respectively, in otolaryngology, which were consistent with the rates of other medical specialties at the time.”
BackgroundResultMogull, S. A. (2017) · PLoS ONE · doi:10.1371/journal.pone.0184727 · Cited by 75 · cited 5×
“8%).(9) Conversely, Jergas and Baethge reported a major quotation error rate of 11.”
BackgroundMethodInfluentialRisk factors for citation errors in peer‐reviewed nursing journals
Lok, C. K. W., Chan, M. T. V., & Martinson, I. M. (2001) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2001.01748.x · Cited by 73
Technical editing of research reports in biomedical journals
Wager, E., & Middleton, P. (2008) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000002.pub3 · Cited by 68
Reference accuracy in peer-reviewed pediatric orthopaedic literature
Davids, J. R., Weigl, D. M., Edmonds, J. P., & Blackhurst, D. W. (2010) · The Journal of Bone and Joint Surgery-American Volume · doi:10.2106/jbjs.i.00063 · Cited by 55
Accuracy of references in general surgical journals — An old problem revisited
Reddy, M. S., Srinivas, S., Sabanayagam, N., & Balasubramanian, S. P. (2008) · The Surgeon · doi:10.1016/s1479-666x(08)80067-4 · Cited by 41
Accuracy of references in burns journals
Al-Benna, S., Rajgarhia, P., Ahmed, S., & Sheikh, Z. (2009) · Burns · doi:10.1016/j.burns.2008.11.014 · Cited by 41
Research works printed but not linked: 2
- 10.1001/jama.263.10.1353 · DOI · Paper page
- Clarivate Analytics.2016journal citation reports.https://clarivate.com/products/journal‐citation‐reports/. Published 2017. Accessed September 12 2017.
Cited by
Quotation accuracy in educational research articles
Lazonder, A. W., & Janssen, N. (2021) · Educational Research Review · doi:10.1016/j.edurev.2021.100430 · Cited by 24
How accurate is the neurosurgery literature? A review of references
Montenegro, T. S., Hines, K., Gonzalez, G. A., Fatema, U., Partyka, P. P., Thalheimer, S., & Harrop, J. (2021) · Acta Neurochirurgica · doi:10.1007/s00701-020-04576-3 · Cited by 16
Quotation Errors in High-Impact-Factor Orthopaedic and Sports Medicine Journals
Gazendam, A., Cohen, D., Morgan, S., Ekhtiari, S., & Ghert, M. (2021) · JBJS Open Access · doi:10.2106/jbjs.oa.21.00019 · Cited by 13
Bagga, R., Cay, P., Ricketts, D., Roper, T., & Phadnis, J. (2021) · Shoulder & Elbow · doi:10.1177/1758573220950235 · Cited by 12
Reference accuracy in spine surgery
Montenegro, T. S., Hines, K., Partyka, P. P., & Harrop, J. (2021) · Journal of Neurosurgery: Spine · doi:10.3171/2020.6.spine20640 · Cited by 12
Metadata
- Authors
- Armstrong, M. F., Conduff, J. H., Fenton, J. E., & Coelho, D. H.
- Affiliations
- Virginia Commonwealth University (US)
- University of Limerick (IE)
- Corresponding author
- Coelho, Daniel H.
- Venue
- Otolaryngology–Head and Neck Surgery
- Publisher
- Wiley
- Published
- 2018-04-24
- Volume
- 159
- Issue
- 2
- Pages
- 249-253
- ISSN
- 0161-6439 (ISSN-L)
- 0194-5998
- 1097-6817
- OpenAlex
- W2801334190
- Semantic Scholar
- 70637ad97dd934ece0ca781b98c92707e80ece0d
- Cited by
- 24
- References
- 13
- Citations by year
- 2025: 3 · 2023: 2 · 2022: 5 · 2021: 9 · 2020: 4 · 2018: 1
- FWCI
- 16.97
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Otolaryngology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Social Sciences › Education › Academic integrity and plagiarism
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- citation errors, quotation errors, otolaryngology journals, reference management software, journal impact factor, scientific integrity
- MeSH terms
- Humans, Otolaryngology, Periodicals as Topic, Publishing, Otorhinolaryngologic Surgical Procedures, Bibliometrics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Reference Errors in Otolaryngology–Head and Neck Surgery Literature. https://app.cochat.ai/papers/10.1177/0194599818772521
- The paper
- Armstrong, M. F., Conduff, J. H., Fenton, J. E., & Coelho, D. H. (2018). Reference Errors in Otolaryngology–Head and Neck Surgery Literature. Otolaryngology–Head and Neck Surgery. https://doi.org/10.1177/0194599818772521
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.