The DOI matches its Crossref record; 27 of the 28 references it cites were found in a registry or an index; 7 of the 32 sources its claims cite were checked for support.
Manuscript Referencing Errors and Their Impact on Shaping Current Evidence
Open accessAbstract
It is imperative that articles published in reputable peer-reviewed journals provide balanced, fair, objective, and accurate references. However, studies on the accuracy of references in various scientific disciplines demonstrate an error rate of 25%-54%. These errors can range from minor errors in citation accuracy to major errors that alter the original content and meaning of the material referenced. This article discusses importance of citation accuracy, reviews principles of good citation practices, and offers recommendations aimed to decrease citation error rates.
Overview
CoChat Summary
TL;DR
This commentary argues that inaccurate referencing in peer-reviewed literature is a widespread and under-discussed problem that can distort the evidence base, inflate or diminish authors' perceived impact, and propagate retracted or misinterpreted findings. It reviews principles of good citation practice and offers recommendations for authors, reviewers, and journals to reduce citation error rates.
Key findings
- Studies on reference accuracy across scientific disciplines report error rates of 25%-54%, ranging from minor citation inaccuracies to errors that alter the meaning of the referenced material.
- In a study asking scientists how well they knew the content of references they cited, 40% reported knowing them only "slightly well" or "not well at all"; authors were also influenced by a paper's citation index, being less familiar with details of prominent papers than less-cited ones (described as preliminary data).
- de Lacey and colleagues found a 15% misquotation rate in medical journals, confirmed by a more recent study by Mogull; misquotation significance ranged from "trivial" to "seriously misleading," with all six highly regarded journals analyzed publishing two to five seriously misleading quotations in 50 randomly selected articles.
- Retracted articles continue to be actively cited after retraction, with most citing articles giving a positive overview of the retracted research; the paper's example is a 2018 *Environmental Research* review citing a source retracted in 2017 for ethical conflicts and erroneous information.
Methods
- Design: a commentary (not original research) that discusses citation accuracy, reviews principles of good citation practice, and offers recommendations.
- A literature search was conducted to identify relevant examples supporting the principles discussed; the author presents reflections on key citation practices with applicable examples from identified articles.
- No systematic review methodology, data extraction, or quantitative synthesis is described.
Limitations
- Not stated in the paper: the commentary does not include a limitations section.
- Evident from the text: this is an expert commentary rather than a systematic study, so the cited error rates and examples are drawn selectively from prior literature rather than from a comprehensive or reproducible search; the author also notes that studies evaluating the impact of reference management software on error rates are lacking, and that it is difficult to know when deceptive citation practices occur.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
6 Valid · 0 Not valid · 16 Not checked · 5 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“In their study of the accuracy of quotations and references in medical journals, de Lacey and colleagues found a 15% misquotation rate, 4”
What the sources say
- Supportedcites [4] 4. de Lacey G, Record C, Wade J. How accurate are quotations and references in medical journals? Br Med J (Clin Res Ed). 1985;291(6499):884-886. source
The Discussion states that the authors found misquotations in 15% of all references. This directly supports the citing sentence’s reported misquotation rate. (LLM, conf=0.95)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“While academics educate their students in how to properly cite research and reference appropriate sources, citation errors still occur in published manuscripts, even those written by expert researchers.”
What the sources say
- Not matchedcites [1] 1. Harzing A. Are our referencing errors undermining our scholarship and credibility? J Organ Behav . 2002;23(1):127-148.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Supportedcites [2] 2. Jergas H, Baethge C. Quotation accuracy in medical journal articles-a systematic review and meta-analysis. PeerJ . 2015;3:e1364. source
The Abstract reports quotation errors in published medical journal articles, estimating a total error rate of 25.4%, and concludes that such errors are common. The Discussion (‘What are the consequences of quotation errors?’) also describes these errors as a problem in scholarly medical writing. (LLM, conf=0.90)
- Not matchedcites [3] 3. Mogull SA. Accuracy of cited 'facts' in medical research articles: a review of study methodology and recalculation of quotation error rate. PLoS One . 2017;12(9):e0184727.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“studies on the accuracy of references in various scientific disciplines demonstrate an error rate of 25%-54%.”
- Also stated in: § American Journal of Pharmaceutical Education 2020; 84 (7) Article 7846. · boosted
“Several studies on the accuracy of references in various scientific disciplines demonstrate an error rate of 25%-54%. 2,9-11”
What the sources say
- Partly supportedcites [2] 2. Jergas H, Baethge C. Quotation accuracy in medical journal articles-a systematic review and meta-analysis. PeerJ . 2015;3:e1364. sourceExperimental — accuracy not yet measured
The Results (Main analysis; page unavailable) estimate a 25.4% total quotation-error rate in medical journal articles. The Discussion compares findings with other academic fields, but does not report a 25%–54% error-rate range across disciplines; the Results instead give a 6.7%–83.0% range for total errors among the medical studies. (LLM, conf=0.88)
- Not matchedcites [9]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Partly supportedcites [10] 10. Siebers R, Holt S. Accuracy of references in five leading medical journals. Lancet . 2000;356(9239):1445. sourceExperimental — accuracy not yet measured
The table in “Accuracy of references in five leading medical journals” reports reference error rates, including 27.7% and 40.3%. But this study covers five medical journals, not various scientific disciplines, and its reported range is 4.1%–40.3%, not 25%–54%. (LLM, conf=0.88)
- Not matchedcites [11] 11. Key JD, Roland CG. Reference accuracy in articles accepted for publication in the Archives of Physical Medicine and Rehabilitation. Arch Phys Med Rehabil . 1977;58(3):136-137.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § American Journal of Pharmaceutical Education 2020; 84 (7) Article 7846. · boosted
Every source the paper cites for this claim was checked and supports it.
In the paper
“erroneous or inaccurate quotations, if continually repeated, may turn inaccuracies into conventional knowledge. 4”
What the sources say
- Supportedcites [4] 4. de Lacey G, Record C, Wade J. How accurate are quotations and references in medical journals? Br Med J (Clin Res Ed). 1985;291(6499):884-886. source
The Abstract says inaccurate quotations and citations can cause untruths to become “accepted fact.” The Discussion gives an example of erroneous statements being cited again years after correction, supporting the claim about repetition. (LLM, conf=0.93)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: unclear — It is unclear whether it could be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
In the paper
“When scientists across various disciplines were asked how well they knew the content of the references they cited in their research papers, 40% reported that they knew them only 'slightly well' or 'not well at all.'”
What the sources say
- Not matchedcites [17] 17. Teplitskiy M, Duede E, Menietti M, Lakhani K. Why (almost) everything we know about citations is wrong: evidence from authors.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
4 more claims
Create a free account to see all 27 claims and to verify the 4 references still open.
- It may state two separate claims as one. 9
- Probably not a substantial claim. 12
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“as they may mislead readers and have the potential to affect patient care1,3-5”
From Quotation Errors in High-Impact-Factor Orthopaedic and Sports Medicine Journals (2021) · cites this paper as [3]
In the citing paper
“Quotation errors are more serious than citation errors”
From Quotation Errors in High-Impact-Factor Orthopaedic and Sports Medicine Journals (2021) · cites this paper as [3]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Self-check results appear here once an independent check has confirmed them.
Cited works that were retracted
Works this paper cites that were later retracted, from the retraction notices publishers deposit. Major when the notice came out before this paper was published.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
“Kern, 2017, Retracted article: systematic assessment of research on autism spectrum disorder (ASD) and mercury reveals conflicts of interest and the need for transparency in autism research, Sci Eng Ethics, 23, 1689, 10.1007/s11948-015-9713-6”
Cited work 10.1007/s11948-015-9713-6 · retracted 2015-10-27 · notice 10.1007/s11948-015-9713-6 · this paper published 2020-07
A note, not an issue: for example, a cited work that was retracted only after this paper was published, which its authors could not have known.
In the paper
“Kern, 2017, Systematic assessment of research on autism spectrum disorder (ASD) and mercury reveals conflicts of interest and the need for transparency in autism research, Sci Eng Ethics, 1691, 10.1007/s11948-017-9983-2”
Cited work 10.1007/s11948-017-9983-2 · retraction date not known · this paper published 2020-07
Citations
Cites
2 retracted
Kern, J. K., Geier, D. A., Deth, R. C., Sykes, L. K., Hooker, B. S., Love, J. M., Bjørklund, G., Chaigneau, C. G., Haley, B. E., & Geier, M. R. (2015) · Science and Engineering Ethics · doi:10.1007/s11948-015-9713-6 · Cited by 21
RetractedKern, J. K., Geier, D. A., Deth, R. C., Sykes, L. K., Hooker, B. S., Love, J. M., Bjørklund, G., Chaigneau, C. G., Haley, B. E., & Geier, M. R. (2017) · Science and Engineering Ethics · doi:10.1007/s11948-017-9983-2 · Cited by 14
RetractedPhenomena of Retraction: Reasons for Retraction and Citations to the Publications
Budd, J. M., Sievert, M., & Schultz, T. R. (1998) · JAMA · doi:10.1001/jama.280.3.296 · Cited by 230
Post retraction citations in context: a case study
Bar-Ilan, J., & Halevi, G. (2017) · Scientometrics · doi:10.1007/s11192-017-2242-0 · Cited by 191
The Continued Use of Retracted, Invalid Scientific Literature
Pfeifer, M. P. (1990) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1990.03440100140020 · Cited by 188
Harzing, A. (2002) · Journal of Organizational Behavior · doi:10.1002/job.125 · Cited by 188
How accurate are quotations and references in medical journals?
de Lacey, G., Record, C., & Wade, J. (1985) · BMJ · doi:10.1136/bmj.291.6499.884 · Cited by 160
Toxic metal(loid)-based pollutants and their possible role in autism spectrum disorder
Bjørklund, G., Skalny, A. V., Rahman, M. M., Dadar, M., yassa, H. A., Aaseth, J., Chirumbolo, S., Геннадиевна, С. М., & Tinkov, A. A. (2018) · Environmental Research · doi:10.1016/j.envres.2018.05.020 · Cited by 130
The accuracy of citation and quotation in otolaryngology/head and neck surgery journals
Fenton, J. E., Brazier, H., Souza, A., Hughes, J. P., & McShane, D. P. (2000) · Clinical Otolaryngology · doi:10.1046/j.1365-2273.2000.00322.x · Cited by 94
Quotation accuracy in medical journal articles—a systematic review and meta-analysis
Jergas, H., & Baethge, C. (2015) · PeerJ · doi:10.7717/peerj.1364 · Cited by 88
Cited by
Acut, D. P., Malabago, N. K., Malicoban, E. V., Galamiton, N. S., & Garcia, M. B. (2024) · Internet Reference Services Quarterly · doi:10.1080/10875301.2024.2426793 · Cited by 33
“Such references, when incorporated into academic papers, could undermine the credibility of the research, leading to flawed conclusions or invalid citations (Rivkin, 2020).”
Quotation accuracy in educational research articles
Lazonder, A. W., & Janssen, N. (2021) · Educational Research Review · doi:10.1016/j.edurev.2021.100430 · Cited by 24
Quotation Errors in High-Impact-Factor Orthopaedic and Sports Medicine Journals
Gazendam, A., Cohen, D., Morgan, S., Ekhtiari, S., & Ghert, M. (2021) · JBJS Open Access · doi:10.2106/jbjs.oa.21.00019 · Cited by 13
“The independent variables were (1) string or single citation, (2) journal, (3) level of evidence, (4) type of study, and (5) total number of citations in the paper.”
BackgroundAn author’s guide to mastering academic writing skills: Discussion of a medical manuscript
EL-Sobky, T. A. (2021) · Journal of Musculoskeletal Surgery and Research · doi:10.25259/jmsr_79_2021 · Cited by 9
Kamel, S. A., & EL-Sobky, T. A. (2023) · Research Integrity and Peer Review · doi:10.1186/s41073-023-00135-3 · Cited by 10
Metadata
- Authors
- Rivkin, A.
- Affiliations
- Fairleigh Dickinson University (US)
- Corresponding author
- Rivkin, Anastasia
- ORCID
- Rivkin, Anastasia
- Venue
- American Journal of Pharmaceutical Education
- Publisher
- Elsevier BV
- Published
- 2020-07
- Volume
- 84
- Issue
- 7
- Pages
- ajpe7846
- ISSN
- 0002-9459 (ISSN-L)
- PMC
- PMC7405306
- OpenAlex
- W3015373820
- Cited by
- 32
- References
- 28
- Citations by year
- 2026: 8 · 2025: 2 · 2024: 5 · 2023: 7 · 2022: 4 · 2021: 6
- FWCI
- 15.83
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- Locations
- American Journal of Pharmaceutical Education (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Education › Academic integrity and plagiarism
- Keywords
- citation errors, citation accuracy, citation practices, bibliographic references, evidence-based medicine, peer-reviewed journals
- MeSH terms
- Data Accuracy, Humans, Peer Review, Publishing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-11-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Manuscript Referencing Errors and Their Impact on Shaping Current Evidence. https://app.cochat.ai/papers/10.5688/ajpe7846
- The paper
- Rivkin, A. (2020). Manuscript Referencing Errors and Their Impact on Shaping Current Evidence. American Journal of Pharmaceutical Education. https://doi.org/10.5688/ajpe7846
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.