The DOI matches its Crossref record; 17 of the 18 references it cites were found in a registry or an index.
Accuracy of Citation and Quotation in Foot and Ankle Surgery Journals
Abstract
Background: A recent review of technical editing of research suggests that over one third of references cited in articles in medical journals have some inaccuracies and one fifth of quotations to references in these articles are not accurate. Methods: Two hundred and forty-nine citation references and 408 quotes from 25 articles published in 5 orthopaedic journals were randomly selected to determine referencing accuracy. The presence of citation errors was examined by 1 of the authors while the presence of quotation errors was determined by 2 of the authors. Full copies of articles as well as the references were obtained to compare the accuracies. Results: The total citation error rate was 41% (103 out of 249 references), and the total quotation error rate was 20% (80 out of 408 quotes) for the 5 orthopaedic journals. Conclusion: Citation and quotation errors were still relatively common in orthopaedic journals. While we did not identify any factors associated with citation and quotation errors, the use of technical editing may reduce the amount of citation errors. Clinical Relevance: Readers and authors should be aware that many citations of studies are inaccurate and one should review the original source if it is to be used in another publication or to guide clinical treatment.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Seven studies presented agreement figures of error assessment by raters for an average kappa of 0.73 (range: 0.61–0.96) [33, 42, 43, 46, 52, 56, 63], indicating good interrater-agreement.”
From Systematic review and meta-analysis of quotation inaccuracy in medicine (2025) · cites this paper as [52]
In the citing paper
“Generally, each assertion was evaluated by multiple experts and the classification of quotation error was determined by consensus.[19, 20, 22, 27, 31, 32]”
From Accuracy of cited "facts" in medical research articles: A review of study methodology and recalculation of quotation error rate (2017) · cites this paper as [31]
In the citing paper
“Among the studies that provided the frequency of inter-rater agreement, a good to excellent agreement between experts was reported at 83.3%–87.5%,[27] 87.9%,[22] and 90.4%.[31]”
From Accuracy of cited "facts" in medical research articles: A review of study methodology and recalculation of quotation error rate (2017) · cites this paper as [31]
In the citing paper
“In a 2009 sample of 249 references 5 orthopedic journals (2 journals, 40%, were the same as the previous study[22]), another study[31] reported a quotation error rate of 20% (16% to 24% at a 95% confidence interval). (The content quotation error rate for this study[31] data was recalculated here at 17.9%.)”
From Accuracy of cited "facts" in medical research articles: A review of study methodology and recalculation of quotation error rate (2017) · cites this paper as [31]
In the citing paper
“Yet, several studies also noted some degree of difficulty,[20, 27, 31] subjectivity,[31, 32] and disagreement[19, 22, 27, 31] among the authors while evaluating assertions.”
From Accuracy of cited "facts" in medical research articles: A review of study methodology and recalculation of quotation error rate (2017) · cites this paper as [31]
8 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Impact factor: a valid measure of journal quality?
(2003) · Europe PMC (PubMed Central) · Cited by 584
Quotational and Reference Accuracy in Surgical Journals: A Continuing Peer Review Problem
Evans, J. T. (1990) · JAMA · doi:10.1001/jama.1990.03440100059009 · Cited by 129
The Ups and Downs of Journal Impact Factors
Ogden, T. L., & Bartley, D. L. (2008) · The Annals of Occupational Hygiene · doi:10.1093/annhyg/men002 · Cited by 101 · cited 1×
“While some agree that the impact factor is a good indicator of how well the physicians view the journal,(22) others argue that there are shortcomings such as short citation period (1 year).(18) In this study, we were not able to observe any articles’ demographic data as risk factors for higher citation error rates.”
BackgroundThe accuracy of citation and quotation in otolaryngology/head and neck surgery journals
Fenton, J. E., Brazier, H., Souza, A., Hughes, J. P., & McShane, D. P. (2000) · Clinical Otolaryngology · doi:10.1046/j.1365-2273.2000.00322.x · Cited by 94 · cited 2×
“The first type involves errors in bibliography listing.(7,10,11,21,26) Author citation mistakes may lead to difficulties in locating valuable resources for other researchers.”
BackgroundResultRisk factors for citation errors in peer‐reviewed nursing journals
Lok, C. K. W., Chan, M. T. V., & Martinson, I. M. (2001) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2001.01748.x · Cited by 73 · cited 1×
“Long reference lists in articles, single author, and articles published in journals with low impact factor were all identified as risk factors in certain citation errors.(17) Impact factor of 2009 is defined as citations to articles from journal X in 2007 and 2008 in 2009 divided by number of substantial articles publ…”
BackgroundTechnical editing of research reports in biomedical journals
Wager, E., & Middleton, P. (2008) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000002.pub3 · Cited by 68 · cited 5×
“Previous studies have characterized reference errors,(1,2,5-7,10-12,21,23,26) most notable the Cochrane review in 2008, which reviewed 69 reference accuracy studies with over 27 000 references evaluated.(26) The 2008 review reported a median citation error rate per journal of 38%, with a range of 4% to 67%.”
BackgroundInfluentialReferencing and quotation accuracy in four manual therapy journals
Gosling, C. M., Cameron, M., & Gibbons, P. F. (2004) · Manual Therapy · doi:10.1016/s1356-689x(03)00056-0 · Cited by 58
Reference accuracy in peer-reviewed pediatric orthopaedic literature
Davids, J. R., Weigl, D. M., Edmonds, J. P., & Blackhurst, D. W. (2010) · The Journal of Bone and Joint Surgery-American Volume · doi:10.2106/jbjs.i.00063 · Cited by 55 · cited 5×
“Citations errors were classified as major, intermediate, or minor errors to be consistent with previous studies.(5,7) The major citation errors were any errors in first author’s name, journal title, publication year, volume number, and beginning page number.”
BackgroundMethodResultInfluentialReference accuracy in the emergency medicine literature
Goldberg, R., Newton, E., Cameron, J., Jacobson, R., Chan, L., Bukata, W. R., & Rakab, A. (1993) · Annals of Emergency Medicine · doi:10.1016/s0196-0644(05)81995-x · Cited by 49 · cited 1×
“The first type involves errors in bibliography listing.(7,10,11,21,26) Author citation mistakes may lead to difficulties in locating valuable resources for other researchers.”
BackgroundReference accuracy in the dermatologic literature
George, P. M., & Robbins, K. (1994) · Journal of the American Academy of Dermatology · doi:10.1016/s0190-9622(94)70136-9 · Cited by 45 · cited 1×
“The first type involves errors in bibliography listing.(7,10,11,21,26) Author citation mistakes may lead to difficulties in locating valuable resources for other researchers.”
Background
Research works printed but not linked: 9
- Foot and Ankle Surgery (European volume). Guide for authors. http://www.elsevier.com/wps/find/journaldescription.cws_home/672694/authorinstructions Accessed December 20, 2011.
- Journal Citation Reports. Journal impact factor 2009. http://scientific.thomson.com/products/jcr/. Accessed December 20, 2011.
- Journal of Bone and Joint Surgery (American volume). Instructions for authors. http://jbjs.org/public/instructionsauthors.aspx. Accessed December 20, 2011.
- Journal of Bone and Joint Surgery (British volume). The structure of a paper. http://www.bjj.boneandjoint.org.uk/site/media/Authors/Paperstructure.pdf. Accessed December 20, 2011.
- The Journal of Foot and Ankle Surgery (American volume). Guide for authors. http://www.elsevier.com/wps/find/journaldescription.cws_home/662210/authorinstructions. Accessed December 20, 2011.
- Ogden TL, 2008, Ann Occup Hyg, 52, 73
- PubMed. http://www.ncbi.nlm.nih.gov/sites/entrez. Accessed November 9, 2011.
- Saha S, 2003, J Med Libr Assoc, 91, 42
- Wager E, 2008, Cochrane Database Syst Rev, 4, MR000002
Cited by
Quotation accuracy in medical journal articles—a systematic review and meta-analysis
Jergas, H., & Baethge, C. (2015) · PeerJ · doi:10.7717/peerj.1364 · Cited by 88
“…Evans, Nadjari & Burchell, 1990; Goldberg et al., 1993; Schulmeister, 1998; Pieters, Ceysens & De Heyn, 2001; Lukić et al., 2004; Buchan, Norris & Kuper, 2005; Reddy et al., 2008; Awrey et al., 2010; Davids et al., 2010; Buijze et al., 2012; Mertens & Baethge, 2011; Luo et al., 2013; see Table 1).”
BackgroundMethodResultInfluentialMogull, S. A. (2017) · PLoS ONE · doi:10.1371/journal.pone.0184727 · Cited by 75
Preserving the Integrity of Citations and References by All Stakeholders of Science Communication
Gasparyan, A. Y., Yessirkepov, M., Voronov, A. A., Gerasimov, A. N., Kostyukova, E. I., & Kitas, G. D. (2015) · Journal of Korean Medical Science · doi:10.3346/jkms.2015.30.11.1545 · Cited by 70
“1545 points in the primary literature may improve the referencing and shape the whole publishing landscape (7,21,22).”
BackgroundQuotation errors in general science journals
Smith, N., & Cumberledge, A. (2020) · Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rspa.2020.0538 · Cited by 32
“Regardless of the cause, the most pragmatic approach to improving this problem is to improve the review and verification of references [1,20].”
BackgroundReference Errors in Otolaryngology–Head and Neck Surgery Literature
Armstrong, M. F., Conduff, J. H., Fenton, J. E., & Coelho, D. H. (2018) · Otolaryngology–Head and Neck Surgery · doi:10.1177/0194599818772521 · Cited by 24
“degree of human error exists in classifying a reference error as major, intermediate, or minor.(8,9) The variability in study design introduces some bias in the interpretation of metaanalyses published on the topic of reference error.”
BackgroundResultInfluential
Metadata
- Authors
- Luo, M., Li, C. C., Molina, D., Andersen, C. R., & Panchbhavi, V. K.
- Affiliations
- The University of Texas Medical Branch at Galveston (US)
- Venue
- Foot & Ankle International
- Publisher
- SAGE Publications
- Published
- 2013-02-04
- Volume
- 34
- Issue
- 7
- Pages
- 949-955
- ISSN
- 1071-1007 (ISSN-L)
- 1944-7876
- OpenAlex
- W2316884669
- Cited by
- 41
- References
- 18
- Citations by year
- 2026: 2 · 2025: 4 · 2024: 3 · 2023: 4 · 2022: 4 · 2021: 8 · 2020: 5 · 2019: 1 · 2018: 1 · 2017: 2 · 2016: 4 · 2015: 3
- FWCI
- 15.79
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Foot & Ankle International (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Library and Information Sciences › Publishing and Scholarly Communication
- Keywords
- citation errors, quotation errors, foot and ankle surgery, orthopaedic journals, technical editing, citation accuracy
- MeSH terms
- Foot, Humans, Orthopedics, Periodicals as Topic, Publishing, Bibliometrics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Accuracy of Citation and Quotation in Foot and Ankle Surgery Journals. https://app.cochat.ai/papers/10.1177/1071100713475354
- The paper
- Luo, M., Li, C. C., Molina, D., Andersen, C. R., & Panchbhavi, V. K. (2013). Accuracy of Citation and Quotation in Foot and Ankle Surgery Journals. Foot & Ankle International. https://doi.org/10.1177/1071100713475354
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.