Importance, Errors, and Patterns of Quotations to Psychiatric Original Articles
The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
Introduction A substantial rate of quotation errors has been reported in medical journal publications: about 25% of all quotations are wrong. It is, however, entirely unclear how important quotation errors are for the message of quoting articles. Methods This is a case study in form of a retrospective quotation analysis of a cohort of 72 psychiatric original articles (index articles) from 5 German-language general psychiatric journals. Main outcomes were importance and accuracy of quotations from the 2 calendar years following the publication of index articles. Results Fifty-one index articles were quoted 235 times in 109 quoting articles. Almost all quotations were of medium (76% [95% CI: 70%; 81%]) or high (20% [15%, 25%]) importance for the message of the quoting paper. Regarding quotation accuracy, 44 quotations (19% [14%; 24%]) were rated as minor, and 51 (22% [17%; 27%]) as major errors. In multivariable analyses, no statistically significant and practically relevant factors associated with quotation inaccuracy emerged, such as self-quotation, impact factor of the quoting journal, or importance. Among quoting articles, 7 (6% [3%; 13%]) showed a pattern of predominantly quoting index articles from the time span relevant to the calculation of the impact factor. Discussion Quotations are important for the message of the quoting paper. Therefore, quotation errors may be detrimental to scientific reasoning and may undermine public trust in medical science. The present investigation is a case study, and its results are exploratory. While it is plausible that the findings translate into other environments, independent replication is needed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In the meantime, new studies have been published e.g., [3, 4, 10].”
From Systematic review and meta-analysis of quotation inaccuracy in medicine (2025) · cites this paper as [10]
In the citing paper
“Baethge (2020) reported that 21% of wrong quotations were of high, and 74% of wrong quotations of intermediate importance for the message of the paper, and only few were negligible (5%).”
From Systematic review and meta-analysis of quotation inaccuracy in medicine (2025) · cites this paper as Baethge (2020)
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148 · cited 3×
“76 across 5 studies, sufficient according to the criteria by Landis & Koch [21].”
MethodInfluentialInterpersonal Psychotherapy for Depression: A Meta-Analysis
Cuijpers, P., Geraedts, A. S., van Oppen, P., Andersson, G., Markowitz, J. C., & van Straten, A. (2011) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2010.10101411 · Cited by 511
Bouter, L. M., Tijdink, J., Axelsen, N., Martinson, B. C., & ter Riet, G. (2016) · Research Integrity and Peer Review · doi:10.1186/s41073-016-0024-5 · Cited by 211 · cited 1×
“In the field, quotation misbehavior seems to be well known: Dutch researchers asked attendees of World Conferences on Research Integrity to rank 60 research misbehaviors [18].”
BackgroundHow accurate are quotations and references in medical journals?
de Lacey, G., Record, C., & Wade, J. (1985) · BMJ · doi:10.1136/bmj.291.6499.884 · Cited by 160 · cited 1×
“De Lacey and co-authors [1], in what is probably the first study on the subject in medicine in 1985, related a 15 % error rate among 300 quotations.”
BackgroundBaethge, C. (2008) · Deutsches Ärzteblatt international · doi:10.3238/arztebl.2008.0037 · Cited by 108 · cited 1×
“While English is the lingua franca in science, regional languages continue to have an important role in the distribution of medical knowledge [24].”
BackgroundSelf-citationThe accuracy of citation and quotation in otolaryngology/head and neck surgery journals
Fenton, J. E., Brazier, H., Souza, A., Hughes, J. P., & McShane, D. P. (2000) · Clinical Otolaryngology · doi:10.1046/j.1365-2273.2000.00322.x · Cited by 94
Busse, R., Geissler, A., Aaviksoo, A., Cots, F., Hakkinen, U., Kobel, C., Mateus, C., Or, Z., O'Reilly, J., Serden, L., et al. (2013) · BMJ · doi:10.1136/bmj.f3197 · Cited by 94
Quotation accuracy in medical journal articles—a systematic review and meta-analysis
Jergas, H., & Baethge, C. (2015) · PeerJ · doi:10.7717/peerj.1364 · Cited by 88 · cited 9×
“If other studies in the field reported interrater reliability, however, results were encouraging: as reported in the overview by Jergas & Baethge [2], mean Cohen’s kappa was 0.”
BackgroundResultInfluentialSelf-citationCitation and quotation accuracy in three anatomy journals
Lukić, I. K., Lukić, A., Glunc̆ić, V., Katavić, V., Vuc̆enik, V., & Marus̆ić, A. (2004) · Clinical Anatomy · doi:10.1002/ca.10255 · Cited by 56
Reference accuracy in peer-reviewed pediatric orthopaedic literature
Davids, J. R., Weigl, D. M., Edmonds, J. P., & Blackhurst, D. W. (2010) · The Journal of Bone and Joint Surgery-American Volume · doi:10.2106/jbjs.i.00063 · Cited by 55 · cited 1×
“[16] reported error rates of 59, 82, and 83 %, respectively.”
BackgroundReference accuracy in the emergency medicine literature
Goldberg, R., Newton, E., Cameron, J., Jacobson, R., Chan, L., Bukata, W. R., & Rakab, A. (1993) · Annals of Emergency Medicine · doi:10.1016/s0196-0644(05)81995-x · Cited by 49
Finkenzeller, W., Zobel, I., Rietz, S., Schramm, E., & Berger, T. (2009) · Der Nervenarzt · doi:10.1007/s00115-008-2649-1 · Cited by 42
Attachment security and alexithymia in a heavy drinking sample
Thorberg, F. A., Young, R. M., Sullivan, K. A., Lyvers, M., Hurst, C. P., Connor, J. P., & Feeney, G. F. X. (2011) · Addiction Research & Theory · doi:10.3109/16066359.2011.580065 · Cited by 38
Schouler‐Ocak, M., Bretz, H. J., Hauth, I., Montesinos, A. H., Koch, E., Drießen, M., & Heinz, A. (2010) · Psychiatrische Praxis · doi:10.1055/s-0030-1248489 · Cited by 34
Hypnosedative Use and Predictors of Successful Withdrawal in New Patients Attending a Falls Clinic
Joester, J., Vogler, C., Chang, K., & Hilmer, S. N. (2010) · Drugs & Aging · doi:10.2165/11584480-000000000-00000 · Cited by 28
Glaesmer, H., Kallert, T. W., Brähler, E., Hofmeister, D., & Gunzelmann, T. (2010) · Psychiatrische Praxis · doi:10.1055/s-0029-1223435 · Cited by 24
Reference Errors in Otolaryngology–Head and Neck Surgery Literature
Armstrong, M. F., Conduff, J. H., Fenton, J. E., & Coelho, D. H. (2018) · Otolaryngology–Head and Neck Surgery · doi:10.1177/0194599818772521 · Cited by 24 · cited 1×
“For example, a study of references in otolaryngology— head and neck surgery—journals from 2017 [22] found a 9 % [6.”
BackgroundBaethge, C. (2013) · BMC Psychiatry · doi:10.1186/1471-244x-13-102 · Cited by 15 · cited 5×
“The 2-year observation period is a consequence of the fact that the first part of this study was finished in 2012 [6].”
BackgroundInfluentialSelf-citationAccuracy of references in psychiatric literature: a survey of three journals
Lawson, L. A., & Fosker, R. (1999) · Psychiatric Bulletin · doi:10.1192/pb.23.4.221 · Cited by 12 · cited 4×
“With 40 % [34 %; 47 %], the rate of quotation errors is higher than the average rate estimated in our previous meta-analysis (25 % [20 %; 32 %]) [2] and higher than in 2 earlier studies on quotations in psychiatry [3, 4] but not outside the range of earlier studies.”
BackgroundResultInfluentialADHS und Störung des Sozialverhaltens: Trends im deutschsprachigen Raum
Petermann, F., & Lehmkuhl, G. (2011) · Zeitschrift für Kinder- und Jugendpsychiatrie und Psychotherapie · doi:10.1024/1422-4917/a000141 · Cited by 9
Einfluss unsicherer Bindungsstile und ADHS auf Alkoholabhängigkeit
Ridinger, M., König, S., Lange, K. M., & Wodarz, N. (2009) · Der Nervenarzt · doi:10.1007/s00115-009-2729-x · Cited by 7
Petermann, F., & Schüßler, G. (2010) · Zeitschrift für psychosomatische Medizin und Psychotherapie · doi:10.13109/zptm.2010.56.3.297 · Cited by 7 · cited 1×
“In a similar approach, in 2010, authors published a bibliometric analysis on “Psychotherapy research in the Germanspeaking community” on the basis of the volumes 2008 and 2009 of 3 German language journals [8], among them Zeitschrift für Psychiatrie, Psychologie und Psychotherapie, another of the journals included in…”
MethodHeidenreich, U., & Baethge, C. (2012) · Psychiatrische Praxis · doi:10.1055/s-0031-1276955 · Cited by 7 · cited 2×
“The study is part of a larger project, starting in 2010, on psychiatric journals in regional languages [5, 6].”
BackgroundSelf-citationStelling, K., Kuhn, K., Riedel-Heller, S. G., & Jungbauer, J. (2008) · Psychiatrische Praxis · doi:10.1055/s-2008-1067572 · Cited by 4
Depression und Response: Der Einfluss von Persönlichkeit und Kognition
David, I., Brunnauer, A., Laux, G., & Zwick, S. (2009) · Psychiatrische Praxis · doi:10.1055/s-0028-1090102 · Cited by 4
Status der psychosomatischen Forschung im deutschsprachigen Bereich
Schüßler, G., & Petermann, F. (2011) · Psychotherapeut · doi:10.1007/s00278-011-0843-2 · Cited by 3
Alzheimer-Krankheit und senile Demenz
Wallesch, C.-W. (2011) · Fortschritte der Neurologie · Psychiatrie · doi:10.1055/s-0029-1246086 · Cited by 3 · cited 1×
“The preceding 2 years were also the frame of reference for an editorial in Fortschritte der Psychiatrie und Neurologie on how a particular topic (dementia research) had been covered in the same periodical [13].”
BackgroundGodemann, F., Hauth, I., Gutzmann, H., & Heinz, A. (2009) · Psychiatrische Praxis · doi:10.1055/s-0028-1090257 · Cited by 1
Psychiatrie der Lebensspanne? – Der Altersbezug in der psychiatrischen Forschung
Sikorski, C., & Motzek, T. (2010) · Psychiatrische Praxis · doi:10.1055/s-0030-1248623 · Cited by 1 · cited 2×
“For example, in an article published in Psychiatrische Praxis in 2010, the authors investigated whether and in what way age was treated as a demographic variable in original articles [7].”
Background
Research works printed but not linked: 10
- G Pieters, 2001, Formele en inhoudelijke nauwkeurigheid van referenties in het Tijdschrift voor Psychiatrie [Accuracy and appropriateness of references in the “Tijdschrift voor Psychiatrie”], Tijdschr Psychiatr, 43, 349
- K Stengler, 2011, Gender- und geschlechtsspezifische Aspekte in der psychiatrischen und psychotherapeutischen Forschung: eine bibliometrische Analyse. Z Psychiatr, Psychol Psychother, 59, 305
- U de Vries, 2011, Risiken und Chancen für Kinder in belasteten Familien [Risk and opportunities for children in problem families] Prax Kinderpsychol und Kinderpsychiatr, 60, 576
- S Mertens, 2011, The virtues of correct citation: Careful referencing is important but is often neglected—even in peer-reviewed articles, Dtsch Arztebl Int, 108, 550
- J Staedt, 2009, Einfluss erhöhter Lichtintensität auf die Verweildauer von stationär behandelten depressiven Patienten [Influence of light intensity on the length of hospitalisation of depressive patients], Nervenheilkunde, 28, 223
- J Staedt, 2010, Schlafstörungen bei schizophrenen Erkrankungen. Bedeutung und Optionen einer multimodalen Hilfestellung [Sleep disorders in schizophrenia. importance and options for a multi-dimensional support], Fortschr Neurol Psychiatr, 78, 70
- F Hoffmann, 2009, Verbrauch von Zolpidem und Zopiclon auf Privatrezepten zwischen 1993 und 2007. [Use of zolpidem and zopiclone on private prescription between 1993 and 2007], Nervenarzt, 80, 578
- S Tagay, 2009, Wie hängen Religiosität, psychische Symptombelastung und Integration zusammen? Eine vergleichende Betrachtung der Religiosität bei türkischen/kurdischen Migranten gegenüber Deutschen [How are religiosity, psychological distress and integration interrelated? A comparative study of the religiosity in Turkish/Kurdish migrants in comparisons to Germans], Psychiatr Prax, 36, 286
- J Jeske, 2009, Risikofaktor Krankheitsverarbeitung – Zusammenhänge zwischen der Krankheitsverarbeitung einer elterlichen psychischen Erkrankung und der gesundheitsbezogenen Lebensqualität der Kinder [Risk factor coping with a disease—associations between coping and health related quality of life of children with a mentally ill parent] Z Psychiatr, Psychol Psychother, 57, 207
- S Voigt-Radloff, 2011, Alltagsbewältigung bei Demenz: Medikamentöse und nicht medikamentöse Interventionen zeigen kleine Effekte auf heterogenen Skalen. Eine Synopse vier systematischer Reviews [Daily functioning in dementia: Pharmacological and non-pharmacological interventions demonstrate small effects on heterogeneous scales. A synopsis of four health technology assessments], Psychiatr Prax, 38, 221
Cited by
Systematic review and meta-analysis of quotation inaccuracy in medicine
Baethge, C., & Jergas, H. (2025) · Research Integrity and Peer Review · doi:10.1186/s41073-025-00173-z · Cited by 11
“Out of 5094 database records screened and 52 study reports assessed as full texts we included 18 reports on 18 new studies [3, 4, 10, 23–38], for a total of 46 studies – together with 28 studies [2, 3, 5, 6, 16, 17, 17, 39–45 , Studies were published between 1985 and 2024, covered quotations…”
InfluentialSelf-citationCitation Misuses in the Biomedical Literature and Its Effects on Public Health
Dumas-Mallet, E., & Gonon, F. (2022) · Springer eBooks · doi:10.1007/978-3-030-99680-2_42 · Cited by 6
Wakeling, S., Paramita, M. L., & Pinfield, S. (2025) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.70000 · Cited by 11
“…as educational research (Lazonder & Janssen, 2022), foot and ankle surgery (Luo et al., 2013), history (Cumberledge et al., 2023), psychiatry (Baethge, 2020), orthopedic and sports medicine (Gazendam et al., 2021; Homeier et al., 2024), neurosurgery (Montenegro et al., 2021), library and…”
InfluentialLe mésusage des citations et ses conséquences en médecine
Dumas-Mallet, E., Boraud, T., & Gonon, F. (2021) · médecine/sciences · doi:10.1051/medsci/2021142 · Cited by 9
Unverified history: an analysis of quotation accuracy in leading history journals
Cumberledge, A., Smith, N., & Riley, B. W. (2023) · Scientometrics · doi:10.1007/s11192-023-04755-w · Cited by 5
“…medicine, (Goldberg et al., 1993, p. 1450), neurosurgery (Montenegro et al., 2021a, 2021b, p. 13), nursing (Schulmeister, 1998, p. 143), psychiatry (Baethge, 2020, p. 247), manual therapy, (Gosling et al., 2004, p. 36), pediatrics (Gupta et al., 2005, p. 140), veterinary medicine…”
Metadata
- Authors
- Baethge, C.
- Affiliations
- University of Cologne (DE)
- Corresponding author
- Baethge, Christopher
- ORCID
- Baethge, Christopher
- Venue
- Pharmacopsychiatry
- Publisher
- Georg Thieme Verlag KG
- Published
- 2020-06-02
- Volume
- 53
- Issue
- 06
- Pages
- 247-255
- ISSN
- 0176-3679 (ISSN-L)
- 1439-0795
- OpenAlex
- W3032089832
- Cited by
- 7
- References
- 29
- Citations by year
- 2025: 2 · 2024: 1 · 2023: 1 · 2022: 1 · 2021: 1 · 2020: 1
- FWCI
- 0.61
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Pharmacopsychiatry (publishedVersion)
- PubMed (publishedVersion)
- Kölner Universitäts PublikationsServer (Universität zu Köln) (publishedVersion)
- Funders
- This study has not been externally funded.
- Topics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- quotation errors, citation patterns, impact factor, self-quotation, scientific integrity
- MeSH terms
- Periodicals as Topic, Psychiatry, Writing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.