Scientific fraud in 20 falsified anesthesia papers: Detection using financial auditing methods
The DOI matches its Crossref record; 23 of the 24 references it cites were found in a registry or an index.
Abstract
Data from natural sources show counter-intuitive distribution patterns for the leading digits to the left of the decimal point and the digit 1 is observed more frequently than all other numbers. This pattern, which was first described by Newcomb and later confirmed by Benford, is used in financial and tax auditing to detect fraud. Deviations from the pattern indicate possible falsifications. Anesthesiology journals are affected not only by ghostwriting and plagiarism but also by counterfeiting. In the present study 20 publications in anesthesiology known to be falsified by an author were investigated for irregularities with respect to Benford's law using the χ(2)-test and the Z-test. In the 20 retracted publications an average first-digit frequency of 243.1 (standard deviation SD ± 118.2, range: 30-592) and an average second-digit frequency of 132.3 (SD ± 72.2, range: 15-383) were found. The observed distribution of the first and second digits to the left of the decimal point differed significantly (p< 0.01) from the expected distribution described by Benford. Only the observed absolute frequencies for digits 3, 4 and 5 did not differ significantly from the expected values. In an analysis of each paper 17 out of 20 studies differed significantly from the expected value for the first digit and 18 out of 20 studies varied significantly from the expected value of the second digit. Only one paper did not vary significantly from expected values for the digits to the left of the decimal. For comparison, a meta-analysis using complex mathematical procedures was chosen as a control. The analysis showed a first-digit distribution consistent with the Benford distribution. Thus, the method used in the present study seems to be sensitive for detecting fraud. Additional statements of specificity cannot yet be made as this requires further analysis of data that is definitely not falsified. Future studies exploring conformity might help prevent falsified studies from being published.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Chi-square tests, Fisher exact tests, odds ratios, and risk ratios can be reproduced using absolute numbers given in crosstabs.18”
From Assessing Research Misconduct in Randomized Controlled Trials (2021) · cites this paper as [18]
In the citing paper
“We previously demonstrated that trials with individual participant data sharing have better performance on quality and integrity than trials without sharing.18”
From Assessing Research Misconduct in Randomized Controlled Trials (2021) · cites this paper as [18]
Citations
Cites
Statistics Notes: Diagnostic tests 1: sensitivity and specificity
Altman, D. G., & Bland, J. M. (1994) · BMJ · doi:10.1136/bmj.308.6943.1552 · Cited by 2,061
Fanelli, D. (2009) · PLoS ONE · doi:10.1371/journal.pone.0005738 · Cited by 1,911
Statistical Fraud Detection: A Review
Bolton, R. J., & Hand, D. J. (2002) · Statistical Science · doi:10.1214/ss/1042727940 · Cited by 1,450
Note on the Frequency of Use of the Different Digits in Natural Numbers
Newcomb, S. (1881) · American Journal of Mathematics · doi:10.2307/2369148 · Cited by 974
A Statistical Derivation of the Significant-Digit Law
Hill, T. P. (1995) · Statistical Science · doi:10.1214/ss/1177009869 · Cited by 670
The effective use of Benford's Law to assist in detecting fraud in accounting data
Durtschi, C., Hillison, W., & Pacini, C. (2004) · Digital Commons - University of South Florida (University of South Florida) · Cited by 466
The analysis of 168 randomised controlled trials to test data integrity
Carlisle, J. B. (2012) · Anaesthesia · doi:10.1111/j.1365-2044.2012.07128.x · Cited by 255
Ting, K. M. (2016) · Encyclopedia of Machine Learning and Data Mining · doi:10.1007/978-1-4899-7502-7_758-1 · Cited by 207
The Significant-Digit Phenomenon
Hill, T. P. (1995) · The American Mathematical Monthly · doi:10.1080/00029890.1995.11990578 · Cited by 183
Dexter, F., Bayman, E. O., & Epstein, R. H. (2010) · Anesthesia & Analgesia · doi:10.1213/ane.0b013e3181b5dcb7 · Cited by 148
Research works printed but not linked: 4
- Benford F (1938) The law of anomalous numbers. Proc Am Philos Soc 78:551–572
- Nigrini MJ (2000) Digital analysis using Benford’s law. Glob Audit:78
- Nigrini MJ (1996) A taxpayer compliance application of Benford’s law. J Am Tax Assoc 18:72–91
- Varian H (1972) Benford’s law. Am Stat 26:65–66
Cited by
Methods to assess research misconduct in health-related research: A scoping review
Bordewijk, E. M., Li, W., van Eekelen, R., Wang, R., Showell, M., Mol, B. W., & van Wely, M. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.05.012 · Cited by 68
Moore, A., Fisher, E., & Eccleston, C. (2022) · British Journal of Anaesthesia · doi:10.1016/j.bja.2022.09.030 · Cited by 57
Assessing Research Misconduct in Randomized Controlled Trials
Li, W., Bordewijk, E. M., & Mol, B. W. (2021) · Obstetrics & Gynecology · doi:10.1097/aog.0000000000004513 · Cited by 37
Hüllemann, S., Schüpfer, G., & Mauch, J. (2017) · Der Anaesthesist · doi:10.1007/s00101-017-0333-1 · Cited by 25
“Benford-Newcomb’s law was previously applied to screen scientific publications for fraud in the field of anesthesia, with some success [10, 11].”
BackgroundUsing the Benford’s Law as a First Step to Assess the Quality of the Cancer Registry Data
Crocetti, E., & Randi, G. (2016) · Frontiers in Public Health · doi:10.3389/fpubh.2016.00225 · Cited by 24
Metadata
- Authors
- Hein, J., Zobrist, R., Konrad, C., & Schuepfer, G.
- Affiliations
- Luzerner Kantonsspital (CH)
- Corresponding author
- Schuepfer, G.
- ORCID
- Konrad, C.
- Venue
- Der Anaesthesist
- Published
- 2012-06
- Volume
- 61
- Issue
- 6
- Pages
- 543-549
- ISSN
- 0003-2417 (ISSN-L)
- 1432-055X
- OpenAlex
- W109673316
- Cited by
- 25
- References
- 24
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 1 · 2023: 2 · 2022: 1 · 2021: 4 · 2019: 1 · 2018: 1 · 2017: 2 · 2016: 3 · 2015: 3 · 2014: 2 · 2013: 2
- FWCI
- 2.14
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Der Anaesthesist (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Benford’s Law and Fraud Detection
- Social Sciences › Education › Academic integrity and plagiarism
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- scientific fraud, Benford's law, digit distribution, retracted article, fraud detection, publication integrity
- MeSH terms
- Algorithms, Anesthesiology, Data Collection, Financial Audit, Probability, Publishing, Retraction of Publication as Topic, Software, Meta-Analysis as Topic, Plagiarism, Scientific Misconduct
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Scientific fraud in 20 falsified anesthesia papers: Detection using financial auditing methods. https://app.cochat.ai/papers/10.1007/s00101-012-2029-x
- The paper
- Hein, J., Zobrist, R., Konrad, C., & Schuepfer, G. (2012). Scientific fraud in 20 falsified anesthesia papers: Detection using financial auditing methods. Der Anaesthesist. https://doi.org/10.1007/s00101-012-2029-x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.