Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.

Errors and Integrity in Seeking and Reporting Apparent Research Misconduct

Kharasch, Evan D., Houle, Timothy T. · 2017 · Anesthesiology

Abstract

THE responsible conduct of research is the bedrock on which the scientific enterprise rests. Scientific integrity is indispensable for preserving the public trust and the trust of the scientific community, protecting those who participate in research (investigators and research subjects), and safeguarding the health and safety of patients who depend on scientific knowledge for their diagnosis and care. When the scientific content of Anesthesiology and the integrity of our authors are publically questioned, it is the journal’s responsibility to evaluate such claims and to inform our readers about the claims, the pertinent issues, and the results of our evaluation of the claims.Research misconduct has become an all too familiar stain on the research and clinical landscape, and it is occurring with increasing frequency and public awareness. Variably complicit in research misconduct, explicitly and/or implicitly, are investigators, authors, sponsors, academic institutions, and journals. Revelations of scientific misconduct have been punctuated by several well-known instances of gross fabrication and falsification in our specialty. Never tolerable, misconduct is perhaps even more egregious when occurring in randomized clinical trials, which are a foundational element informing clinical practice.The scientific community is ever watchful for fabrication and falsification—journal editors included. It is the bane of our existence. Were there only some valid algorithm or software that could detect fabrication and falsification (akin to that which detects duplication and plagiarism with remarkable alacrity and accuracy).A recent issue of the journal Anaesthesia contains an article by Dr. John Carlisle on “data fabrication and other reasons” for nonrandom sampling in randomized clinical trials in the specialty of anesthesia and in two general medical journals.1 It was accompanied by an editorial that celebrates the article, the statistical method used, and the application thereof to detecting scientific misconduct.2 We were particularly concerned because the Carlisle article identified 12 research investigations published in Anesthesiology with purportedly problematic results (at a P value cut-off less than 0.0001) that “might benefit from further investigation”...“to correct and if necessary retract,”1 and which might be “corrupted.”2In brief, the Carlisle Method3 evaluates the baseline variables (e.g., age, weight) in a manuscript and identifies those with more or less balance than would be expected by chance. Less balance is akin to data not being consistent with random sampling. The Carlisle Method therefore deems such data suspicious.1,4,5The Method assumes that every individual baseline demographic variable in a randomized controlled trial (i.e., what is typically presented in a manuscript’s “table 1”) is randomly assigned across treatment groups. Using this assumption, the Method then examines the observed distribution of individual P values that result from testing the null hypothesis that the randomized groups do not differ. The observed distributions are then compared to the expected distribution that should be observed when the null hypothesis is true (e.g., uniform distribution).With some degree of equipoise, the Carlisle article attributes observed deviations from these expected distributions to typographical error, unintentional error, correlation, stratified allocation, poor methodology, fabricated data, or fraud.1 It politely suggests that the articles in question “might benefit from further investigation,” but then asserts that “association of extreme distributions with trial retraction suggests that further investigation of uncorrected unretracted trials and their authors will result in most trials being corrected and some retracted.”1 Put more succinctly, a probability is extrapolated to a fact, which then becomes the basis for judgement and action (vide infra).The Carlisle Method has been touted as the long-sought “Holy Grail” for detecting fabrication and falsification in scientific publishing. Anaesthesia “can rightly claim with vicarious pride that one of its own, John Carlisle, is at the forefront of this effort,” and that Carlisle’s “statistical exposé…made the research world stand up and take notice” in an effort to prevent publication of fraudulent material.2Anaesthesia declared that it “has decided to screen all randomized trials submitted to the journal using the Carlisle Method” and “will (summarily) reject any that fall foul due to suspicious data that are not consistent with random sampling.”3 Furthermore, it “hopes that other journals will follow suit and also screen submissions.”3 Loadsman and McCulloch proclaim that “a strong argument could be made that every journal in the world now needs to apply Carlisle’s method to all the randomized clinical trials they’ve ever published.”2 All these emphatic exhortations are made while acknowledging that “clearly there is still a lot of work to

Overview

Integrity signals

Registry

Crossref · 10.1097/aln.0000000000001875

Cites

11 of 11 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 11 references

Cited by

See all 15

Metadata

Authors
Kharasch, E. D., & Houle, T. T.
Affiliations
Harvard University (US)
Venue
Anesthesiology
Published
2017-11
Volume
127
Issue
5
Pages
733-737
ISSN
0003-3022 (ISSN-L)
OpenAlex
W2747160812
Cited by
15
References
11
Citations by year
2024: 1 · 2023: 2 · 2021: 2 · 2020: 1 · 2019: 4 · 2018: 3 · 2017: 2
Type
journal article
Language
en
Open access
closed
Locations
  • Anesthesiology (publishedVersion)
  • PubMed (publishedVersion)
Topics
  • Social Sciences › Education › Academic integrity and plagiarism
  • Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
  • Physical Sciences › Mathematics › Statistics and Probability › Benford’s Law and Fraud Detection
Keywords
research misconduct, scientific integrity, data fabrication, falsification, non-probability sampling, randomized controlled trials, retraction, p-values, research funding conflicts of interest
MeSH terms
Humans, Scientific Misconduct, Biomedical Research

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Errors and Integrity in Seeking and Reporting Apparent Research Misconduct. https://app.cochat.ai/papers/10.1097/aln.0000000000001875
The paper
Kharasch, E. D., & Houle, T. T. (2017). Errors and Integrity in Seeking and Reporting Apparent Research Misconduct. Anesthesiology. https://doi.org/10.1097/aln.0000000000001875

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.