Cited by 64Academic integrity and plagiarismBenford’s Law and Fraud DetectionMeta-analysis and systematic reviews

Evidence for compromised data integrity in studies of liberal peri‐operative inspired oxygen

Open access
Myles, P. S., Carlisle, J. B., Scarr, B.·2019·Anaesthesia

Abstract

Summary: In 2016 the World Health Organization recommended intra‐operative ventilation with 80% inspired oxygen to reduce surgical site infection rates, based upon a meta‐analysis of 15 randomised controlled trials, of which two were by Mario Schietroma's research group. Five trials by this group have been retracted for duplication, plagiarism, statistical error and lack of ethical approval. We analysed 40 papers by this group: 24 randomised controlled trials (5064 participants) and 16 observational studies (1847 patients). There was evidence that data integrity was compromised in 38 out of the 40 analysed papers. The distribution of baseline characteristics in randomised controlled trials was unlikely, p = 1.5 × 10 −8 : continuous variables within trials were heterogeneous, p = 1.9 × 10 −9 , and categorical variables were homogeneous, p = 8.5 × 10 −20 . Effects of interventions varied less than expected between studies: for categorical variables, for instance postoperative wound infection, p < 1 × 10 −7 , and for continuous variables, for instance HLA ‐ DR concentration, p = 0.00001. Of 184 calculable p values, for baseline variables or results, 179 (98%) were incorrect, ranging from three orders of magnitude too small to 10 orders of magnitude too large. Twenty‐one graphs occurred 81 times in 23 out of 40 papers. Liberal peri‐operative oxygen did not reduce surgical site infection in a meta‐analysis of 20 trials that excluded seven trials by Mario Schietroma and colleagues (odds ratio (95% CI ) 0.89 (0.73‐1.08); p = 0.23). An update by the World Health Organization has now excluded trials of liberal oxygen by Schietroma's group, four of which have not been retracted. We conclude that Mario Schietroma's work should not inform practice until investigated.

Integrity signals

Registry

Crossref · 10.1111/anae.14584

Cites

67 of 67 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 20 cited sources checked · 0 supported · 0 flagged

  • Findingown data

    In another paper, the calculated p value for five categories of hiatus hernia across three groups was 0.835, 835 times larger than the reported p = 0.001.

    “In another paper, five categories of hiatus hernia (none/large type 1/large type 2/ small type 1/small type 2) in three groups were: 1/0/2/0/40; 3/1/8/1/76; and 5/1/5/2/56, respectively, for which p = 0.835, 835 times larger than the reported p = 0.001”
    Quote in the paperSubstantial claim
  • Findingown data

    Evidence indicated that data integrity was compromised in 38 of the 40 analysed papers.

    “There was evidence that data integrity was compromised in 38 out of 40 analysed papers (Table 1 and Supporting Information Appendix S1).”
    • Also stated in: § Abstract · plain
      “There was evidence that data integrity was compromised in 38 out of the 40 analysed papers.”
    Quote in the paperSubstantial claim
  • Findingown data

    Twenty-one graphs were used 81 times in 23 of the 40 papers.

    “Twenty-one graphs were used 81 times in 23 out of 40 papers (Table 2 and Supporitng Information Appendix S1).”
    • Also stated in: § Abstract · plain
      “Twenty-one graphs occurred 81 times in 23 out of 40 papers.”
    Quote in the paperSubstantial claim
  • Findingown data

    Differences for outcomes varied little between papers for both randomised controlled trials and observational studies.

    “There was a similar pattern of little variation in differences for outcomes between papers, both randomised controlled trials and observational studies.”
    Quote in the paperSubstantial claim
  • Findingnone given

    No trial had been registered in advance on a public website.

    “None of the trials had been preregistered on a publicly available website.”
    Quote in the paperSubstantial claim
  • May combine two claims. 7
  • Classified as probably not a substantial claim. 4
  • The quote only partly states this claim. 1
  • May combine two claims.

    Findingown data

    The terminal digit was even for 149 of 184 (81%) p values, differing from the expected 83 of 184 (p = 3.0 × 10^-12) and from an equal odd/even split of 92 of 184 (p = 1.1 × 10^-9).

    “The terminal (right-hand) digit was even (0, 2, 4, 6 or 8) for 149/184 (81%) p values, reported to one digit (83), for two digits (91) or three digits(10); this rate was different to the expected rate of 83/184, p = 3.0 9 10 À12 and different to an equal number of odd and even terminal digits, 92/184, p = 1.1 9 10 À9 .”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Schietroma's trials were more consistent than expected, each reporting more than a 50% reduction in outcome with liberal oxygen.

    “In short, the Schietroma trials were more consistent in their results than one would expect, with each reporting more than a 50% reduction in outcome when using liberal inspired oxygen.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Findingown data

    In 40 papers authored by Mario Schietroma, 184 p values were calculated.

    “The cumulative distribution of 184 p values, calculated for 40 papers with Mario Schietroma as an author”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The authors included 20 other randomised trials of liberal peri-operative inspired oxygen, with 8357 participants.

    “We included 20 other randomised trials of liberal peri-operative inspired oxygen in 8357 participants”
    Quote in the paperSubstantial claim
  • May combine two claims. The quote only partly states this claim.

    Findingnone given

    Continuous variables were sometimes heterogeneous between groups within studies, but their distribution varied little between studies.

    “The groups within trials were often imbalanced, particularly for neutrophil count, but their distribution was relatively homogeneous.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Variation between studies was low for anastomotic leak (p = 0.000006), ASEPSIS score < 19 (p = 0.012), and wound infection (p < 1 × 10^-7).

    “The probabilities for variation between studies for some categorical outcomes were: anastomotic leak, p = 0.000006; ASEPSIS score < 19, p = 0.012; and wound infection, p < 1 9 10 À7 (see Supporting Information Figures S1-S6).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The authors identified 40 papers meeting their criteria: 24 randomised controlled trials with 5064 participants and 16 observational studies with 1847 patients.

    “We analysed 40 papers by this group: 24 randomised controlled trials (5064 participants) and 16 observational studies (1847 patients).”
    • Also stated in: § Results · plain
      “We identified 40 papers that fulfilled our criteria [1-5, 16-50]: 24 randomised controlled trials with 5064 participants Data S1)).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [1-5, 16-50]

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    Limitations include those inherent in the Carlisle method and in meta-analysis.

    “Limitations of our paper include those inherent in the Carlisle method and in meta-analysis.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    Whether liberal peri-operative inspired oxygen is beneficial has been contested.

    “The merits of liberal peri-operative inspired oxygen have been disputed [7,8].”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [7] source

      Not checked in the free run.

    • cites [8] source

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisecitation

    In 2016, the World Health Organization strongly recommended that adults having general anaesthesia with endotracheal intubation for surgery receive 80% inspired oxygen during operation and, if feasible, for 2-6 hours after operation to lower surgical site infection risk.

    “In 2016, the World Health Organization made a strong recommendation that “adult patients undergoing general anaesthesia with endotracheal intubation for surgical procedures should receive an 80% fraction of inspired oxygen intra-operatively and, if feasible, in the immediate postoperative period for 2-6 h to reduce the risk of surgical site infection.”[6]”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [6]

      Not checked in the free run.

10 of 10
  • The paper relies on this without support.

    The 2016 WHO recommendation was based on a meta-analysis of 15 randomised controlled trials, two of which were by Schietroma's group.

    “In 2016 the World Health Organization recommended intra-operative ventilation with 80% inspired oxygen to reduce surgical site infection rates, based upon a meta-analysis of 15 randomised controlled trials, of which two were by Mario Schietroma's research group.”
  • The paper relies on this without support.

    The WHO has updated its guideline and excluded trials by Schietroma et al.

    “The WHO has recently updated their guideline, and excluded trials by Schietroma et al.”
    “An update by the World Health Organization has now excluded trials of liberal oxygen by Schietroma's group, four of which have not been retracted.”
2 of 2

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • SPRITE reconstructs potential discrete data sets using the mean, standard deviation, sample size, and lower and upper bounds of item values.

    “SPRITE (Sample Parameter Reconstruction via Iterative Techniques) is a technique for reconstructing potential discrete data sets using basic summary information about a sample, namely the mean, the SD, the sample size, and the lower and upper bounds of the range of item values.22”
  • SPRITE complements GRIMMER, has no sample-size limitation, can handle per-cell sample sizes in the thousands, and considers the range of possible raw values.

    “SPRITE complements GRIMMER tests.It does not have a sample size limitation and can be used with per-cell sample sizes in the thousands.SPRITE also takes into consideration the range of possible values of the raw data.”

Cites

4 retracted

Flagged first, then by citations

Research works printed but not linked: 3

  1. Piccirillo JF, 2018, Dexamethasone for the Prevention of Recurrent Laryngeal Nerve Palsy and Other Complications After Thyroid Surgery: A Randomized Double‐blind Placebo‐Controlled Trial, Journal of the American Medical Association Otolaryngology – Head and Neck Surgery, 144, 1089
  2. 2017, Retraction notice to “How Does High‐Concentration Supplemental Perioperative Oxygen Influence Surgical Outcomes after Thyroid Surgery? A Prospective, Randomized, Double‐Blind, Controlled, Monocentric Trial, Journal of the American College of Surgeons, 225, 359
  3. Retraction Watch.JAMA journal retracts paper when author can’t produce original data.2018;https://retractionwatch.com/2018/10/25/jama-journal-retracts-paper-when-author-cant-produce-original-data/(accessed 26/10/2018).

Cited by

Sorted by citations

Authors
Myles, P. S., Carlisle, J. B., & Scarr, B.
Affiliations
  • The Alfred Hospital (AU)
  • Torbay Hospital (GB)
  • The Royal Melbourne Hospital (AU)
Corresponding author
Myles, P. S.
Venue
Anaesthesia
Publisher
Wiley
Published
2019-02-17
Volume
74
Issue
5
Pages
573-584
ISSN
  • 0003-2409 (ISSN-L)
  • 1365-2044
OpenAlex
W2915437227
Cited by
64
References
66
Citations by year
2026: 1 · 2025: 4 · 2024: 9 · 2023: 9 · 2022: 11 · 2021: 10 · 2020: 6 · 2019: 14
FWCI
2.72
Type
journal article
Language
en
Open access
Locations
  • Anaesthesia (publishedVersion)
  • PubMed (publishedVersion)
  • Monash University Research Portal (Monash University) (submittedVersion, other-oa)
Topics
  • Social Sciences › Safety Research › Academic integrity and plagiarism
  • Physical Sciences › Mathematics › Statistics and Probability › Benford’s Law and Fraud Detection
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Keywords
data integrity, research misconduct, surgical site infection, intraoperative mechanical ventilation, statistical errors, HLA-DR, meta-analysis critique
MeSH terms
Humans, Oxygen Inhalation Therapy, Surgical Wound Infection, Scientific Misconduct, Randomized Controlled Trials as Topic, Perioperative Care, Biomedical Research, Observational Studies as Topic

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-05.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-05.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review