CoChat

Automatic detection of image manipulations in the biomedical literature

Open access
Bucci, Enrico M. · 2018 · Cell Death & Disease

The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index; 4 of the 11 sources its claims cite were checked for support.

Abstract

Images in scientific papers are used to support the experimental description and the discussion of the findings since several centuries. In the field of biomedical sciences, in particular, the use of images to depict laboratory results is widely diffused, at such a level that one would not err in saying that there is barely any experimental paper devoid of images to document the attained results. With the advent of software for digital image manipulation, however, even photographic reproductions of experimental results may be easily altered by researchers, leading to an increasingly high rate of scientific papers containing unreliable images. In this paper I introduce a software pipeline to detect some of the most diffuse misbehaviours, running two independent tests on a random set of papers and on the full publishing record of a single journal. The results obtained by these two tests support the feasibility of the software approach and imply an alarming level of image manipulation in the published record.

Overview

CoChat Summary

TL;DR

The paper introduces an automated software pipeline to detect image manipulation in biomedical papers and applies it to a random PubMed Central sample and the full 2010–2014 record of *Cell Death and Disease*. It reports suspected manipulation in about 6% of sampled papers and 8.6% of the single journal’s papers, with gel-electrophoresis images especially affected.

Key findings

  • In a random PMC sample of 1,364 papers from 451 journals, 78 papers (5.7%) from 46 journals (10.2%) contained at least one suspected image manipulation; the affected journals had an average impact factor of 4.00 (range 0.11–9.13).
  • Among flagged papers, 65 (83%) contained at least one manipulated gel-electrophoresis image; among the 299 papers containing at least one gel image, 21.7% had a potential ORI-policy-violating manipulation involving gel images.
  • For *Cell Death and Disease*, 8.6% of 1,546 papers published in 2010–2014 contained manipulated images, with a growing yearly trend exceeding the PMC range in the last two years; 20 papers published in 2014 contained images previously published by the same group.
  • For 6 of 7 journals examined, image-manipulation rate correlated with retraction rate; retractions totaled 0.38% of papers containing potentially manipulated images, while about 40% of retraction notes detailing reasons reported image problems. China produced more problematic papers than expected and the UK fewer; no preferred funding source was found, and 12 NIH projects producing 12 problematic papers represented a lower-bound value greater than $4,800,000.

Methods

  • The automated pipeline used PDF conversion, in-house ImageCutter for panel segmentation, ImageCheck for gel-feature cloning detection, and the commercial “Visual Similarity Duplicate Image Finder Pro” for image reuse with a 95% similarity threshold. Gel spots were flagged if, after alignment and possible 180° rotation/mirroring, pixel-by-pixel intensity subtraction differed by less than 2% of the normalized average area.
  • Two tests were run: a random sample of 1,364 open-access papers from PubMed Central released in January 2014 (451 journals, 4,778 extracted images), and the full publishing record of *Cell Death and Disease* for 2010–2014 (1,546 papers).
  • Analyses included rates of suspected manipulation, journal-level correlation with retractions, country attribution by corresponding-author institution, and funding-source assessment from PubMed records.

Limitations

  • The paper states that the approach is restricted to detecting only a tiny amount of possible data manipulations, that the country result is based on a single month in 2014 and needs confirmation, and that conclusions about *Cell Death and Disease* should be compared with a similar journal that did not increase article numbers.
  • Evident from the text: flagged papers are described as “suspected” or “potentially manipulated,” not confirmed misconduct; the duplicate-detection step relies on a commercial tool and a 95% similarity threshold; funding information is partial; and no correlation was found between journal impact factor and manipulation ratio.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1038/s41419-018-0430-3

Cites

6 of 6 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Fig. 1 Linear correlation between the retraction rate and the rate of manipulated images found in published manuscripts, as obtained in the examined random sample of journals considered in this paper
Fig. 1 Linear correlation between the retraction rate and the rate of manipulated images found in published manuscripts, as obtained in the examined random sample of journals considered in this paperCC BY · PubMed Central
Fig. 2 Number of papers containing manipulated images as a function of the overall number of papers examined for each nation included in the analyzed random sample. A paper is attributed to a given nation according to the nationality of affiliation of the institution of the corresponding author
Fig. 2 Number of papers containing manipulated images as a function of the overall number of papers examined for each nation included in the analyzed random sample. A paper is attributed to a given nation according to the nationality of affiliation of the institution of the corresponding authorCC BY · PubMed Central
Fig. 3 Disclosed source of funding for the paper containing manipulated images (upper pie) and for the overall examined random sample (bottom pie)
Fig. 3 Disclosed source of funding for the paper containing manipulated images (upper pie) and for the overall examined random sample (bottom pie)CC BY · PubMed Central
Fig. 4 Yearly rate of published papers containing at list one manipulated image (orange line) for the journal Cell Death and Disease. The yearly number of retrieved manipulated images and the number of papers containing them is also reported (blue and red bars, respectively)
Fig. 4 Yearly rate of published papers containing at list one manipulated image (orange line) for the journal Cell Death and Disease. The yearly number of retrieved manipulated images and the number of papers containing them is also reported (blue and red bars, respectively)CC BY · PubMed Central
Fig. 5 Workflow to extract image panels from a pdf file, corresponding to the automatic procedure adopted by the Java software ImageCutter. JPEG versions of each page in the pdf file are changed to 8-bit, gray level images. Assuming a white background, page images are then inverted, smoothed and used for a segmentation step adopting the rolling ball procedure. To avoid over-segmenting, a region growing step increasing each segmented region is performed; if two segmented regions are joined after moderate area growing, they are considered as a single object to segment. After that, borders of the segmented object are refined by identifying abrupt changes in gray level intensity, assuming all objects to segment are rectangular. After segmentation, those objects with predefined properties (e.g., uniform color and small size) are discarded, while all the others are passed as image panels to the following routines
Fig. 5 Workflow to extract image panels from a pdf file, corresponding to the automatic procedure adopted by the Java software ImageCutter. JPEG versions of each page in the pdf file are changed to 8-bit, gray level images. Assuming a white background, page images are then inverted, smoothed and used for a segmentation step adopting the rolling ball procedure. To avoid over-segmenting, a region growing step increasing each segmented region is performed; if two segmented regions are joined after moderate area growing, they are considered as a single object to segment. After that, borders of the segmented object are refined by identifying abrupt changes in gray level intensity, assuming all objects to segment are rectangular. After segmentation, those objects with predefined properties (e.g., uniform color and small size) are discarded, while all the others are passed as image panels to the following routinesCC BY · PubMed Central

Verification

Claims the paper makes

3 Valid · 1 Not valid · 7 Not checked · 32 Own results and interpretations

24 more claims

Create a free account to see all 43 claims and every source verdict.

See all claims — free account
  • It may state two separate claims as one. 10
  • Probably not a substantial claim. 4

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 6 references

Research works printed but not linked: 3

  1. Bucci, E. M., Adamo, G., Frandi, A. & Caporale, C. Introducing an unbiased software procedure for image checking in a large research institution. In Extended Abstracts from the 5th World Conference on Research Integrity (Elsevier, Amsterdam, 2017).
  2. Home - PMC - NCBI. Available at http://www.ncbi.nlm.nih.gov/pmc/ (Accessed 18 May 2014).
  3. Marcus, A. & Oransky, I. Can we trust western blots? Lab Times 2, 41 (2012).

Cited by

See all 79

Metadata

Authors
Bucci, E. M.
Affiliations
Sbarro Health Research Organization (US)
Corresponding author
Bucci, Enrico M.
Venue
Cell Death & Disease
Published
2018-03-14
Volume
9
Issue
3
Pages
400-400
ISSN
2041-4889 (ISSN-L)
OpenAlex
W2791382476
Cited by
76
References
6
Citations by year
2026: 2 · 2025: 9 · 2024: 6 · 2023: 4 · 2022: 21 · 2021: 9 · 2020: 18 · 2019: 7
FWCI
4.25
Type
journal article
Language
en
Open access
Licence
Locations
  • Cell Death and Disease (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
  • Social Sciences › Education › Academic integrity and plagiarism
  • Physical Sciences › Mathematics › Statistics and Probability › Benford’s Law and Fraud Detection
Keywords
image forgery detection, biomedical literature, research misconduct, image editing, software pipeline, scholarly publishing
MeSH terms
Automation, Image Processing, Computer-Assisted, Publications, Software, Biomedical Research, Open Access Publishing

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-01, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-01 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Automatic detection of image manipulations in the biomedical literature. https://app.cochat.ai/papers/10.1038/s41419-018-0430-3
The paper
Bucci, E. M. (2018). Automatic detection of image manipulations in the biomedical literature. Cell Death & Disease. https://doi.org/10.1038/s41419-018-0430-3

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.