Cited by 33Academic integrity and plagiarismPublishing and Scholarly CommunicationAcademic Publishing and Open Access

Guidance needed for using artificial intelligence to screen journal submissions for misconduct

Open access
Hosseini, Mohammad, Resnik, David B·2025·Research Ethics

Abstract

Journals and publishers are increasingly using artificial intelligence (AI) to screen submissions for potential misconduct, including plagiarism and data or image manipulation. While using AI can enhance the integrity of published manuscripts, it can also increase the risk of false/unsubstantiated allegations. Ambiguities related to journals’ and publishers’ responsibilities concerning fairness and transparency also raise ethical concerns. In this Topic Piece, we offer the following guidance: (1) All cases of suspected misconduct identified by AI tools should be carefully reviewed by humans to verify accuracy and ensure accountability; (2) Journals/publishers that use AI tools to detect misconduct should use only well-tested and reliable tools, remain vigilant concerning forms of misconduct that cannot be detected by these tools, and stay abreast of advancements in technology; (3) Journals/publishers should inform authors about irregularities identified by AI tools and give them a chance to respond before forwarding allegations to their institutions in accordance with Committee on Publication Ethics guidelines; (4) Journals/publishers that use AI tools to detect misconduct should screen all relevant submissions and not just random/purposefully selected submissions; and (5) Journals should inform authors about their definition of misconduct, their use of AI tools to detect misconduct, and their policies and procedures for responding to suspected cases of misconduct.

AI snapshot

Written from the paper’s full text.

TL;DR

Journals and publishers are increasingly using AI to screen submissions for misconduct, which can improve integrity but also risks false or unsubstantiated allegations and unclear responsibilities. The paper offers five guidance recommendations emphasizing human review, reliable tools, author notification and response, screening all relevant submissions, and transparency.

Key findings

  • AI detection tools are not error-free: Turnitin has a reported 4% false positive rate, and Proofig has an estimated 5.8% false positive rate; false positives raise serious concerns because they may lead to false allegations against innocent researchers.
  • Most misconduct allegations are unsubstantiated: a study of 3,561 PHS-funded research allegations from 1994–2011 found institutions dismissed 87.4%, and in 2022 the Office of Research Integrity dismissed 85.9% of allegations it received.
  • In a study of manuscripts submitted to nine American Association of Cancer Research journals from January 2021 to May 2022, 63% of 195 images identified as duplications by Proofig were likely due to error rather than deliberate misbehavior.
  • The paper recommends that all AI-flagged suspected misconduct be reviewed by humans; that journals use well-tested tools and stay vigilant about undetectable misconduct; that authors be informed and given a chance to respond before allegations go to institutions; that all relevant submissions be screened; and that policies, AI use, and definitions of misconduct be disclosed.

Methods

  • This is a Topic Piece/commentary, not an empirical study; it presents ethical analysis and guidance rather than original data collection.
  • It synthesizes cited literature, news reports, regulatory examples, and prior studies—including the Proofig/AACR screening study and misconduct allegation dismissal statistics—to support its arguments.
  • The main analysis is normative and argumentative, culminating in five recommendations for journals and publishers using AI to screen submissions for misconduct.

Limitations

  • The paper does not report a formal limitations section for its own analysis.
  • It states limitations of AI detection tools: false positives and false negatives, inability to detect all forms of plagiarism or subtle image manipulation, and inability to prove that a respondent acted knowingly, intentionally, or recklessly.
  • Evident from the text: the recommendations are not empirically tested, and the analysis relies on selected examples and cited literature rather than a systematic review.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1177/17470161241254052

Cites

23 of 23 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 30 cited sources checked · 0 supported · 0 flagged

  • Interpretationnone given

    Using AI tools to screen journal submissions for plagiarism and data or image manipulation is likely to enhance the integrity of published research.

    “While using AI can enhance the integrity of published manuscripts, it can also increase the risk of false/unsubstantiated allegations.”
    • Also stated in: § Background · hedged
      “While using AI tools to screen journal submissions for plagiarism and data or image manipulation is likely to enhance the integrity of published research, it also generates some ethical concerns.”
    Quote in the paperNot a substantial claim
  • Premisecitation

    Proofig has an estimated false positive rate of 5.8%.

    “Proofig, for example, has an estimated false positive rate of 5.8% (Evanko, 2022).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Evanko, 2022

      Not checked in the free run.

  • Premisecitation

    According to US federal policy, a finding of research misconduct requires proof by preponderance of evidence that the person acted intentionally, knowingly, or recklessly.

    “For example, according to US federal policy, a finding of research misconduct (defined as fabrication or falsification of data or plagiarism) requires proof by preponderance of evidence that the person acted intentionally, knowingly, or recklessly (Office of Science and Technology Policy, 2000).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Office of Science and Technology Policy, 2000

      Not checked in the free run.

  • Premisecitation

    Misconduct-detection programs are not error-free.

    “Although misconduct-detection programs perform well, they are not error-free (Haritonova, 2022).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Haritonova, 2022

      Not checked in the free run.

  • Premisecitation

    AI tools cannot prove misconduct because they cannot show that the respondent acted knowingly, intentionally, or recklessly.

    “While AI tools can enhance our ability to detect deviations from accepted research practices, they cannot prove misconduct because they cannot show that the respondent acted knowingly, intentionally, or recklessly, which requires delving into the person’s state of mind (Shamoo and Resnik, 2022).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Shamoo and Resnik, 2022

      Not checked in the free run.

  • May combine two claims. 5
  • Classified as probably not a substantial claim. 8
  • May combine two claims.

    Premisecitation

    AI image-manipulation detection programs are mostly accurate but can make mistakes.

    “AI image-manipulation detection programs are also mostly accurate, but they can make mistakes (David, 2023).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites David, 2023

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    Using AI tools to screen submissions increases the ability to detect misconduct.

    “Because using AI tools to screen submissions increases the ability to detect misconduct, it may also increase journals’ and publishers’ responsibilities related to reporting or investigating suspected misconduct.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Since AI detection tools are openly available, ill-intentioned researchers can try them out before submission to ensure that their manuscript passes certain tests so they can avoid being caught by AI tools.

    “Furthermore, since AI detection tools are openly available, ill-intentioned researchers can try them out before submission to ensure that their manuscript passes certain tests so they can avoid being caught by AI tools.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Current AI tools can detect plagiarism of words but not other types of plagiarism, such as misappropriation of data, ideas, methods, arguments, images, tables, or unique forms of expression.

    “For example, current AI tools can detect plagiarism of words but not other types of plagiarism, such as misappropriation of data, ideas, methods, arguments, images, tables, or unique forms of expression (Hosseini and Gordijn, 2020).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Hosseini and Gordijn, 2020

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisecitation

    The research integrity community have been using AI tools to identify manipulated images and papers produced by paper mills or AI ChatBots.

    “Recently, the research integrity community have been using artificial intelligence (AI) tools, such as Papermill Alarm, Proofig, FigCheck, ImaCheck, and ImageTwin, to identify manipulated images and papers produced by paper mills or AI ChatBots (Else, 2022; Oza, 2023; Sanderson, 2024; STM Integrity Hub, n.d).”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites Else, 2022

      Not checked in the free run.

    • cites Oza, 2023

      Not checked in the free run.

    • cites Sanderson, 2024

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    In March 2024, Wiley announced it would begin using a new AI-powered Papermill Detection service to identify papers produced by paper mills.

    “In March 2024, Wiley announced it would begin using a new AI-powered Papermill Detection service to identify papers produced by paper mills (De Rose, 2024).1”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites De Rose, 2024

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The editors of the Science family of journals announced that they will use AI to screen all submitted images for problematic manipulations.

    “The editors of the Science family of journals, for example, recently announced that they will use AI to screen all submitted images for problematic manipulations (Thorp, 2024).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Thorp, 2024

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Using AI tools to screen journal submissions for misconduct generates ethical concerns related to harm, fairness, and transparency.

    “While using AI tools to screen journal submissions for misconduct is likely to enhance the integrity of published research, it also generates some ethical concerns related to harm, fairness, and transparency, which need to be addressed.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    Current AI tools can detect relatively unsophisticated forms of image manipulation, such as image duplication or repositioning, but not more subtle forms of manipulation, such as alteration of microdetails of represented structures.

    “Current AI tools can detect relatively unsophisticated forms of image manipulation, such as image duplication or repositioning but not more subtle forms of manipulation, such as alteration of microdetails of represented structures (Bik et al., 2016).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Bik et al., 2016

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisecitation

    Journals and publishers are beginning to take advantage of AI tools to screen submissions.

    “Now, journals and publishers are beginning to take advantage of these tools (Conroy, 2023).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Conroy, 2023

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Respondents who can afford to hire an attorney may spend tens of thousands of dollars in legal fees, and their reputations may still be damaged forever.

    “Respondents who can afford to hire an attorney may spend tens of thousands of dollars in legal fees, and their reputations may still be damaged forever (Benderly, 2016).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Benderly, 2016

      Not checked in the free run.

  • Classified as probably not a substantial claim. May combine two claims.

    Premisereasoning

    It is unclear what journals or publishers will do after detecting suspected misconduct in a submitted manuscript and whether or how they will share this information with authors or institutions.

    “However, it is unclear what journals or publishers will do after detecting suspected misconduct in a submitted manuscript and whether or how they will share this information with authors or institutions.”
    Quote in the paperSubstantial claim
12 of 12
  • The paper relies on this without support.

    The proportion of research misconduct allegations that are unsubstantiated in traditional reports is a valid predictor of the proportion of AI-generated allegations that will be unsubstantiated.

    “It is likely, therefore, that a high percentage of research misconduct allegations generated by AI tools will also turn out to be unsubstantiated.”
  • The paper relies on this without support.

    Human review of AI-flagged cases can reliably verify accuracy and ensure accountability.

    “All cases of suspected misconduct identified by AI tools should be carefully reviewed by humans to verify accuracy and ensure accountability”
2 of 2

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Cites

Flagged first, then by citations

Research works printed but not linked: 3

  1. De Rose G (2024). Wiley announces pilot of new AI-powered Papermill Detection service. Available at: https://johnwiley2020news.q4web.com/press-releases/press-release-details/2024/Wiley-announces-pilot-of-new-AI-powered-Papermill-Detection-service/default.aspx (accessed 2 April 2024).
  2. Evanko D (2022) Use of an artificial intelligence–based tool for detecting image duplication prior to manuscript acceptance. Chicago IL: Peer Review Congress. Available at: https://peerreviewcongress.org/abstract/use-of-an-artificial-intelligence-based-tool-for-detecting-image-duplication-prior-to-manuscript-acceptance/ (accessed March 15 2024).
  3. Oransky I (2024) Up to one in seven submissions to hundreds of Wiley journals flagged by new paper mill tool. Retraction Watch. Available at: https://retractionwatch.com/2024/03/14/up-to-one-in-seven-of-submissions-to-hundreds-of-wiley-journals-show-signs-of-paper-mill-activity/ (accessed 14 April 2024).

Cited by

Sorted by citations

Authors
Hosseini, M., & Resnik, D. B.
Affiliations
  • Northwestern University (US)
  • National Institutes of Health (US)
Corresponding author
Hosseini, Mohammad
Venue
Research Ethics
Published
2024-05-11
Volume
21
Issue
1
Pages
1-8
ISSN
  • 1747-0161 (ISSN-L)
  • 2047-6094
OpenAlex
W4396834410
Cited by
33
References
23
Citations by year
2026: 15 · 2025: 12 · 2024: 6
FWCI
13.63
Type
journal article
Language
en
Open access
Locations
  • Research Ethics (publishedVersion, cc-by-nc)
  • PubMed (publishedVersion)
  • PubMed Central (acceptedVersion, cc-by-nc)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
National Center for Advancing Translational Sciences (UL1TR001422)
Topics
  • Social Sciences › Safety Research › Academic integrity and plagiarism
  • Social Sciences › Arts and Humanities › History and Philosophy of Science › Publishing and Scholarly Communication
  • Social Sciences › Decision Sciences › Information Systems and Management › Academic Publishing and Open Access
Keywords
artificial intelligence, plagiarism detection, image forgery detection, data manipulation, journal editorial policy, accountability, transparency, Committee on Publication Ethics, research integrity

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-07.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-07.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review