CoChat

How Sensitive Are the Free AI-detector Tools in Detecting AI-generated Texts? A Comparison of Popular AI-detector Tools

Open access
Kar, Sujita Kumar, Bansal, Teena, Modi, Sumit, Singh, Amit · 2025 · Indian Journal of Psychological Medicine

The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.

Abstract

Background: Recently, Artificial intelligence (AI) has significantly influenced academic writing. We aimed to investigate the sensitivity of the free versions of popular AI-detection software programs in detecting AI-generated text. Methods: We searched for AI-content-detection software on Google and selected the first 10 free versions that allowed a minimum of 500 words for text analysis. Then, we gave ChatGPT 3.5 version a command to generate a scientific article on the “Role of Electroconvulsive Therapy (ECT) in Treatment-resistant Depression” under 500 words. After generating the primary text, we rephrased it using three different software tools. We then used AI-detection software to analyse the original and paraphrase texts. Results: 10 AI-detector tools were tested on their ability to detect AI-generated text. The sensitivity ranged from 0% to 100%. 5 out of 10 tools detected AI-generated content with 100% accuracy. For paraphrased texts, Sapling and Undetectable AI detected all three software-generated contents with 100% accuracy. Meanwhile, Copyleaks, QuillBot , and Wordtune identified content generated by two software programs with 100% accuracy. Conclusion: The integration of AI technology in academic writing is becoming more prevalent. Nonetheless, relying solely on AI-generated content can diminish the author’s credibility, leading most academic journals to suggest limiting its use. AI-content-detection software programs have been developed to detect AI-generated or AI-assisted texts. Currently, some of the platforms are equally sensitive. However, future upgrades may enhance their ability to detect AI-generated text more accurately.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1177/02537176241247934

Cites

7 of 7 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

2 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 7 references

Research works printed but not linked: 2

  1. Radford A Narasimhan K Salimans T . Improving language understanding by generative pre-training. 2018. Proceedings of 36th Conference on Neural Information Processing Systems (NeurIPS 2022). https://proceedings.neurips.cc/paper_files/paper/2022/file/ec795aeadae0b7d230fa35cbaf04c041-Paper-Conference.pdf (accessed 14February2024)
  2. Fishman T. “We know it when we see it” is not good enough: toward a standard definition of plagiarism that transcends theft fraud and copyright. 2009. 4th Asia Pacific Conference on Educational Integrity (4APCEI) 28–30 September 2009. University of Wollongong NSW Australia. https://www.bmartin.cc/pubs/09-4apcei/4apcei-Fishman.pdf (accessed on 14February2024)

Cited by

See all 82

Metadata

Authors
Kar, S. K., Bansal, T., Modi, S., & Singh, A.
Affiliations
King George's Medical University (IN)
Corresponding author
Kar, Sujita Kumar
Venue
Indian Journal of Psychological Medicine
Published
2024-05-11
Volume
47
Issue
3
Pages
275-278
ISSN
  • 0253-7176 (ISSN-L)
  • 0975-1564
OpenAlex
W4396826457
Cited by
49
References
7
Citations by year
2026: 26 · 2025: 20 · 2024: 3
FWCI
20.24
Type
journal article
Language
en
Open access
Licence
Locations
  • Indian Journal of Psychological Medicine (publishedVersion, cc-by-nc)
  • PubMed Central (publishedVersion, cc-by-nc)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Social Sciences › Education › Academic integrity and plagiarism
  • Physical Sciences › Computer Science › Artificial Intelligence › Authorship Attribution and Profiling
  • Social Sciences › Education › Artificial Intelligence in Education
Keywords
AI-generated text detection, AI detection software, ChatGPT, paraphrase, detection sensitivity, academic integrity, AI-assisted writing, treatment-resistant depression, electroconvulsive therapy

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: How Sensitive Are the Free AI-detector Tools in Detecting AI-generated Texts? A Comparison of Popular AI-detector Tools. https://app.cochat.ai/papers/10.1177/02537176241247934
The paper
Kar, S. K., Bansal, T., Modi, S., & Singh, A. (2025). How Sensitive Are the Free AI-detector Tools in Detecting AI-generated Texts? A Comparison of Popular AI-detector Tools. Indian Journal of Psychological Medicine. https://doi.org/10.1177/02537176241247934

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.