ChatGPT’s ability to generate realistic experimental images poses a new challenge to academic integrity
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
The rapid advancements in large language models (LLMs) such as ChatGPT have raised concerns about their potential impact on academic integrity. While initial concerns focused on ChatGPT’s writing capabilities, recent updates have integrated DALL-E 3’s image generation features, extending the risks to visual evidence in biomedical research. Our tests revealed ChatGPT’s nearly barrier-free image generation feature can be used to generate experimental result images, such as blood smears, Western Blot, immunofluorescence and so on. Although the current ability of ChatGPT to generate experimental images is limited, the risk of misuse is evident. This development underscores the need for immediate action. We suggest that AI providers restrict the generation of experimental image, develop tools to detect AI-generated images, and consider adding “invisible watermarks” to the generated images. By implementing these measures, we can better ensure the responsible use of AI technology in academic research and maintain the integrity of scientific evidence.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ChatGPT listed as author on research papers: many scientists disapprove
Stokel-Walker, C. (2023) · Nature · doi:10.1038/d41586-023-00107-z · Cited by 868 · cited 1×
“Initial concerns focused on ChatGPT’s writing abilities being exploited for academic writing, leading several publishers to ban ChatGPT as an author [1, 2].”
BackgroundTools such as ChatGPT threaten transparent science; here are our ground rules for their use
(2023) · Nature · doi:10.1038/d41586-023-00191-1 · Cited by 605
The Prevalence of Inappropriate Image Duplication in Biomedical Research Publications
Bik, E. M., Casadevall, A., & Fang, F. C. (2016) · mBio · doi:10.1128/mbio.00809-16 · Cited by 287 · cited 1×
“The earliest methods involved techniques like rotation, splicing, and retouching, but careful inspection could detect traces of manipulation [5].”
MethodLarge Language Model Advanced Data Analysis Abuse to Create a Fake Data Set in Medical Research
Taloni, A., Scorcia, V., & Giannaccare, G. (2023) · JAMA Ophthalmology · doi:10.1001/jamaophthalmol.2023.5162 · Cited by 50 · cited 1×
“In addition to writing articles, a recent study found Chat-GPT can generate fake but realistic research datasets from scratch to support a predetermined conclusion [3].”
Background
Cited by
How is ChatGPT acknowledged in academic publications?
Kousha, K. (2024) · Scientometrics · doi:10.1007/s11192-024-05193-y · Cited by 23
Moderators of academic performance on the use of generative artificial intelligence
Marjerison, R. K., Jun, J. Y., & Kim, J. M. (2025) · Education and Information Technologies · doi:10.1007/s10639-025-13711-5 · Cited by 3
“While some students may use AI to augment their learning and problem-solving capabilities, others may exploit it in ways that compromise ethical academic conduct (Zhu et al., 2024a, b).”
Lin, A., Chen, Z., Jiang, A., Tang, B., Qi, C., Zhu, L., Mou, W., Gan, W., Zeng, D., Xiao, M., et al. (2026) · International Journal of Surgery · doi:10.1097/js9.0000000000003839 · Cited by 2
Self-citationCryptographic Provenance and AI-Generated Images
Bushey, J., Rivard, N., & Barbeau, M. (2025) · 2025 IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata66926.2025.11402054
Metadata
- Authors
- Zhu, L., Lai, Y., Mou, W., Zhang, H., Lin, A., Qi, C., Yang, T., Xu, L., Zhang, J., & Luo, P.
- Venue
- Journal of Hematology & Oncology
- Published
- 2024-05-01
- Volume
- 17
- Issue
- 1
- Pages
- 27-27
- ISSN
- 1756-8722 (ISSN-L)
- OpenAlex
- W4396545937
- Cited by
- 31
- References
- 4
- FWCI
- 12.80
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: ChatGPT’s ability to generate realistic experimental images poses a new challenge to academic integrity. https://app.cochat.ai/papers/10.1186/s13045-024-01543-8
- The paper
- Zhu, L., Lai, Y., Mou, W., Zhang, H., Lin, A., Qi, C., Yang, T., Xu, L., Zhang, J., & Luo, P. (2024). ChatGPT’s ability to generate realistic experimental images poses a new challenge to academic integrity. Journal of Hematology & Oncology. https://doi.org/10.1186/s13045-024-01543-8
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.