New Challenges in Scientific Publications: Referencing, Artificial Intelligence and ChatGPT
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
The COVID-19 pandemic has led to a surge in scientific publications, some of which have bypassed the usual peer-review processes, leading to an increase in unsupported claims being referenced. Therefore, the need for references in scientific articles is increasingly being questioned. The practice of relying solely on quantitative measures, such as impact factor, is also considered inadequate by many experts. This can lead to researchers choosing research ideas that are likely to generate favourable metrics instead of interesting and important topics. Evaluating the quality and scientific value of articles requires a rethinking of current approaches, with a move away from purely quantitative methods. Artificial intelligence (AI)-based tools are making scientific writing easier and less time-consuming, which is likely to further increase the number of scientific publications, potentially leading to higher quality articles. AI tools for searching, analysing, synthesizing, evaluating and writing scientific literature are increasingly being developed. These tools deeply analyse the content of articles, consider their scientific impact, and prioritize the retrieved literature based on this information, presenting it in simple visual graphs. They also help authors to quickly and easily analyse and synthesize knowledge from the literature, prepare summaries of key information, aid in organizing references, and improve manuscript language. The language model ChatGPT has already greatly changed the way people communicate with computers, bringing it closer to human communication. However, while AI tools are helpful, they must be used carefully and ethically. In summary, AI has already changed the way we write articles, and its use in scientific publishing will continue to enhance and streamline the process.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“When references generated by LLMs are inaccurate or fabricated, the consequences extend beyond academic integrity, posing risks for patient safety, clinical outcomes, and professional training.”
From Fabricated or accurate? Ethical concerns and citation hallucination in aI-generated scientific writing on musculoskeletal topics (2025) · cites this paper as [5]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The International Committee of Medical Journal Editors
van der Weyden, M. (2006) · Proceedings of the Workshop on Publishing for Biomedical Journal Editors and Reviewers · doi:10.2349/biij.2.4.e54-13 · Cited by 1,998
Can artificial intelligence help for scientific writing?
Salvagno, M., Taccone, F. S., & Gerli, A. G. (2023) · Critical Care · doi:10.1186/s13054-023-04380-2 · Cited by 827 · cited 2×
“At about the same time we have seen the emergence of artificial intelligence tools, especially the language model ChatGPT, which has already changed the way many people write articles (2).”
Background(2015) · Chinese Nursing Research · doi:10.1016/j.cnre.2016.01.001 · Cited by 739
Nicholson, J. M., Mordaunt, M., Lopez, P., Uppala, A., Rosati, D., Rodrigues, N. P., Grabitz, P., & Rife, S. C. (2021) · bioRxiv (published in Quantitative Science Studies) · doi:10.1101/2021.03.15.435418 · Cited by 202 · cited 1×
“Some of these tools (scite) can also be used for research articles assessment (11).”
BackgroundSimons, K. (2008) · Science · doi:10.1126/science.1165316 · Cited by 177 · cited 1×
“Although the fact that many experts consider this to be an inadequate approach (8), the practice of relying solely on quantitative measures of quality is still widespread.”
BackgroundHow covid-19 bolstered an already perverse publishing system
Clark, J. (2023) · BMJ · doi:10.1136/bmj.p689 · Cited by 49 · cited 1×
“Some of these journals have bypassed the usual peer-review process to meet the increased demand, resulting in the publication of papers that they would not normally accept (e.g., small, uncontrolled studies, etc.) (1).”
BackgroundSmolčić, V. Š., Mlinarić, A., Antončić, D., Horvat, M., Omazić, J., & Šimundić, A.-M. (2015) · Biochemia Medica · doi:10.11613/bm.2015.033 · Cited by 27 · cited 1×
“However, with the rapid rise in published articles and other sources of information, both the purpose and need for references are being increasingly questioned (4).”
BackgroundCOVID-19 infodemic on Facebook and containment measures in Italy, United Kingdom and New Zealand
Etta, G., Galeazzi, A., Hutchings, J. R., Smith, C. S. J., Conti, M., Quattrociocchi, W., & Riva, G. V. D. (2022) · PLoS ONE · doi:10.1371/journal.pone.0267022 · Cited by 17 · cited 1×
“This problem was particularly evident in the toxic debates during the COVID-19 pandemic (6, 7).”
BackgroundPredators and hijackers in academic publishing
Švab, I., & Makivić, I. (2015) · European Journal of General Practice · doi:10.3109/13814788.2015.1037270 · Cited by 7 · cited 1×
“New types of quasi-scientific publications have become a serious issue for scientific work (5).”
BackgroundSelf-citationDispelling Covid-19 Misinformation
Epstein, H.-A. B. (2022) · Medical Reference Services Quarterly · doi:10.1080/02763869.2022.2021036 · Cited by 6 · cited 1×
“This problem was particularly evident in the toxic debates during the COVID-19 pandemic (6, 7).”
Background
Cited by
Using artificial intelligence in academic writing and research: An essential productivity tool
Khalifa, M., & Albadawy, M. (2024) · Computer Methods and Programs in Biomedicine Update · doi:10.1016/j.cmpbup.2024.100145 · Cited by 580
Wang, M., Wang, M., Xu, X., Yang, L., Cai, D., & Yin, M. (2023) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2023.3324714 · Cited by 218
Naeem, M., Smith, T., & Thomas, L. (2025) · International Journal of Qualitative Methods · doi:10.1177/16094069251333886 · Cited by 193
Tangadulrat, P., Sono, S., & Tangtrakulwanich, B. (2023) · JMIR Medical Education · doi:10.2196/50658 · Cited by 99
Gandía, J. A. G., Gavrila, S. G., Ancillo, A. D. L., & Núñez, M. T. D. V. (2024) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2024.123908 · Cited by 67
Metadata
- Authors
- Švab, I., Klemenc-Ketiš, Z., & Zupanič, S.
- Affiliations
- University of Ljubljana (SI)
- Department of Family Medicine, Medical Faculty , University of Ljubljana , Poljanski nasip 58 , Ljubljana , Slovenia
- National Institute of Public Health (SI)
- Venue
- Slovenian Journal of Public Health
- Publisher
- Walter de Gruyter GmbH
- Published
- 2023-06-13
- Volume
- 62
- Issue
- 3
- Pages
- 109-112
- ISSN
- 0351-0026 (ISSN-L)
- 1854-2476
- PMC
- PMC10263368
- OpenAlex
- W4380537205
- Cited by
- 29
- References
- 11
- Citations by year
- 2026: 5 · 2025: 10 · 2024: 8 · 2023: 6
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- Slovenian Journal of Public Health (publishedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- University of Maribor digital library (University of Maribor) (submittedVersion, cc-by-nc-nd)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- scholarly publishing, citation practices, ChatGPT, artificial intelligence in scientific writing, impact factor, publication ethics, peer review, AI ethics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: New Challenges in Scientific Publications: Referencing, Artificial Intelligence and ChatGPT. https://app.cochat.ai/papers/10.2478/sjph-2023-0015
- The paper
- Švab, I., Klemenc-Ketiš, Z., & Zupanič, S. (2023). New Challenges in Scientific Publications: Referencing, Artificial Intelligence and ChatGPT. Slovenian Journal of Public Health. https://doi.org/10.2478/sjph-2023-0015
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.