Cited by 40Academic Publishing and Open AccessResearch Data Management PracticesEthics and Social Impacts of AI

Open Science at the generative AI turn: An exploratory analysis of challenges and opportunities

Open access
Hosseini, Mohammad, Horbach, Serge P. J. M., Holmes, Kristi, Ross-Hellauer, Tony·2025·Quantitative Science Studies

Published version of a preprint

Abstract

Technology influences Open Science (OS) practices, because conducting science in transparent, accessible, and participatory ways requires tools and platforms for collaboration and sharing results. Due to this relationship, the characteristics of the employed technologies directly impact OS objectives. Generative Artificial Intelligence (GenAI) is increasingly used by researchers for tasks such as text refining, code generation/editing, reviewing literature, and data curation/analysis. Nevertheless, concerns about openness, transparency, and bias suggest that GenAI may benefit from greater engagement with OS. GenAI promises substantial efficiency gains but is currently fraught with limitations that could negatively impact core OS values, such as fairness, transparency, and integrity, and may harm various social actors. In this paper, we explore the possible positive and negative impacts of GenAI on OS. We use the taxonomy within the UNESCO Recommendation on Open Science to systematically explore the intersection of GenAI and OS. We conclude that using GenAI could advance key OS objectives by broadening meaningful access to knowledge, enabling efficient use of infrastructure, improving engagement of societal actors, and enhancing dialogue among knowledge systems. However, due to GenAI’s limitations, it could also compromise the integrity, equity, reproducibility, and reliability of research. Hence, sufficient checks, validation, and critical assessments are essential when incorporating GenAI into research workflows.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1162/qss_a_00337

Cites

103 of 103 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 4

  1. Elsevier. (n.d.). Publishing ethics. Retrieved April 5, 2024, from https://www.elsevier.com/about/policies-and-standards/publishing-ethics.
  2. Fleerackers A (2023). Unreviewed science in the news: Why and how journalists cover preprint research. Simon Fraser University. https://summit.sfu.ca/item/36680
  3. Pearson J (2024). Scientific journal publishes AI-generated rat with gigantic penis in worrying incident. Vice, February 15. https://www.vice.com/en/article/dy3jbz/scientific-journal-frontiers-publishes-ai-generated-rat-with-gigantic-penis-in-worrying-incident
  4. Wolters Kluwer. (2021). Terms of use. Wolters Kluwer, April 9. https://www.wolterskluwer.com/en/terms-of-use

Cited by

Sorted by citations

Authors
Hosseini, M., Horbach, S. P. J. M., Holmes, K., & Ross-Hellauer, T.
Affiliations
  • Northwestern University (US)
  • Radboud University Nijmegen (NL)
  • Open and Reproducible Research Group, Know-Center GmbH and Institute for Interactive Systems and Data Science, Graz University of Technology, Graz, Austria
Corresponding author
Hosseini, Mohammad
Venue
Quantitative Science Studies
Publisher
MIT Press
Published
2025
Volume
6
Pages
22-45
ISSN
2641-3337 (ISSN-L)
OpenAlex
W4404059533
Cited by
40
References
97
Citations by year
2026: 21 · 2025: 18 · 2024: 1
FWCI
14.93
Type
journal article
Language
en
Open access
Locations
  • Quantitative Science Studies (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • PubMed Central (acceptedVersion, cc-by-sa)
  • Radboud Repository (Radboud University) (submittedVersion, cc-by-sa)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • SocArXiv (OSF Preprints) (submittedVersion, cc-by-nd)
Funders
  • National Center for Advancing Translational Sciences (UL1TR001422, UM1TR005121)
  • Office of Data Science Strategy (OTA-21-009, OTA Number OT2DB000013-01)
  • U.S. National Library of Medicine (U24LM013751)
  • Horizon Europe Programme (101094817)
  • Know-Center (COMET—Competence Centers for Excellent Technologies)
Topics
  • Social Sciences › Decision Sciences › Information Systems and Management › Academic Publishing and Open Access
  • Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
  • Social Sciences › Safety Research › Ethics and Social Impacts of AI
Keywords
open science, generative AI, research integrity, transparency, reproducibility, UNESCO Recommendation on Open Science, research bias, research equity, research workflows

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review