Student or educator? Sign up with your school email and get 6 months of Pro free.

The DOI matches its Crossref record; 98 of the 98 references it cites were found in a registry or an index.

Can Generative AI Improve Social Science?

Open access
Bail, Christopher A.·2023·Proceedings of the National Academy of Sciences

Abstract

Artificial intelligence that can produce realistic text,images, and other human-like outputs is currently transforming many different industries. Yet it is not yet known how such tools might transform social science research. In the first section of this article, I assess the potential of Generative AI to improve online experiments, agent-based models, and automated content analyses.I also discuss whether these tools may help social scientists perform literature reviews, identify novel research questions, and develop hypotheses to explain them. Next, I evaluate whether Generative AI can help social scientists with more mundane tasks such as acquiring advancedprogramming skills or writing more effective prose. In the second section of this article I discuss the limitations of Generative AI as well as how these tools might be employed by researchers in an ethical manner. I discuss how bias in the processes and data used to train these tools can negatively impact social science research as well as a rangeof other challenges related to accuracy, reproducibility,interpretability, and efficiency. I conclude by highlighting the need for increased collaboration between social scientists and artificial intelligence researchers--- not only to ensure that such tools are used in a safe and ethical manner, but also because the progress of artificial intelligence may require deeper understanding of theories of human behavior

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.31235/osf.io/rwtzs

Cites

98 of 98 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 90 references

Research works printed but not linked: 3

  1. [15]15. Daneshjou, Roxana et al. 2021. "Lack of Transparency and Potential Bias in Artificial Intelligence Data Sets and Algorithms: A Scoping Review." JAMA Dermatology 157(11): 1362-69.
  2. [39]39. Princeton, N.J.: Princeton University Press.
  3. [48]48. Yang, Kai-Cheng, and Filippo Menczer. 2023. "Large Language Models Can Rate News Outlet Credibility." http://arxiv.org/abs/2304.00228 (April 25, 2023). · arXiv

Cited by

See all 704

Metadata

Authors
Bail, C. A.
Affiliations
Duke University (US)
Corresponding author
Bail, Christopher A.
Venue
Proceedings of the National Academy of Sciences
Published
2023-05-12
Volume
121
Issue
21
Pages
e2314021121-e2314021121
ISSN
0027-8424 (ISSN-L)
OpenAlex
W4396781199
Cited by
369
References
90
Citations by year
2026: 143 · 2025: 160 · 2024: 55 · 2023: 11
FWCI
148.38
Type
journal article
Language
en
Open access
Locations
  • Proceedings of the National Academy of Sciences (publishedVersion, cc-by-nc-nd)
  • PubMed Central (publishedVersion, cc-by-nc-nd)
  • PubMed (publishedVersion)
  • SocArXiv (OSF Preprints) (submittedVersion, cc-by-nd)
  • SocArXiv (OSF Preprints) (submittedVersion)
Funders
Eunice Kennedy Shriver National Institute of Child Health and Human Development (P2CHD065563)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Social Sciences › General Social Sciences › Computational and Text Analysis Methods
  • Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
Keywords
generative AI, social science research, survey research, online experiments, computational text analysis, agent-based modeling, training data bias, research ethics, replication, environmental impact of AI, human behavior
MeSH terms
Artificial Intelligence, Humans, Social Sciences

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Can Generative AI Improve Social Science? https://app.cochat.ai/papers/10.31235/osf.io/rwtzs
The paper
Bail, C. A. (2023). Can Generative AI Improve Social Science? Proceedings of the National Academy of Sciences. https://doi.org/10.31235/osf.io/rwtzs

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.