The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Experimental evidence on the productivity effects of generative artificial intelligence
Open accessAbstract
We examined the productivity effects of a generative artificial intelligence (AI) technology, the assistive chatbot ChatGPT, in the context of midlevel professional writing tasks. In a preregistered online experiment, we assigned occupation-specific, incentivized writing tasks to 453 college-educated professionals and randomly exposed half of them to ChatGPT. Our results show that ChatGPT substantially raised productivity: The average time taken decreased by 40% and output quality rose by 18%. Inequality between workers decreased, and concern and excitement about AI temporarily rose. Workers exposed to ChatGPT during the experiment were 2 times as likely to report using it in their real job 2 weeks after the experiment and 1.6 times as likely 2 months after the experiment.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“That generative AI particularly benefited less able writers is paralleled in recent studies focusing on other domains in which generative AI has been shown to help less productive workers (4, 5).”
From Generative artificial intelligence enhances creativity but reduces the diversity of novel content (2023) · cites this paper as [4]
In the citing paper
“Previous studies have found that LLMs increase productivity the most for low-performing workers (Brynjolfsson et al. 2023, Noy and Zhang 2023, Dell'Acqua et al. 2023).”
From AI Meets the Classroom: When Do Large Language Models Harm Learning? (2024) · cites this paper as Noy and Zhang 2023
In the citing paper
“Noy and Zhang (2023) show that access to LLMs reduced completion time of mid-level professional writing tasks by 40 percent and raised quality by 18 percent, while compressing productivity differences between workers.”
From Labor Market Consequences of Generative AI: Early Evidence from Norway (2026) · cites this paper as Noy and Zhang, 2023
In the citing paper
“The study finds that AI can generate a large number of ideas within a very short time, markedly improving work efficiency (Noy and Zhang, 2023).”
From From humans to AI: understanding why AI is perceived as the preferred co-creation partner (2025) · cites this paper as Noy and Zhang, 2023
In the citing paper
“GenAI has signi cantly impacted various aspects of daily life, including enhancing productivity [68], writing [57, 58], interpersonal communication [35], and relationships [34, 76].”
From Creativity in the Age of AI: Evaluating the Impact of Generative AI on Design Outputs and Designers' Creative Thinking (2024) · cites this paper as [68]
32 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Robots and Jobs: Evidence from US Labor Markets
Acemoglu, D., & Restrepo, P. (2020) · Journal of Political Economy · doi:10.1086/705716 · Cited by 4,088
Why Are There Still So Many Jobs? The History and Future of Workplace Automation
Autor, D. H. (2015) · Journal of Economic Perspectives · doi:10.1257/jep.29.3.3 · Cited by 3,917 · cited 1×
“Previous waves of automation predominantly impacted “routine” tasks consisting of explicit sequences of steps that could be easily codified and programmed into a computer (Autor and Dorn, 2013; Autor, 2015).”
BackgroundThe growth of low-skill service jobs and the polarization of the US labor market
Autor, D. H., & Dorn, D. (2013) · American Economic Review · doi:10.1257/aer.103.5.1553 · Cited by 3,824 · cited 1×
“Previous waves of automation predominantly impacted “routine” tasks consisting of explicit sequences of steps that could be easily codified and programmed into a computer (Autor and Dorn, 2013; Autor, 2015).”
BackgroundAcemoglu, D., & Restrepo, P. (2018) · American Economic Review · doi:10.1257/aer.20160696 · Cited by 3,121 · cited 1×
“Moreover, their impacts on aggregate productivity may be small or nonexistent to the degree that they mainly serve to redistribute income previously earned by displaced workers to the capital owners supplying their robot replacements (10).”
BackgroundGPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Models
Eloundou, T., Manning, S., Mishkin, P., & Rock, D. (2023) · arXiv · doi:10.48550/arxiv.2303.10130 · Cited by 2,330
Data quality of platforms and panels for online behavioral research
Peer, E., Rothschild, D., Gordon, A., Evernden, Z., & Damer, E. (2021) · Behavior Research Methods · doi:10.3758/s13428-021-01694-3 · Cited by 1,718
Training, Wages, and Sample Selection: Estimating Sharp Bounds on Treatment Effects
LEE, D. S. (2009) · Review of Economic Studies · doi:10.1111/j.1467-937x.2009.00536.x · Cited by 1,399
Human Decisions and Machine Predictions
Kleinberg, J., Lakkaraju, H., Leskovec, J., Ludwig, J., & Mullainathan, S. (2018) · The Quarterly Journal of Economics · doi:10.1093/qje/qjx032 · Cited by 1,040
Brynjolfsson, E., Li, D., & Raymond, L. (2023) · National Bureau of Economic Research · doi:10.3386/w31161 · Cited by 995 · cited 1×
“These results are consistent with other studies showing productivity-enhancing and equalizing effects of recent AI technologies (8, 15, 16, 18).”
ResultToward understanding the impact of artificial intelligence on labor
Frank, M. R., Autor, D., Bessen, J. E., Brynjolfsson, E., Cebrian, M., Deming, D. J., Feldman, M., Groh, M., Lobo, J., Moro, E., et al. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1900949116 · Cited by 713
Research works printed but not linked: 1
- Data and code for: S. Noy W. Zhang Experimental evidence on the productivity effects of generative artificial intelligence Open Science Framework (2023); https://osf.io/xd7qw/?view_only=b8dac58dd6f44b979bf81069022fa392DOI10.17605/OSF.IO/XD7QW.10.17605/OSF.IO/XD7QW · doi:10.17605/osf.io/xd7qw
Cited by
Brynjolfsson, E., Li, D., & Raymond, L. (2023) · National Bureau of Economic Research · doi:10.3386/w31161 · Cited by 995
Brynjolfsson, E., Li, D., & Raymond, L. (2025) · The Quarterly Journal of Economics · doi:10.1093/qje/qjae044 · Cited by 1,083
Generative artificial intelligence enhances creativity but reduces the diversity of novel content
Doshi, A., & Hauser, O. (2023) · doi:10.2139/ssrn.4535536 · Cited by 1,350
“That generative AI particularly benefited less able writers is paralleled in recent studies focusing on other domains in which generative AI has been shown to help less productive workers ( 4 , 5 ).”
Dell'Acqua, F., McFowland III, E., Mollick, E. R., Lifshitz-Assaf, H., Kellogg, K., Rajendran, S., Krayer, L., Candelon, F., & Lakhani, K. R. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4573321 · Cited by 794
Fan, Y., Tang, L., Le, H., Shen, K., Tan, S., Zhao, Y., Shen, Y., Li, X., & Gašević, D. (2025) · British Journal of Educational Technology · doi:10.1111/bjet.13544 · Cited by 805
Metadata
- Authors
- Noy, S., & Zhang, W.
- Affiliations
- Massachusetts Institute of Technology (US)
- Corresponding author
- Noy, Shakked
- Venue
- Science
- Published
- 2023-07-14
- Volume
- 381
- Issue
- 6654
- Pages
- 187-192
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W4384154918
- Semantic Scholar
- 8d020275181c69e5e768c6ffc40e09710a6f54f1
- Cited by
- 2,150
- References
- 29
- Citations by year
- 2026: 985 · 2025: 639 · 2024: 405 · 2023: 116
- FWCI
- 435.72
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Locations
- Science (publishedVersion)
- SSRN Electronic Journal (acceptedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Labor market dynamics and wage inequality
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Keywords
- generative AI, ChatGPT, productivity, professional writing, artificial intelligence adoption, output quality, task completion time, attitudes toward AI, workplace technology use
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Experimental evidence on the productivity effects of generative artificial intelligence. https://app.cochat.ai/papers/10.1126/science.adh2586
- The paper
- Noy, S., & Zhang, W. (2023). Experimental evidence on the productivity effects of generative artificial intelligence. Science. https://doi.org/10.1126/science.adh2586
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.