CoChat

Navigating the Jagged Technological Frontier: Field Experimental Evidence of the Effects of Artificial Intelligence on Knowledge Worker Productivity and Quality

Open access
Dell'Acqua, Fabrizio, McFowland III, Edward, Mollick, Ethan R., Lifshitz-Assaf, Hila, Kellogg, Katherine, Rajendran, Saran, Krayer, Lisa, Candelon, François, Lakhani, Karim R. · 2023 · SSRN Electronic Journal

The DOI matches its Crossref record; 88 of the 88 references it cites were found in a registry or an index.

Abstract

We introduce and study the concept of a “jagged technology frontier” to describe the uneven impact of artificial intelligence (AI) capabilities, where AI assistance improves performance for some tasks but worsens it for others, even within the same knowledge workflow and with a seemingly similar level of difficulty. In collaboration with the global management consulting firm Boston Consulting Group, we have developed realistic management consulting tasks and examined the human performance implications of using AI to perform complex and knowledge-intensive work. The preregistered experiment involved 758 knowledge workers. After establishing a performance baseline on similar tasks, subjects were randomly assigned to one of three conditions: no AI access, GPT-4 AI access, or GPT-4 AI access with a prompt engineering overview. For each one of a set of 18 realistic knowledge tasks within the frontier of AI capabilities ranging from creative to analytical tasks, subjects using AI outperformed those not using AI, completing 12.2% more tasks and completing them 25.1% more quickly on average while also delivering solutions of significantly improved quality. However, for a complex managerial task selected to be outside the frontier, subjects using AI were 19% less likely to produce correct solutions compared with those without AI, pointing to potential limitations of AI supporting knowledge workers. We discuss the positive and negative implications of AI-aided human performance in knowledge-intensive tasks.

Overview

Integrity signals

Registry

Crossref · 10.2139/ssrn.4573321

Cites

88 of 88 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

15 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Citations

Cites

Show all 88 references

Research works printed but not linked: 16

  1. A Agrawal, 2018, Prediction Machines: The Simple Economics of Artificial Intelligence
  2. A Blandin, 2026, The rapid adoption of generative AI, Management Sci
  3. Z Buc �inca, 2021, To trust or to think: Cognitive forcing functions can reduce overreliance on AI in
  4. Dell'acqua, Navigating the Jagged Technological Frontier Organization Science, Articles in Advance, Proc. ACM Human-Comput. Interaction, 5
  5. E Sogancioglu, 2021, Deep learning for chest X-ray analysis: A survey, Medical Image Anal, 73
  6. F Dell'acqua, 2022, Falling asleep at the wheel: Human/AI collaboration in a field experiment on HR recruiters. Working paper, Laboratory for Innovation Science
  7. P F Drucker, 1959, Landmarks of Tomorrow: A Report on the New Post Modern World
  8. M Iansiti, 2020, Competing in the Age of AI: Strategy and Leadership When Algorithms and Networks Run the World
  9. A Karpathy, 2024, Commentary on jagged capabilities of large language models, Twitter
  10. A Karpathy, 2025, 2025 LLM year in review
  11. L Meincke, 2024, Using large language models for idea generation in innovation. Working paper, Operations, Information and Decisions
  12. S Pichai, 2025, Interview with Lex Fridman, Lex Fridman Podcast #471
  13. S Randazzo, 2025, GenAI as a power persuader: How professionals get persuasion bombed when they attempt to validate LLMs
  14. S Reed, 2022, A generalist agent
  15. Dell'acqua, Navigating the Jagged Technological Frontier
  16. K Vlamis, 2024, MBB explained: How hard it is to get hired and what it's like to work for the prestigious strategy consulting firms, McKinsey, Bain, and BCG. Bus. Insider Africa

Cited by

Items 301–400 of 798

Metadata

Authors
Dell'Acqua, F., McFowland III, E., Mollick, E. R., Lifshitz-Assaf, H., Kellogg, K., Rajendran, S., Krayer, L., Candelon, F., & Lakhani, K. R.
Affiliations
  • University of Pennsylvania (US)
  • Massachusetts Institute of Technology (US)
  • Boston Consulting Group (United States) (US)
  • Harvard University (US)
Venue
SSRN Electronic Journal
Publisher
Elsevier BV
Published
2023
ISSN
1556-5068 (ISSN-L)
OpenAlex
W4386827556
Cited by
794
References
67
Citations by year
2026: 240 · 2025: 305 · 2024: 230 · 2023: 18
Type
posted content
Language
en
Open access
Locations
SSRN Electronic Journal (acceptedVersion)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Impact of AI and Big Data on Business and Society
  • Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › AI and HR Technologies
Keywords
artificial intelligence, knowledge workers, GPT-4, prompt engineering, human-AI collaboration, task performance, solution quality, knowledge-intensive work

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.