Navigating the Jagged Technological Frontier: Field Experimental Evidence of the Effects of Artificial Intelligence on Knowledge Worker Productivity and Quality
Open accessThe DOI matches its Crossref record; 88 of the 88 references it cites were found in a registry or an index.
Abstract
We introduce and study the concept of a “jagged technology frontier” to describe the uneven impact of artificial intelligence (AI) capabilities, where AI assistance improves performance for some tasks but worsens it for others, even within the same knowledge workflow and with a seemingly similar level of difficulty. In collaboration with the global management consulting firm Boston Consulting Group, we have developed realistic management consulting tasks and examined the human performance implications of using AI to perform complex and knowledge-intensive work. The preregistered experiment involved 758 knowledge workers. After establishing a performance baseline on similar tasks, subjects were randomly assigned to one of three conditions: no AI access, GPT-4 AI access, or GPT-4 AI access with a prompt engineering overview. For each one of a set of 18 realistic knowledge tasks within the frontier of AI capabilities ranging from creative to analytical tasks, subjects using AI outperformed those not using AI, completing 12.2% more tasks and completing them 25.1% more quickly on average while also delivering solutions of significantly improved quality. However, for a complex managerial task selected to be outside the frontier, subjects using AI were 19% less likely to produce correct solutions compared with those without AI, pointing to potential limitations of AI supporting knowledge workers. We discuss the positive and negative implications of AI-aided human performance in knowledge-intensive tasks.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We already see widespread adoption of AI in business and the world at large [16].”
From Incorporating generative AI into a writing-intensive undergraduate course without off-loading learning (2025) · cites this paper as [16]
In the citing paper
“Previous studies have found that LLMs increase productivity the most for low-performing workers (Brynjolfsson et al. 2023, Noy and Zhang 2023, Dell'Acqua et al. 2023).”
From AI Meets the Classroom: When Do Large Language Models Harm Learning? (2024) · cites this paper as Dell'Acqua et al. 2023
In the citing paper
“In a laboratory experiment on consultants employed by Boston Consulting Group, Dell'Acqua et al. (2023) found that productivity on 18 tasks designed to mimic the day-to-day work at a consulting company increased by 12% to 25%.”
From The Productivity Effects of Generative AI: Evidence from a Field Experiment with GitHub Copilot (2024) · cites this paper as Dell'Acqua et al. (2023)
In the citing paper
“Gains were most impressive for historically below average performers, who improved performance 43%, compared to above average performers increasing performance 17%.”
From Is it all hype? ChatGPT’s performance and disruptive potential in the accounting and auditing industries (2024) · cites this paper as Dell'Acqua et al. (2023)
In the citing paper
“They showed dramatic improvements for tasks that AI can perform-consultants performed tasks 25.1% more quickly and completed 12.2% more tasks with quality 40% higher than a control group.”
From Is it all hype? ChatGPT’s performance and disruptive potential in the accounting and auditing industries (2024) · cites this paper as Dell'Acqua et al. (2023)
15 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The Skill Content of Recent Technological Change: An Empirical Exploration
Autor, D. H., Levy, F., & Murnane, R. J. (2003) · The Quarterly Journal of Economics · doi:10.1162/003355303322552801 · Cited by 6,205
Kung, T. H., Cheatham, M., ChatGPT, Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., et al. (2022) · doi:10.1101/2022.12.19.22283643 · Cited by 4,115
Kung, T. H., Cheatham, M., Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., Maningo, J., et al. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000198 · Cited by 4,115
Large language models encode clinical knowledge
Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., Scales, N., Tanwani, A., Cole-Lewis, H., Pfohl, S., et al. (2023) · Nature · doi:10.1038/s41586-023-06291-2 · Cited by 4,083
Skills, Tasks and Technologies: Implications for Employment and Earnings
Acemoglu, D., & Autor, D. (2011) · Handbook of Labor Economics · doi:10.1016/s0169-7218(11)02410-5 · Cited by 3,799
Agarwal, R., & Prasad, J. (1998) · Information Systems Research · doi:10.1287/isre.9.2.204 · Cited by 3,575
Human trust in artificial intelligence: Review of empirical research
Glikson, E., & Woolley, A. W. (2020) · Academy of Management Annals · doi:10.5465/annals.2018.0057 · Cited by 2,921
Artificial Intelligence and Management: The Automation–Augmentation Paradox
Raisch, S., & Krakowski, S. (2021) · Academy of Management Review · doi:10.5465/amr.2018.0072 · Cited by 2,755
Algorithms at Work: The New Contested Terrain of Control
Kellogg, K. C., Valentine, M. A., & Christin, A. (2020) · Academy of Management Annals · doi:10.5465/annals.2018.0174 · Cited by 2,732
Self-citationAutomation and New Tasks: How Technology Displaces and Reinstates Labor
Acemoglu, D., & Restrepo, P. (2019) · Journal of Economic Perspectives · doi:10.1257/jep.33.2.3 · Cited by 2,612
GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Models
Eloundou, T., Manning, S., Mishkin, P., & Rock, D. (2023) · arXiv · doi:10.48550/arxiv.2303.10130 · Cited by 2,330
Experimental evidence on the productivity effects of generative artificial intelligence
Noy, S., & Zhang, W. (2023) · Science · doi:10.1126/science.adh2586 · Cited by 2,150
Foundation models for generalist medical artificial intelligence
Moor, M., Banerjee, O., Abad, Z. S. H., Krumholz, H. M., Leskovec, J., Topol, E. J., & Rajpurkar, P. (2023) · Nature · doi:10.1038/s41586-023-05881-4 · Cited by 2,028
Benefits, Limits, and Risks of GPT-4 as an AI Chatbot for Medicine
Lee, P., Bubeck, S., & Petro, J. (2023) · New England Journal of Medicine · doi:10.1056/nejmsr2214184 · Cited by 1,738
Brynjolfsson, E., Li, D., & Raymond, L. (2025) · The Quarterly Journal of Economics · doi:10.1093/qje/qjae044 · Cited by 1,083
The Origins of Technology-Skill Complementarity
Goldin, C., & Katz, L. F. (1998) · The Quarterly Journal of Economics · doi:10.1162/003355398555720 · Cited by 1,061
Autonomous chemical research with large language models
Boiko, D. A., MacKnight, R., Kline, B., & Gomes, G. (2023) · Nature · doi:10.1038/s41586-023-06792-0 · Cited by 1,050
Short and extra-short forms of the Big Five Inventory–2: The BFI-2-S and BFI-2-XS
Soto, C. J., & John, O. P. (2017) · Journal of Research in Personality · doi:10.1016/j.jrp.2017.02.004 · Cited by 927
Heath, D. R. (2019) · Journal of Information Technology Case and Application Research · doi:10.1080/15228053.2019.1673511 · Cited by 901
Microfoundations of Organizational Paradox: The Problem Is How We Think about the Problem
Miron-Spektor, E., Ingram, A., Keller, J., Smith, W. K., & Lewis, M. W. (2018) · Academy of Management Journal · doi:10.5465/amj.2016.0594 · Cited by 805
Miron, E., Erez, M., & Naveh, E. (2004) · Journal of Organizational Behavior · doi:10.1002/job.237 · Cited by 736
What Can Machines Learn and What Does It Mean for Occupations and the Economy?
Brynjolfsson, E., Mitchell, T., & Rock, D. (2018) · AEA Papers and Proceedings · doi:10.1257/pandp.20181019 · Cited by 695
Does automation bias decision-making?
SKITKA, L. J., MOSIER, K. L., & BURDICK, M. (1999) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1999.0252 · Cited by 694
Lebovitz, S., Lifshitz-Assaf, H., & Levina, N. (2022) · Organization Science · doi:10.1287/orsc.2021.1549 · Cited by 632
Self-citationWhen combinations of humans and AI are useful: A systematic review and meta-analysis
Vaccaro, M., Almaatouq, A., & Malone, T. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-02024-1 · Cited by 570
Algorithmic Management of Work on Online Labor Platforms: When Matching Meets Control
Möhlmann, M., Zalmanson, L., Henfridsson, O., & Gregory, R. W. (2021) · MIS Quarterly · doi:10.25300/misq/2021/15333 · Cited by 554
Tong, S., Jia, N., Luo, X., & Fang, Z. (2021) · Strategic Management Journal · doi:10.1002/smj.3322 · Cited by 531
Furman, J., & Seamans, R. (2019) · Innovation Policy and the Economy · doi:10.1086/699936 · Cited by 483
Generative artificial intelligence, human creativity, and art
Zhou, E., & Lee, D. (2024) · PNAS Nexus · doi:10.1093/pnasnexus/pgae052 · Cited by 459
Advancing mathematics by guiding human intuition with AI
Davies, A., Veličković, P., Buesing, L., Blackwell, S., Zheng, D., Tomašev, N., Tanburn, R., Battaglia, P., Blundell, C., Juhász, A., et al. (2021) · Nature · doi:10.1038/s41586-021-04086-x · Cited by 451
Reconfiguring Boundary Relations: Robotic Innovations in Pharmacy Work
Barrett, M., Oborn, E., Orlikowski, W. J., & Yates, J. (2012) · Organization Science · doi:10.1287/orsc.1100.0639 · Cited by 421
“Collaborating” with AI: Taking a System View to Explore the Future of Work
Anthony, C., Bechky, B. A., & Fayard, A.-L. (2023) · Organization Science · doi:10.1287/orsc.2022.1651 · Cited by 370
Ali, R., Tang, O. Y., Connolly, I. D., Fridley, J. S., Shin, J. H., Zadnik Sullivan, P. L., Cielo, D., Oyelese, A. A., Doberstein, C. E., Telfeian, A. E., et al. (2023) · Neurosurgery · doi:10.1227/neu.0000000000002551 · Cited by 354
The Crowdless Future? Generative AI and Creative Problem Solving
Boussioux, L., N. Lane, J., Zhang, M., Jacimovic, V., & Lakhani, K. R. (2023) · doi:10.2139/ssrn.4533642 · Cited by 343
Self-citationThe Crowdless Future? Generative AI and Creative Problem-Solving
Boussioux, L., Lane, J. N., Zhang, M., Jacimovic, V., & Lakhani, K. R. (2024) · Organization Science · doi:10.1287/orsc.2023.18430 · Cited by 329
Self-citationBhattacharya, D. (2021) · Strategic Analysis · doi:10.1080/09700161.2021.1918951 · Cited by 311
Bailey, D. E., Faraj, S., Hinds, P. J., Leonardi, P. M., & von Krogh, G. (2022) · Organization Science · doi:10.1287/orsc.2021.1562 · Cited by 305
Machine learning and human capital complementarities: Experimental evidence on bias mitigation
Choudhury, P., Starr, E., & Agarwal, R. (2020) · Strategic Management Journal · doi:10.1002/smj.3152 · Cited by 293
The Impact of AI on Developer Productivity: Evidence from GitHub Copilot
Peng, S., Kalliamvakou, E., Cihon, P., & Demirer, M. (2023) · arXiv · doi:10.48550/arxiv.2302.06590 · Cited by 287
Shadow Learning: Building Robotic Surgical Skill When Approved Means Fail
Beane, M. (2019) · Administrative Science Quarterly · doi:10.1177/0001839217751692 · Cited by 286
Information, Technology, and Information Worker Productivity
Aral, S., Brynjolfsson, E., & Van Alstyne, M. (2012) · Information Systems Research · doi:10.1287/isre.1110.0408 · Cited by 256
Make Way for the Algorithms: Symbolic Actions and Change in a Regime of Knowing
Pachidi, S., Berends, H., Faraj, S., & Huysman, M. (2021) · Organization Science · doi:10.1287/orsc.2020.1377 · Cited by 218
Are Emergent Abilities of Large Language Models a Mirage?
Schaeffer, R., Miranda, B., & Koyejo, S. (2023) · arXiv · doi:10.48550/arxiv.2304.15004 · Cited by 200
Hui, X., Reshef, O., & Zhou, L. (2024) · Organization Science · doi:10.1287/orsc.2023.18441 · Cited by 200
(2023) · doi:10.52202/075280-2425 · Cited by 200
The Power of Prediction: Predictive Analytics, Workplace Complements, and Business Performance
Brynjolfsson, E., Jin, W., & McElheran, K. (2021) · Business Economics · doi:10.1057/s11369-021-00224-5 · Cited by 198
"The human body is a black box": supporting clinical decision-making with deep learning
Sendak, M., Elish, M. C., Gao, M., Futoma, J., Ratliff, W., Nichols, M., Bedoya, A., Balu, S., & O'Brien, C. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372827 · Cited by 196
Failures of Fairness in Automation Require a Deeper Understanding of Human–ML Augmentation
Teodorescu, M. H. M., Morse, L., Awwad, Y., & Kane, G. C. (2021) · MIS Quarterly · doi:10.25300/misq/2021/16535 · Cited by 194
Human-AI Ensembles: When Can They Work?
Choudhary, V., Marchetti, A., Shrestha, Y. R., & Puranam, P. (2025) · Journal of Management · doi:10.1177/01492063231194968 · Cited by 194
Algorithm-Augmented Work and Domain Experience: The Countervailing Forces of Ability and Aversion
Allen, R., & Choudhury, P. (. (2022) · Organization Science · doi:10.1287/orsc.2021.1554 · Cited by 177
AI and Its Impact on Creativity and Diversity: An Empirical Study of LLM-Generated Product Ideas
Terwiesch, C., Meincke, L., Girotra, K., Mollick, E. R., Nave, G., & Ulrich, K. T. (2023) · doi:10.2139/ssrn.4526071 · Cited by 174
Self-citationBiased Programmers? Or Biased Data? A Field Experiment in Operationalizing AI Ethics
Cowgill, B., Dell'Acqua, F., Deng, S., Hsu, D., Verma, N., & Chaintreau, A. (2020) · Proceedings of the 21st ACM Conference on Economics and Computation · doi:10.1145/3391403.3399545 · Cited by 166
Self-citationWaardenburg, L., Huysman, M., & Sergeeva, A. V. (2022) · Organization Science · doi:10.1287/orsc.2021.1544 · Cited by 165
Occupational Heterogeneity in Exposure to Generative AI
Felten, E. W., Raj, M., & Seamans, R. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4414065 · Cited by 163
Human–AI collaborative decision-making as an organization design problem
Puranam, P. (2021) · Journal of Organization Design · doi:10.1007/s41469-021-00095-2 · Cited by 162
Bringing artificial intelligence to business management
Feuerriegel, S., Shrestha, Y. R., von Krogh, G., & Zhang, C. (2022) · Nature Machine Intelligence · doi:10.1038/s42256-022-00512-5 · Cited by 162
Losing Touch: An Embodiment Perspective on Coordination in Robotic Surgery
Sergeeva, A., Faraj, S. A., & Huysman, M. (2020) · Organization Science · doi:10.1287/orsc.2019.1343 · Cited by 151
Taming Platform Power: Taking Accountability into Account in the Management of Platforms
Rahman, H. A., Karunakaran, A., & Cameron, L. D. (2024) · Academy of Management Annals · doi:10.5465/annals.2022.0090 · Cited by 136
Scaling up analogical innovation with crowds and AI
Kittur, A., Yu, L., Hope, T., Chan, J., Lifshitz‐Assaf, H., Gilon, K., Ng, F., Kraut, R. E., & Shahaf, D. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1807185116 · Cited by 131
Self-citationTraining with AI: Evidence from chess computers
Gaessler, F., & Piezunka, H. (2023) · Strategic Management Journal · doi:10.1002/smj.3512 · Cited by 125
ChatGPT has Aced the Test of Understanding in College Economics: Now What?
Geerling, W., Mateer, G. D., Wooten, J., & Damodaran, N. (2023) · The American Economist · doi:10.1177/05694345231169654 · Cited by 119
Capturing Value from Artificial Intelligence
Berg, J. M., Raj, M., & Seamans, R. (2023) · Academy of Management Discoveries · doi:10.5465/amd.2023.0106 · Cited by 115
Strategic organization in the digital age: Rethinking the concept of technology
Faraj, S. A., & Leonardi, P. M. (2022) · Strategic Organization · doi:10.1177/14761270221130253 · Cited by 111
The unequal adoption of ChatGPT exacerbates existing inequalities among workers
Humlum, A., & Vestergaard, E. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2414972121 · Cited by 107
The Uneven Impact of Generative AI on Entrepreneurial PerformancePreprint
Otis, N. G., Clarke, R. P., Delecourt, S., Holtz, D., & Koning, R. M. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4671369 · Cited by 107
The Diversity Bonus: How Great Teams Pay Off in the Knowledge Economy
Wooten, L. P. (2019) · Administrative Science Quarterly · doi:10.1177/0001839219850119 · Cited by 96
The Allocation of Decision Authority to Human and Artificial Intelligence
Athey, S. C., Bryan, K. A., & Gans, J. S. (2020) · AEA Papers and Proceedings · doi:10.1257/pandp.20201034 · Cited by 88
Balakrishnan, M., Ferreira, K., & Tong, J. D. (2025) · Management Science · doi:10.1287/mnsc.2022.03850 · Cited by 87
Decision authority and the returns to algorithms
Kim, H., Glaeser, E. L., Hillis, A., Kominers, S. D., & Luca, M. (2023) · Strategic Management Journal · doi:10.1002/smj.3569 · Cited by 81
AI Assistance in Legal Analysis: An Empirical Study
Choi, J. H., & Schwarcz, D. (2023) · doi:10.2139/ssrn.4539836 · Cited by 80
Ali, R., Tang, O. Y., Connolly, I. D., et al. (2023) · medRxiv · doi:10.1101/2023.04.06.23288265 · Cited by 79
Emergent autonomous scientific research capabilities of large language models
Boiko, D. A., MacKnight, R., & Gomes, G. (2023) · arXiv · doi:10.48550/arxiv.2304.05332 · Cited by 72
Kellogg, K. C. (2021) · Organization Science · doi:10.1287/orsc.2021.1445 · Cited by 68
Self-citationDell’Acqua, F., Kogut, B., & Perkowski, P. (2020) · The Review of Economics and Statistics · doi:10.1162/rest_a_01328 · Cited by 64
Self-citationArt-ificial Intelligence: The Effect of AI Disclosure on Evaluations of Creative ContentPreprint
Raj, M., Berg, J. M., & Seamans, R. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4369818 · Cited by 57
Lebovitz, S., Levina, N., & Lifshitz-Assaf, H. (2021) · MIS Quarterly · doi:10.25300/misq/2021/16564 · Cited by 49
Self-citationGlobal Evidence on Gender Gaps and Generative AIPreprint
Otis, N. G., Delecourt, S., Cranney, K., & Koning, R. M. (2024) · doi:10.31219/osf.io/h6a7c · Cited by 46
Beane, M., & Leonardi, P. M. (2022) · Journal of Management Studies · doi:10.1111/joms.12867 · Cited by 36
"The Human Body is a Black Box": Supporting Clinical Decision-Making with Deep LearningPreprint
Sendak, M., Elish, M. C., Gao, M. C., Futoma, J., Ratliff, W., Nichols, M., Bedoya, A., Balu, S., & O’Brien, C. L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.08089 · Cited by 35
Kellogg, K. C., Myers, J. E., Gainer, L., & Singer, S. J. (2020) · Organization Science · doi:10.1287/orsc.2020.1374 · Cited by 25
Self-citationImproving Human-Algorithm Collaboration: Causes and Mitigation of Over- and Under-AdherencePreprint
Balakrishnan, M., Ferreira, K., & Tong, J. D. (2022) · Social Science Research Network · doi:10.2139/ssrn.4298669 · Cited by 14
State Actor Orchestration for Achieving Workforce Development at Scale: Evidence from Four US States
Myers, J. E., & Kellogg, K. C. (2020) · Industrial and Labor Relations Review · doi:10.1177/0019793920942767 · Cited by 11
Self-citationDeStefano, T. J., Kellogg, K. C., Menietti, M., et al. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4246077 · Cited by 10
Self-citationMonisha, R., Sen, S., Davangeri, R. U., et al. (2022) · Lecture notes in networks and systems · doi:10.1007/978-981-19-0901-6_26 · Cited by 10
Taming Platform Power: Taking Accountability Into Account In The Management Of PlatformsPreprint
Rahman, H. A., Karunakaran, A., & Cameron, L. D. (2023) · doi:10.31235/osf.io/92k57 · Cited by 7
Randazzo, S., Lifshitz-Assaf, H., Kellogg, K., et al. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4921696 · Cited by 6
Self-citationLazar, M., Lifshitz‐Assaf, H., Ayoubi, C., et al. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4571336 · Cited by 1
Self-citationOpenAI, Achiam, J., Adler, S., Agarwal, S., Ahmad, L., Akkaya, I., Aleman, F. L., Almeida, D., Altenschmidt, J., Altman, S., et al. (2023) · arXiv · doi:10.48550/arxiv.2303.08774
Research works printed but not linked: 16
- A Agrawal, 2018, Prediction Machines: The Simple Economics of Artificial Intelligence
- A Blandin, 2026, The rapid adoption of generative AI, Management Sci
- Z Buc �inca, 2021, To trust or to think: Cognitive forcing functions can reduce overreliance on AI in
- Dell'acqua, Navigating the Jagged Technological Frontier Organization Science, Articles in Advance, Proc. ACM Human-Comput. Interaction, 5
- E Sogancioglu, 2021, Deep learning for chest X-ray analysis: A survey, Medical Image Anal, 73
- F Dell'acqua, 2022, Falling asleep at the wheel: Human/AI collaboration in a field experiment on HR recruiters. Working paper, Laboratory for Innovation Science
- P F Drucker, 1959, Landmarks of Tomorrow: A Report on the New Post Modern World
- M Iansiti, 2020, Competing in the Age of AI: Strategy and Leadership When Algorithms and Networks Run the World
- A Karpathy, 2024, Commentary on jagged capabilities of large language models, Twitter
- A Karpathy, 2025, 2025 LLM year in review
- L Meincke, 2024, Using large language models for idea generation in innovation. Working paper, Operations, Information and Decisions
- S Pichai, 2025, Interview with Lex Fridman, Lex Fridman Podcast #471
- S Randazzo, 2025, GenAI as a power persuader: How professionals get persuasion bombed when they attempt to validate LLMs
- S Reed, 2022, A generalist agent
- Dell'acqua, Navigating the Jagged Technological Frontier
- K Vlamis, 2024, MBB explained: How hard it is to get hired and what it's like to work for the prestigious strategy consulting firms, McKinsey, Bain, and BCG. Bus. Insider Africa
Cited by
Brynjolfsson, E., Li, D., & Raymond, L. (2025) · The Quarterly Journal of Economics · doi:10.1093/qje/qjae044 · Cited by 1,083
Jackson, I., Ivanov, D., Dolgui, A., & Namdar, J. (2024) · International Journal of Production Research · doi:10.1080/00207543.2024.2309309 · Cited by 441
AI literacy and its implications for prompt engineering strategies
Knoth, N., Tolzin, A., Janson, A., & Leimeister, J. M. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100225 · Cited by 368
“Dell ’ Acqua et al. (2023) showed the positive effects on consultant work outcomes, thus, this technology will be adopted industry-wide and we need to train our students in prompting LLMs.”
BackgroundThe Crowdless Future? Generative AI and Creative Problem-Solving
Boussioux, L., Lane, J. N., Zhang, M., Jacimovic, V., & Lakhani, K. R. (2024) · Organization Science · doi:10.1287/orsc.2023.18430 · Cited by 329
Self-citationLarge Legal Fictions: Profiling Legal Hallucinations in Large Language Models
Dahl, M., Magesh, V., Suzgun, M., & Ho, D. E. (2024) · Journal of Legal Analysis · doi:10.1093/jla/laae003 · Cited by 559
Metadata
- Authors
- Dell'Acqua, F., McFowland III, E., Mollick, E. R., Lifshitz-Assaf, H., Kellogg, K., Rajendran, S., Krayer, L., Candelon, F., & Lakhani, K. R.
- Affiliations
- University of Pennsylvania (US)
- Massachusetts Institute of Technology (US)
- Boston Consulting Group (United States) (US)
- Harvard University (US)
- Venue
- SSRN Electronic Journal
- Publisher
- Elsevier BV
- Published
- 2023
- ISSN
- 1556-5068 (ISSN-L)
- OpenAlex
- W4386827556
- Semantic Scholar
- 409dc9f1801947f85c53231cba346f0e314cb208
- Cited by
- 794
- References
- 67
- Citations by year
- 2026: 240 · 2025: 305 · 2024: 230 · 2023: 18
- Type
- posted content
- Language
- en
- Open access
- green
- doi.org
- Locations
- SSRN Electronic Journal (acceptedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Social Sciences › Decision Sciences › Management Science and Operations Research › Impact of AI and Big Data on Business and Society
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › AI and HR Technologies
- Keywords
- artificial intelligence, knowledge workers, GPT-4, prompt engineering, human-AI collaboration, task performance, solution quality, knowledge-intensive work
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.