The DOI matches its Crossref record; 88 of the 88 references it cites were found in a registry or an index.
Navigating the Jagged Technological Frontier: Field Experimental Evidence of the Effects of Artificial Intelligence on Knowledge Worker Productivity and Quality
Open accessAbstract
We introduce and study the concept of a “jagged technology frontier” to describe the uneven impact of artificial intelligence (AI) capabilities, where AI assistance improves performance for some tasks but worsens it for others, even within the same knowledge workflow and with a seemingly similar level of difficulty. In collaboration with the global management consulting firm Boston Consulting Group, we have developed realistic management consulting tasks and examined the human performance implications of using AI to perform complex and knowledge-intensive work. The preregistered experiment involved 758 knowledge workers. After establishing a performance baseline on similar tasks, subjects were randomly assigned to one of three conditions: no AI access, GPT-4 AI access, or GPT-4 AI access with a prompt engineering overview. For each one of a set of 18 realistic knowledge tasks within the frontier of AI capabilities ranging from creative to analytical tasks, subjects using AI outperformed those not using AI, completing 12.2% more tasks and completing them 25.1% more quickly on average while also delivering solutions of significantly improved quality. However, for a complex managerial task selected to be outside the frontier, subjects using AI were 19% less likely to produce correct solutions compared with those without AI, pointing to potential limitations of AI supporting knowledge workers. We discuss the positive and negative implications of AI-aided human performance in knowledge-intensive tasks.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We already see widespread adoption of AI in business and the world at large [16].”
From Incorporating generative AI into a writing-intensive undergraduate course without off-loading learning (2025) · cites this paper as [16]
In the citing paper
“Previous studies have found that LLMs increase productivity the most for low-performing workers (Brynjolfsson et al. 2023, Noy and Zhang 2023, Dell'Acqua et al. 2023).”
From AI Meets the Classroom: When Do Large Language Models Harm Learning? (2024) · cites this paper as Dell'Acqua et al. 2023
In the citing paper
“In a laboratory experiment on consultants employed by Boston Consulting Group, Dell'Acqua et al. (2023) found that productivity on 18 tasks designed to mimic the day-to-day work at a consulting company increased by 12% to 25%.”
From The Productivity Effects of Generative AI: Evidence from a Field Experiment with GitHub Copilot (2024) · cites this paper as Dell'Acqua et al. (2023)
In the citing paper
“Gains were most impressive for historically below average performers, who improved performance 43%, compared to above average performers increasing performance 17%.”
From Is it all hype? ChatGPT’s performance and disruptive potential in the accounting and auditing industries (2024) · cites this paper as Dell'Acqua et al. (2023)
In the citing paper
“They showed dramatic improvements for tasks that AI can perform-consultants performed tasks 25.1% more quickly and completed 12.2% more tasks with quality 40% higher than a control group.”
From Is it all hype? ChatGPT’s performance and disruptive potential in the accounting and auditing industries (2024) · cites this paper as Dell'Acqua et al. (2023)
15 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The Skill Content of Recent Technological Change: An Empirical Exploration
Autor, D. H., Levy, F., & Murnane, R. J. (2003) · The Quarterly Journal of Economics · doi:10.1162/003355303322552801 · Cited by 6,205
Kung, T. H., Cheatham, M., ChatGPT, Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., et al. (2022) · doi:10.1101/2022.12.19.22283643 · Cited by 4,115
Kung, T. H., Cheatham, M., Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., Maningo, J., et al. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000198 · Cited by 4,115
Large language models encode clinical knowledge
Singhal, K., Azizi, S., Tu, T., Mahdavi, S. S., Wei, J., Chung, H. W., Scales, N., Tanwani, A., Cole-Lewis, H., Pfohl, S., et al. (2023) · Nature · doi:10.1038/s41586-023-06291-2 · Cited by 4,083
Skills, Tasks and Technologies: Implications for Employment and Earnings
Acemoglu, D., & Autor, D. (2011) · Handbook of Labor Economics · doi:10.1016/s0169-7218(11)02410-5 · Cited by 3,799
Agarwal, R., & Prasad, J. (1998) · Information Systems Research · doi:10.1287/isre.9.2.204 · Cited by 3,575
Human trust in artificial intelligence: Review of empirical research
Glikson, E., & Woolley, A. W. (2020) · Academy of Management Annals · doi:10.5465/annals.2018.0057 · Cited by 2,921
Artificial Intelligence and Management: The Automation–Augmentation Paradox
Raisch, S., & Krakowski, S. (2021) · Academy of Management Review · doi:10.5465/amr.2018.0072 · Cited by 2,755
Algorithms at Work: The New Contested Terrain of Control
Kellogg, K. C., Valentine, M. A., & Christin, A. (2020) · Academy of Management Annals · doi:10.5465/annals.2018.0174 · Cited by 2,732
Self-citationAutomation and New Tasks: How Technology Displaces and Reinstates Labor
Acemoglu, D., & Restrepo, P. (2019) · Journal of Economic Perspectives · doi:10.1257/jep.33.2.3 · Cited by 2,612
Research works printed but not linked: 16
- A Agrawal, 2018, Prediction Machines: The Simple Economics of Artificial Intelligence
- A Blandin, 2026, The rapid adoption of generative AI, Management Sci
- Z Buc �inca, 2021, To trust or to think: Cognitive forcing functions can reduce overreliance on AI in
- Dell'acqua, Navigating the Jagged Technological Frontier Organization Science, Articles in Advance, Proc. ACM Human-Comput. Interaction, 5
- E Sogancioglu, 2021, Deep learning for chest X-ray analysis: A survey, Medical Image Anal, 73
- F Dell'acqua, 2022, Falling asleep at the wheel: Human/AI collaboration in a field experiment on HR recruiters. Working paper, Laboratory for Innovation Science
- P F Drucker, 1959, Landmarks of Tomorrow: A Report on the New Post Modern World
- M Iansiti, 2020, Competing in the Age of AI: Strategy and Leadership When Algorithms and Networks Run the World
- A Karpathy, 2024, Commentary on jagged capabilities of large language models, Twitter
- A Karpathy, 2025, 2025 LLM year in review
- L Meincke, 2024, Using large language models for idea generation in innovation. Working paper, Operations, Information and Decisions
- S Pichai, 2025, Interview with Lex Fridman, Lex Fridman Podcast #471
- S Randazzo, 2025, GenAI as a power persuader: How professionals get persuasion bombed when they attempt to validate LLMs
- S Reed, 2022, A generalist agent
- Dell'acqua, Navigating the Jagged Technological Frontier
- K Vlamis, 2024, MBB explained: How hard it is to get hired and what it's like to work for the prestigious strategy consulting firms, McKinsey, Bain, and BCG. Bus. Insider Africa
Cited by
Brynjolfsson, E., Li, D., & Raymond, L. (2025) · The Quarterly Journal of Economics · doi:10.1093/qje/qjae044 · Cited by 1,083
Jackson, I., Ivanov, D., Dolgui, A., & Namdar, J. (2024) · International Journal of Production Research · doi:10.1080/00207543.2024.2309309 · Cited by 441
AI literacy and its implications for prompt engineering strategies
Knoth, N., Tolzin, A., Janson, A., & Leimeister, J. M. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100225 · Cited by 368
“Dell ’ Acqua et al. (2023) showed the positive effects on consultant work outcomes, thus, this technology will be adopted industry-wide and we need to train our students in prompting LLMs.”
BackgroundThe Crowdless Future? Generative AI and Creative Problem-Solving
Boussioux, L., Lane, J. N., Zhang, M., Jacimovic, V., & Lakhani, K. R. (2024) · Organization Science · doi:10.1287/orsc.2023.18430 · Cited by 329
Self-citationLarge Legal Fictions: Profiling Legal Hallucinations in Large Language Models
Dahl, M., Magesh, V., Suzgun, M., & Ho, D. E. (2024) · Journal of Legal Analysis · doi:10.1093/jla/laae003 · Cited by 559
Levels of AGI for Operationalizing Progress on the Path to AGI
Morris, M. R., Sohl-Dickstein, J., Fiedel, N., Warkentin, T., Dafoe, A., Faust, A., Farabet, C., & Legg, S. (2023) · arXiv · doi:10.48550/arxiv.2311.02462 · Cited by 274
Generative AI without guardrails can harm learning: Evidence from high school mathematics
Bastani, H., Bastani, O., Sungu, A., Ge, H., Kabakcı, Ö., & Mariman, R. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2422633122 · Cited by 309
A guide to artificial intelligence for cancer researchers
Perez-Lopez, R., Ghaffari Laleh, N., Mahmood, F., & Kather, J. N. (2024) · Nature Reviews Cancer · doi:10.1038/s41568-024-00694-7 · Cited by 211
“Similarly, a recent study from the Boston Consulting Group concluded that AI made management consultants significantly more productive by using large language models in routine tasks that involve the generation of text 170 .”
The Rapid Adoption of Generative AI
Bick, A., Blandin, A., & Deming, D. (2024) · NBER Working Paper · doi:10.3386/w32966 · Cited by 200
The transparency dilemma: How AI disclosure erodes trust
Schilke, O., & Reimann, M. (2025) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2025.104405 · Cited by 201
Artificial Intelligence and the Transformation of Higher Education Institutions: A Systems Approach
Katsamakas, E., Pavlov, O. V., & Saklad, R. (2024) · Sustainability · doi:10.3390/su16146118 · Cited by 195
The power of generative marketing: Can generative AI create superhuman visual marketing content?
Hartmann, J., Exner, Y., & Domdey, S. (2025) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2024.09.002 · Cited by 229
AI and Its Impact on Creativity and Diversity: An Empirical Study of LLM-Generated Product Ideas
Terwiesch, C., Meincke, L., Girotra, K., Mollick, E. R., Nave, G., & Ulrich, K. T. (2023) · doi:10.2139/ssrn.4526071 · Cited by 174
Self-citationGood models borrow, great models steal: intellectual property rights and generative AI
Chesterman, S. (2025) · Policy and Society · doi:10.1093/polsoc/puae006 · Cited by 156
Hallucination‐Free? Assessing the Reliability of Leading AI Legal Research Tools
Magesh, V., Surani, F., Dahl, M., Suzgun, M., Manning, C. D., & Ho, D. E. (2025) · Journal of Empirical Legal Studies · doi:10.1111/jels.12413 · Cited by 182
Przegalińska, A., Triantoro, T., Kovbasiuk, A., Ciechanowski, L., Freeman, R. B., & Sowa, K. (2024) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2024.102853 · Cited by 226
McGuire, J., De Cremer, D., & Van de Cruys, T. (2024) · Scientific Reports · doi:10.1038/s41598-024-69423-2 · Cited by 150
“Alternatively, when people are placed in the role of a co-creator, this is similar to a Cyborg archetype of human–AI collaboration, where people work in tandem with AI rather than divide the labour between the two 27 .”
BackgroundThe Uneven Impact of Generative AI on Entrepreneurial PerformancePreprint
Otis, N. G., Clarke, R. P., Delecourt, S., Holtz, D., & Koning, R. M. (2023) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/hdjpk · Cited by 206
Carobene, A., Padoan, A., Cabitza, F., Banfi, G., & Plebani, M. (2023) · Clinical Chemistry and Laboratory Medicine (CCLM) · doi:10.1515/cclm-2023-1136 · Cited by 219
Artificial intelligence as a tool for creativity
Ivčević, Z., & Grandinetti, M. (2024) · Journal of Creativity · doi:10.1016/j.yjoc.2024.100079 · Cited by 224
A Design Space for Intelligent and Interactive Writing Assistants
Lee, M., Gero, K. I., Chung, J. J. Y., Shum, S. B., Raheja, V., Shen, H., Venugopalan, S., Wambsganss, T., Zhou, D., Alghamdi, E. A., et al. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642697 · Cited by 136
Knoth, N., Mirsch, M., Laupichler, M. C., Pinski, M., Buchholtz, N. F., Bata, K., & Schultz, B. (2024) · Computers and Education Open · doi:10.1016/j.caeo.2024.100177 · Cited by 183
“[31, 43,54,115].”
“How knowledge workers think generative AI will (not) transform their industries,”
Woodruff, A., Shelby, R., Kelley, P. G., Rousso-Schindler, S., Smith-Loud, J., & Wilcox, L. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642700 · Cited by 105
The unequal adoption of ChatGPT exacerbates existing inequalities among workers
Humlum, A., & Vestergaard, E. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2414972121 · Cited by 107
Eulerich, M., Sanatizadeh, A., Vakilzadeh, H., & Wood, D. A. (2024) · Review of Accounting Studies · doi:10.1007/s11142-024-09833-9 · Cited by 195
AI hype as a cyber security risk: the moral responsibility of implementing generative AI in business
Humphreys, D., Koay, A., Desmond, D., & Mealy, E. (2024) · AI and Ethics · doi:10.1007/s43681-024-00443-4 · Cited by 147
A scoping review of ChatGPT research in accounting and finance
Dong, M., Stratopoulos, T. C., & Wang, V. X. (2024) · International Journal of Accounting Information Systems · doi:10.1016/j.accinf.2024.100715 · Cited by 239
Human control of AI systems: from supervision to teaming
Tsamados, A., Floridi, L., & Taddeo, M. (2025) · AI and Ethics · doi:10.1007/s43681-024-00489-4 · Cited by 92
“From a socio-technical or operational level, the capabilities of foundation models-based AI rest heavily on human operators’ ability to prompt, verify, and correct outputs [55].”
Empowering SMEs “Harnessing the Potential of Gen AI for Resilience and Competitiveness”
Carayannis, E. G., Dumitrescu, R., Falkowski, T., & Zotas, N. R. (2024) · IEEE Transactions on Engineering Management · doi:10.1109/tem.2024.3456820 · Cited by 123
“In their study “Navigating the Jagged Technological Frontier,” Dell’Acqua et al. [17] have shown that it is not intuitively possible to know where the capabilities of LLMs lie compared to a person with a known skill set.”
BackgroundIronies of Generative AI: Understanding and Mitigating Productivity Loss in Human-AI Interaction
Simkute, A., Tankelevitch, L., Kewenig, V., Scott, A. E., Sellen, A., & Rintel, S. (2024) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2024.2405782 · Cited by 89
“Over-reliance has been shown to lead to decreased performance; for example, management consultants showed overall poorer performance when they blindly adopted AI-generated outputs (Dell’Acqua et al., 2023).”
InfluentialThe consequences of generative AI for online knowledge communities
Burtch, G., Lee, D., & Chen, Z. (2024) · Scientific Reports · doi:10.1038/s41598-024-61221-0 · Cited by 83
Visual cognition in multimodal large language models
Schulze Buschoff, L. M., Akata, E., Bethge, M., & Schulz, E. (2025) · Nature Machine Intelligence · doi:10.1038/s42256-024-00963-y · Cited by 83
How Artificial Intelligence Constrains the Human Experience
Valenzuela, A., Puntoni, S., Hoffman, D., Castelo, N., De Freitas, J., Dietvorst, B., Hildebrand, C., Huh, Y. E., Meyer, R., Sweeney, M. E., et al. (2024) · Journal of the Association for Consumer Research · doi:10.1086/730709 · Cited by 81
Cui, Z., Demirer, M., Jaffe, S., Musolff, L., Peng, S., & Salz, T. (2024) · doi:10.2139/ssrn.4945566 · Cited by 73
Building machines that learn and think with people
Collins, K. M., Sucholutsky, I., Bhatt, U., Chandra, K., Wong, L., Lee, M., Zhang, C. E., Zhi‐Xuan, T., Ho, M. K., Mansinghka, V. K., et al. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-01991-9 · Cited by 216
“Herein, we also highlight the breadth of thought partners for media beyond language, though the framework does nicely suggest a variety of natural extensions, such as integration into tools for creative writing 72–77 .”
Wu, S., Liu, Y., Ruan, M., Chen, S., & Xie, X. (2025) · Scientific Reports · doi:10.1038/s41598-025-98385-2 · Cited by 166
Financial Statement Analysis with Large Language ModelsPreprint
Kim, A. G., Muhn, M., & Nikolaev, V. V. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4835311 · Cited by 177
Instructors as Innovators: a Future-focused Approach to New AI Learning Opportunities, With PromptsPreprint
Mollick, E., & Mollick, L. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4802463 · Cited by 165
Self-citationCollaborative Intelligence: A Scoping Review Of Current Applications
Schleiger, E., Mason, C., Naughtin, C. K., Reeson, A. F., & Paris, C. L. (2024) · Applied Artificial Intelligence · doi:10.1080/08839514.2024.2327890 · Cited by 114
“Experimental research has already demonstrated that this complementarity improves outcomes ranging from productivity, quality and customer satisfaction (Brynjolfsson, Li, and Raymond 2023; Dell’acqua et al. 2023; Noy and Zhang 2023).”
Obschonka, M., Grégoire, D. A., Nikolaev, B., Ooms, F., Lévesque, M., Pollack, J. M., & Behrend, T. S. (2024) · Entrepreneurship Theory and Practice · doi:10.1177/10422587241304676 · Cited by 84
“In what areas of the uncertain entrepreneurial process, and for what specific tasks, can AI (predictive and/or generative) lead to higher-quality outputs and higher productivity (Dell’Acqua et al., 2023; Inie et al., 2023)?”
Towards an AI-Enhanced Cyber Threat Intelligence Processing Pipeline
Alevizos, L., & Dekker, M. (2024) · Electronics · doi:10.3390/electronics13112021 · Cited by 104
Cardon, P. W., Fleischmann, C., Logemann, M., Heidewald, J., Aritz, J., & Swartz, S. (2023) · Business and Professional Communication Quarterly · doi:10.1177/23294906231208166 · Cited by 70
“For example, Dell’Acqua et al. (2023) examined how 758 consultants engaged in a product development exercise that culminated in writing a recommendation to their manager.”
BackgroundArtificial intelligence, workers, and future of work skills
Bankins, S., Hu, X., & Yuan, Y. E. (2024) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2024.101828 · Cited by 110
Ulfsnes, R., Moe, N. B., Stray, V., & Skarpen, M. (2024) · Generative AI for Effective Software Development · doi:10.1007/978-3-031-55642-5_10 · Cited by 62
Sidra, S., & Mason, C. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2543997 · Cited by 93
“Consequently, we developed five self-report items to assess the range of benefits that have been documented for collaborative AI tools (Brynjolfsson et al., 2023; Choi & Schwarcz, 2025; Dell ’ Acqua et al., 2023; Noy & Zhang, 2023; Zhang et al., 2022).”
Kim, K. T., & Sohn, Y. W. (2024) · Systems · doi:10.3390/systems12110460 · Cited by 122
“AI-driven AI-driven personalized coaching can help managers better understand employees’ psychological needs and respond more effectively, facilitating a systemized approach to improving psychological safety [41].”
How Does AI Improve Human Decision-Making? Evidence from the AI-Powered Go Program
Choi, S., Kang, H., Kim, N., & Kim, J. (2021) · Strategic Management Journal · doi:10.1002/smj.3694 · Cited by 102
Chalmers, D. M., Hunt, R. A., Pachidi, S., Potočnik, K., & Townsend, D. M. (2026) · Journal of Management Studies · doi:10.1111/joms.70063 · Cited by 91
The ethics of personalised digital duplicates: a minimally viable permissibility principle
Danaher, J., & Nyholm, S. R. (2024) · AI and Ethics · doi:10.1007/s43681-024-00513-7 · Cited by 63
AI-empowered scale development: Testing the potential of ChatGPT
Hoffmann, S., Lasarov, W., & Dwivedi, Y. K. (2024) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2024.123488 · Cited by 57
Heine, S., & König, J. (2025) · European Journal of Teacher Education · doi:10.1080/02619768.2025.2540791 · Cited by 66
Delegation to artificial intelligence can increase dishonest behaviour
Köbis, N., Rahwan, Z., Rilla, R., Supriyatno, B. I., Bersch, C., Ajaj, T., Bonnefon, J., & Rahwan, I. (2025) · Nature · doi:10.1038/s41586-025-09505-x · Cited by 126
“Machine delegation promises to increase productivity 14,15 and decision quality 16–18 .”
Leonardi, P. M. (2025) · Information and Organization · doi:10.1016/j.infoandorg.2025.100582 · Cited by 47
Nyberg, A. J., Schleicher, D. J., Bell, B. S., Boon, C., Cappelli, P., Collings, D. G., Dalle Molle, J. E., Feuerriegel, S., Gerhart, B., Jeong, Y., et al. (2025) · Journal of Management · doi:10.1177/01492063251325188 · Cited by 47
“Indeed, Dell’Acqua and colleagues’ (2023) research on realistic, complex, and knowledge-intensive tasks among business consultants confirmed the differential performance benefits of GenAI: those below the average performance threshold increased performance by 43% and those above it increased by 17%.”
Passmore, J., Olafsson, B., & Tee, D. (2025) · Journal of Work-Applied Management · doi:10.1108/jwam-11-2024-0164 · Cited by 76
Open Science at the generative AI turn: An exploratory analysis of challenges and opportunities
Hosseini, M., Horbach, S. P. J. M., Holmes, K., & Ross-Hellauer, T. (2025) · Quantitative Science Studies · doi:10.1162/qss_a_00337 · Cited by 40
“GenAI is shown to be prone to hallucination, bias, and variability in outputs, so much so that the notion of a “ jagged technological frontier ” is used to stress that their performance on tasks of similar perceived difficulty can vary widely (Dell ’ Acqua, McFowland et al., 2023).”
de Fine Licht, K. (2024) · Philosophy & Technology · doi:10.1007/s13347-024-00799-9 · Cited by 40
“There is also research showing that generative AI tools of today can indeed help even experts in some areas while not in others (Dell’Acqua et al., 2023).”
Generative AI Meets Open-Ended Survey Responses: Research Participant Use of AI and Homogenization
Zhang, S., Xu, J., & Alvero, A. (2025) · Sociological Methods & Research · doi:10.1177/00491241251327130 · Cited by 101
The Rapid Adoption of Generative AI
Bick, A., Blandin, A., & Deming, D. J. (2026) · Management Science · doi:10.1287/mnsc.2025.02523 · Cited by 48
The Crowdless Future? Generative AI and Creative Problem Solving
Boussioux, L., N. Lane, J., Zhang, M., Jacimovic, V., & Lakhani, K. R. (2023) · doi:10.2139/ssrn.4533642 · Cited by 343
Self-citationThe use of LLMs to annotate data in management research: Foundational guidelines and warnings
Carlson, N. A., & Burbano, V. (2025) · Strategic Management Journal · doi:10.1002/smj.70023 · Cited by 86
Rafner, J., Zana, B., Bang Hansen, I., Ceh, S., Sherson, J., Benedek, M., & Lebuda, I. (2025) · Creativity Research Journal · doi:10.1080/10400419.2025.2587803 · Cited by 38
Tools or Fools: Are We Educating Managers or Creating Tool-Dependent Robots?
Hyde, S. J., Busby, A., & Bonner, R. L. (2024) · Organizational Behavior Teaching Review · doi:10.1177/10525629241230357 · Cited by 89
“Our concern aligns with findings from Dell’Acqua et al. (2023), which identified a “jagged technological frontier” in AI capabilities.”
A comparison of human, GPT-3.5, and GPT-4 performance in a university-level coding course
Yeadon, W., Peach, A., & Testrow, C. P. (2024) · Scientific Reports · doi:10.1038/s41598-024-73634-y · Cited by 47
“Given that prior studies (e.g. Ghassemi et al. [17]) have shown how user involvement can significantly vary the performance enhancements achieved with AI, this introduces an additional layer of complexity to any analysis.”
ResultHuman-AI joint task performance: Learning from uncertainty in autonomous driving systems
Constantinides, P., Monteiro, E., & Mathiassen, L. (2024) · Information and Organization · doi:10.1016/j.infoandorg.2024.100502 · Cited by 44
Generative AI and K-12 Education: An MIT Perspective
Klopfer, E. D., Reich, J., Abelson, H., & Breazeal, C. (2024) · doi:10.21428/e4baedd9.81164b06 · Cited by 36
GPT-4 in a Cancer Center — Institute-Wide Deployment Challenges and Lessons Learned
Umeton, R., Kwok, A., Maurya, R., Leco, D., Lenane, N., Willcox, J., Abel, G. A., Tolikas, M., & Johnson, J. M. (2024) · NEJM AI · doi:10.1056/aics2300191 · Cited by 50
Block, J., & Kuckertz, A. (2024) · Management Review Quarterly · doi:10.1007/s11301-024-00471-8 · Cited by 38
“AI users increasingly function as “cyborgs” (Dell’Acqua et al. 2023), integrating their contributions with those of AI.”
Untangling Critical Interaction with AI in Students’ Written Assessment
Shibani, A., Knight, S., Kitto, K., Karunanayake, A., & Buckingham Shum, S. (2024) · Extended Abstracts of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613905.3651083 · Cited by 35
Perspectives on the impact of generative AI on early‐childhood development and education
Kanders, K., Stupple‐Harris, L., Smith, L. M., & Gibson, J. L. (2024) · Infant and Child Development · doi:10.1002/icd.2514 · Cited by 53
Emergent AI-assisted discourse: a case study of a second language writer authoring with ChatGPT
Jacob, S. R., Tate, T. P., & Warschauer, M. (2024) · Journal of China Computer-Assisted Language Learning · doi:10.1515/jccall-2024-0011 · Cited by 98
Quinn, M., & Gutt, D. (2025) · Journal of Management Information Systems · doi:10.1080/07421222.2025.2487313 · Cited by 61
A Scoping Review of ChatGPT Research in Accounting and FinancePreprint
Dong, M., Stratopoulos, T. C., & Wang, V. X. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4680203 · Cited by 35
Quaquebeke, N. V., Tonidandel, S., & Banks, G. C. (2025) · The Leadership Quarterly · doi:10.1016/j.leaqua.2025.101895 · Cited by 57
AI in Dental Radiology—Improving the Efficiency of Reporting With ChatGPT: Comparative Study
Stephan, D., Bertsch, A., Burwinkel, M., Vinayahalingam, S., Al‐Nawas, B., Kämmerer, P. W., & Thiem, D. G. E. (2024) · Journal of Medical Internet Research · doi:10.2196/60684 · Cited by 46
“This aligns with study results proving GPT-4 to enhance productivity and quality in various tasks beyond medical use, benefiting consultants and customer support agents across all skill levels [45,46].”
The power of generative marketing: Can generative AI create superhuman visual marketing content?Preprint
Hartmann, J., Exner, Y., & Domdey, S. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4597899 · Cited by 34
Still Waters, Rapid Currents: Early Labor Market Transformation under Generative AI
Humlum, A., & Vestergaard, E. (2025) · doi:10.3386/w33777 · Cited by 68
Ashkinaze, J., Mendelsohn, J., Qiwei, L., Budak, C., & Gilbert, E. (2025) · Proceedings of the ACM Collective Intelligence Conference · doi:10.1145/3715928.3737481 · Cited by 33
Canagasuriam, D., & Lukacik, E. (2024) · International Journal of Selection and Assessment · doi:10.1111/ijsa.12491 · Cited by 48
Wong, L. P. W. (2024) · Merits · doi:10.3390/merits4040027 · Cited by 64
“In the empirical workplace, a Harvard Business School study with Boston Consulting Group [133] examined AI’s impact on management consultants’ performance.”
Me vs. the machine? Subjective evaluations of human- and AI-generated advice
Osborne, M. R., & Bailey, E. R. (2025) · Scientific Reports · doi:10.1038/s41598-025-86623-6 · Cited by 30
ChatGPT decreases idea diversity in brainstorming
Meincke, L., Nave, G., & Terwiesch, C. (2025) · Nature Human Behaviour · doi:10.1038/s41562-025-02173-x · Cited by 65
“Diverse idea sets exhibit a higher percentage of unique idea concepts, as this implies that ideas occupy more distant positions in the semantic space 9 .”
Chen, Y., Wang, Y., Wüstenberg, T., Kizilcec, R. F., Fan, Y., Li, Y., Lu, B., Yuan, M., Zhang, J., Zhang, Z., et al. (2025) · Trials · doi:10.1186/s13063-025-08950-3 · Cited by 79
“…such as OpenAI’s ChatGPT, has been shown to enhance productivity across a wide range of cognitive tasks, including professional writing tasks among white-collar workers [1], customer support services [2], knowledge-intensive consulting [3], creative story-writ-ing [4], and creative ideation [5].”
Will Artificial Intelligence Get in the Way of Achieving Gender Equality?
Carvajal, D., Franco, C., & Isaksson, S. (2024) · doi:10.2139/ssrn.4759218 · Cited by 32
Filippucci, F., Gál, P., Jona‐Lasinio, C., Leandro, Á., & Nicoletti, G. (2024) · OECD artificial intelligence papers · doi:10.1787/8d900037-en · Cited by 270
Tang, M., Hofreiter, S., Werner, C. H., Zielińska, A., & Karwowski, M. (2025) · The Journal of Creative Behavior · doi:10.1002/jocb.1519 · Cited by 32
Who Says Artificial Intelligence Is Stealing Our Jobs?
Dahlin, E. C. (2024) · Socius Sociological Research for a Dynamic World · doi:10.1177/23780231241259672 · Cited by 54
“Research by Dell’Acqua et al. (2023) offers additional insight.”
Teng, D., Ye, C., & Martinez, V. (2025) · Technovation · doi:10.1016/j.technovation.2025.103191 · Cited by 55
The Human‐ GenAI Value Loop in Human‐Centered Innovation: Beyond the Magical Narrative
Grange, C., Demazure, T., Ringeval, M., Bourdeau, S., & Martineau, C. (2025) · Information Systems Journal · doi:10.1111/isj.12602 · Cited by 68
“Another study conducted in a more complex knowledge work scenario showed a comparable outcome, with gains exceeding 40% in output quality and a 25% improvement in time efficiency (Dell'Acqua et al. 2023).”
Yoo, K., Haenlein, M., & Hewett, K. (2025) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-025-01097-2 · Cited by 35
“Despite LMMs’ creative potential, there are concerns that, over time, ideas generated by LMMs could become repetitive or similar since these models are trained on the same data, reducing overall creative diversity in scholarly research (Dell’Acqua et al., 2023; Doshi & Hauser, 2024).”
Artificial Intelligence as an Organizing Capability Arising from Human‐Algorithm Relations
Stelmaszak, M., Joshi, M. P., & Constantiou, I. (2025) · Journal of Management Studies · doi:10.1111/joms.70003 · Cited by 58
Human + AI in accounting: Early evidence from the field
Choi, J. H., & Xie, C. L. (2026) · Journal of Accounting Research · doi:10.1111/1475-679x.70052 · Cited by 30
High hopes, hard falls: consumer expectations and reactions to AI-human collaboration in advertising
Ryoo, Y., Bakpayev, M., Jeon, Y. A., Kim, K. K., & Yoon, S. (2025) · International Journal of Advertising · doi:10.1080/02650487.2025.2458996 · Cited by 40
Temper, M., Tjoa, S., & David, L. (2025) · Frontiers in Education · doi:10.3389/feduc.2025.1505370 · Cited by 57
Effects of LLM-based Search on Decision Making: Speed, Accuracy, and Overreliance
Spatharioti, S. E., Rothschild, D., Goldstein, D. G., & Hofman, J. M. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714082 · Cited by 36
Human bias in AI models? Anchoring effects and mitigation strategies in large language models
Nguyen, J. K. (2024) · Journal of Behavioral and Experimental Finance · doi:10.1016/j.jbef.2024.100971 · Cited by 33
How do judges use large language models? Evidence from Shenzhen
Liu, J. Z., & Li, X. (2024) · The Journal of Legal Analysis · doi:10.1093/jla/laae009 · Cited by 54
Assessing political bias and value misalignment in generative artificial intelligence
Motoki, F. Y. S., Pinho Neto, V., & Rangel, V. (2025) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2025.106904 · Cited by 32
Karjus, A. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-04503-w · Cited by 120
“While the focus here is academic, the same approach could be used in analytics in business, marketing, media monitoring, communication management, etc. (Dell ’ Acqua et al. 2023; Mets et al. 2024).”
A hybrid framework for creating artificial intelligence-augmented systematic literature reviews
Malik, F. S., & Terzidis, O. (2026) · Management Review Quarterly · doi:10.1007/s11301-025-00522-8 · Cited by 28
Metadata
- Authors
- Dell'Acqua, F., McFowland III, E., Mollick, E. R., Lifshitz-Assaf, H., Kellogg, K., Rajendran, S., Krayer, L., Candelon, F., & Lakhani, K. R.
- Affiliations
- University of Pennsylvania (US)
- Massachusetts Institute of Technology (US)
- Boston Consulting Group (United States) (US)
- Harvard University (US)
- Venue
- SSRN Electronic Journal
- Publisher
- Elsevier BV
- Published
- 2023
- ISSN
- 1556-5068 (ISSN-L)
- OpenAlex
- W4386827556
- Semantic Scholar
- 409dc9f1801947f85c53231cba346f0e314cb208
- Cited by
- 794
- References
- 67
- Citations by year
- 2026: 240 · 2025: 305 · 2024: 230 · 2023: 18
- Type
- posted content
- Language
- en
- Open access
- green
- doi.org
- Locations
- SSRN Electronic Journal (acceptedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Social Sciences › Decision Sciences › Management Science and Operations Research › Impact of AI and Big Data on Business and Society
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › AI and HR Technologies
- Keywords
- artificial intelligence, knowledge workers, GPT-4, prompt engineering, human-AI collaboration, task performance, solution quality, knowledge-intensive work
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.