Training with AI: Evidence from chess computers
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
We suggest that AI can help decision‐makers learn; specifically, that it can help them learn strategic interactions by serving as artificial training partners and thus help them to overcome a bottleneck of scarce human training partners. We present evidence from chess computers, the first widespread incarnation of AI. Leveraging the staggered diffusion of chess computers, we find that they did indeed help chess players improve by serving as a substitute for scarce human training partners. We also illustrate that chess computers were not a perfect substitute, as players training with them were not exposed to and thus did not learn to exploit idiosyncratic (“human”) mistakes. We discuss implications for research on learning, on AI in management and strategy, and on competitive advantage.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Chase, W. G., & Simon, H. A. (1973) · Cognitive Psychology · doi:10.1016/0010-0285(73)90004-2 · Cited by 4,479 · cited 1×
“Herbert Simon, a pioneer of AI and organization theory, described chess as the fruit fly of AI — that is, a simple system that allows the initial exploration of complex phenomena (Chase & Simon, 1973), as the fruit fly often does in the study of human genetics.”
Knowledge Transfer: A Basis for Competitive Advantage in Firms
Argote, L., & Ingram, P. (2000) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.2000.2893 · Cited by 4,164 · cited 1×
“An actor's network may thus be a source of competitive advantage or a bottleneck (Argote & Ingram, 2000).”
BackgroundHuman trust in artificial intelligence: Review of empirical research
Glikson, E., & Woolley, A. W. (2020) · Academy of Management Annals · doi:10.5465/annals.2018.0057 · Cited by 2,921 · cited 1×
“We therefore expect training with AI to be most relevant where human involvement remains socially desired (Glikson & Woolley, 2020), legally required (Tambe et al., 2019), or simply unavoidable (Brynjolfsson & McAfee, 2012).”
BackgroundThe 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring
BLOOM, B. S. (1984) · Educational Researcher · doi:10.3102/0013189x013006004 · Cited by 2,734 · cited 1×
“This is because responsive training is usually bilateral (Bloom, 1984); that is, training with a human partner is hard to scale.”
BackgroundAlgorithms at Work: The New Contested Terrain of Control
Kellogg, K. C., Valentine, M. A., & Christin, A. (2020) · Academy of Management Annals · doi:10.5465/annals.2018.0174 · Cited by 2,732
Managerial cognitive capabilities and the microfoundations of dynamic capabilities
Helfat, C. E., & Peteraf, M. A. (2015) · Strategic Management Journal · doi:10.1002/smj.2247 · Cited by 2,056 · cited 1×
“It may, for example, increase actors' ability to reason and strategic intelligence (Helfat & Peteraf, 2015; Kang & Kim, 2023; Levine et al., 2017).”
BackgroundArtificial Intelligence in Human Resources Management: Challenges and a Path Forward
Tambe, P., Cappelli, P., & Yakubovich, V. (2019) · California Management Review · doi:10.1177/0008125619867910 · Cited by 1,609
What can machine learning do? Workforce implications
Brynjolfsson, E., & Mitchell, T. (2017) · Science · doi:10.1126/science.aap8062 · Cited by 1,131 · cited 3×
“While there has been rich debate on the implications of AI's current state and its progress (Agrawal et al., 2019; Brynjolfsson & Mitchell, 2017; Felten et al., 2021), there has been little field data illustrating that progress.”
BackgroundThe Science of Training and Development in Organizations: What Matters in Practice
Salas, E., Tannenbaum, S. I., Kraiger, K., & Smith-Jentsch, K. A. (2012) · Psychological Science in the Public Interest · doi:10.1177/1529100612436661 · Cited by 1,104
Balancing Search and Stability: Interdependencies Among Elements of Organizational Design
Rivkin, J. W., & Siggelkow, N. (2003) · Management Science · doi:10.1287/mnsc.49.3.290.12740 · Cited by 900 · cited 1×
“Also, the effect of any action is contingent on the actions taken by other actors — making learning harder (Piezunka et al., 2022; Rivkin & Siggelkow, 2003).”
BackgroundLambrecht, A., & Tucker, C. (2019) · Management Science · doi:10.1287/mnsc.2018.3093 · Cited by 854 · cited 1×
“Second, if the underlying algorithms are based on flawed data and/or code, the AI may be prone to systemic decision-making biases (Choudhury et al., 2020; Cowgill, 2019; Lambrecht & Tucker, 2019).”
BackgroundHow firms navigate cooperation and competition in nascent ecosystems
Hannah, D. P., & Eisenhardt, K. M. (2018) · Strategic Management Journal · doi:10.1002/smj.2750 · Cited by 692
Lebovitz, S., Lifshitz-Assaf, H., & Levina, N. (2022) · Organization Science · doi:10.1287/orsc.2021.1549 · Cited by 632 · cited 1×
“…of ideas (Bell et al., 2023; Christensen et al., 2017), value creation and value capture (Iansiti & Lakhani, 2020), the organization of labor (Kane et al., 2021; Kellogg et al., 2020), decision-making (Glaeser et al., 2021; Lebovitz et al., 2022), or the provision of feedback (Tong et al., 2021);).”
BackgroundFelten, E., Raj, M., & Seamans, R. (2021) · Strategic Management Journal · doi:10.1002/smj.3286 · Cited by 574 · cited 3×
“First, AI has generally been associated with complex tasks, such as translation, hiring, and medical diagnosis (Agrawal et al., 2018; Brynjolfsson et al., 2019; Felten et al., 2021).”
BackgroundManeuvering in Poor Visibility: How Firms Play the Ecosystem Game when Uncertainty is High
Dattée, B., Alexy, O., & Autio, E. (2018) · Academy of Management Journal · doi:10.5465/amj.2015.0869 · Cited by 567
Tong, S., Jia, N., Luo, X., & Fang, Z. (2021) · Strategic Management Journal · doi:10.1002/smj.3322 · Cited by 531 · cited 1×
“…of ideas (Bell et al., 2023; Christensen et al., 2017), value creation and value capture (Iansiti & Lakhani, 2020), the organization of labor (Kane et al., 2021; Kellogg et al., 2020), decision-making (Glaeser et al., 2021; Lebovitz et al., 2022), or the provision of feedback (Tong et al., 2021);).”
BackgroundKapoor, R., & Agarwal, S. (2017) · Organization Science · doi:10.1287/orsc.2017.1122 · Cited by 453
Artificial Intelligence as Augmenting Automation: Implications for Employment
Tschang, F. T., & Almirall, E. (2021) · Academy of Management Perspectives · doi:10.5465/amp.2019.0062 · Cited by 409
Does Machine Translation Affect International Trade? Evidence from a Large Digital Platform
Brynjolfsson, E., Hui, X., & Liu, M. (2018) · doi:10.3386/w24917 · Cited by 408
Does Machine Translation Affect International Trade? Evidence from a Large Digital Platform
Brynjolfsson, E., Hui, X., & Liu, M. (2019) · Management Science · doi:10.1287/mnsc.2019.3388 · Cited by 408
Machine learning and human capital complementarities: Experimental evidence on bias mitigation
Choudhury, P., Starr, E., & Agarwal, R. (2020) · Strategic Management Journal · doi:10.1002/smj.3152 · Cited by 293
Shadow Learning: Building Robotic Surgical Skill When Approved Means Fail
Beane, M. (2019) · Administrative Science Quarterly · doi:10.1177/0001839217751692 · Cited by 286
New Modes of Learning Enabled by AI Chatbots: Three Methods and Assignments
Mollick, E. R., & Mollick, L. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4300783 · Cited by 176 · cited 2×
“Our study suggests that it can also help decision-makers learn — a so-far mostly neglected implication (Mollick & Mollick, 2022).”
BackgroundSuperhuman artificial intelligence can improve human decision-making by increasing novelty
Shin, M., Kim, J., van Opheusden, B., & Griffiths, T. L. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2214840120 · Cited by 106 · cited 2×
“Actors learn from competitors (Posen et al., 2023; Ross & Sharapov, 2015), peers (Hallen et al., 2020; Tortoriello et al., 2012), teammates (Kim et al., 2023), partners (Ahuja, 2000; Powell et al., 1996), and others.”
BackgroundMethodHow Does AI Improve Human Decision-Making? Evidence from the AI-Powered Go Program
Choi, S., Kim, N., Kim, J., & Kang, H. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3893835 · Cited by 30
Cited by
Dell'Acqua, F., McFowland III, E., Mollick, E. R., Lifshitz-Assaf, H., Kellogg, K., Rajendran, S., Krayer, L., Candelon, F., & Lakhani, K. R. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4573321 · Cited by 794
Dell’Acqua, F., McFowland, E., Mollick, E., Lifshitz, H., Kellogg, K. C., Rajendran, S., Krayer, L., Candelon, F., & Lakhani, K. R. (2026) · Organization Science · doi:10.1287/orsc.2025.21838 · Cited by 1,189
Are Large Language Models a Threat to Digital Public Goods? Evidence from Activity on Stack Overflow
del Rio-Chanona, M., Laurentsyeva, N., & Wachs, J. (2023) · arXiv · doi:10.48550/arxiv.2307.07367 · Cited by 62
Human-centered artificial intelligence: a field experiment
Krakowski, S., Haftor, D., Luger, J., Pashkevich, N., & Raisch, S. (2026) · Management Science · doi:10.1287/mnsc.2022.03849 · Cited by 53
“We also contribute to the understanding of learning effects in human-AI interaction (Gaessler and Piezunka 2023, Te’eni et al. 2023, Raisch and Fomina 2025), demonstrating a direct relationship between increased AI utilization (D3 versus D2) and subsequent performance gains.”
How Does AI Improve Human Decision-Making? Evidence from the AI-Powered Go Program
Choi, S., Kim, N., Kim, J., & Kang, H. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3893835 · Cited by 30
Metadata
- Authors
- Gaessler, F., & Piezunka, H.
- Venue
- Strategic Management Journal
- Publisher
- Wiley
- Published
- 2023-05-22
- Volume
- 44
- Issue
- 11
- Pages
- 2724-2750
- ISSN
- 0143-2095 (ISSN-L)
- 1097-0266
- OpenAlex
- W4378087384
- Cited by
- 97
- References
- 25
- FWCI
- 8.43
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.