AI Assistance Reduces Persistence and Hurts Independent Performance
Open accessAbstract
People often optimize for long-term goals in collaboration: A mentor or companion doesn't just answer questions, but also scaffolds learning, tracks progress, and prioritizes the other person's growth over immediate results. In contrast, current AI systems are fundamentally short-sighted collaborators -- optimized for providing instant and complete responses, without ever saying no (unless for safety reasons). What are the consequences of this dynamic? Here, through a series of randomized controlled trials on human-AI interactions (N=1,222), we provide causal evidence for two key consequences of AI assistance: reduced persistence and impairment of unassisted performance. Across a variety of tasks, including mathematical reasoning and reading comprehension, we find that although AI assistance improves performance in the short-term, people perform significantly worse without AI and are more likely to give up. These findings are particularly concerning because persistence is foundational to skill acquisition and is one of the strongest predictors of long-term learning. We posit that persistence is reduced because AI conditions people to expect immediate answers, thereby denying them the experience of working through challenges on their own. These results add to the growing literature on cognitive offloading and AI-induced deskilling, and suggest the need for AI model development to prioritize scaffolding long-term competence alongside immediate task completion.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The divergence between assisted output and unaided learning found for automation users recurs across settings.
“The divergence between assisted output and unaided learning that we find for automation users recurs across settings.”
From Experimental Evidence on the Learning Impact of Generative AI (2026) · cites this paper as Liu et al., 2026
Four studies compare learners by their observed use of the same tool.
“We also identified four studies that compare learners by their observed use of the same tool, as we do (Liu et al., 2026; Shen and Tamkin, 2026; Franco et al., 2026; Strömberg et al., 2026).”
From Experimental Evidence on the Learning Impact of Generative AI (2026) · cites this paper as Liu et al., 2026
Comparisons by observed use of the same tool point the same way as the paper's comparisons.
“Comparisons by observed use of the same tool point the same way as ours.”
From Experimental Evidence on the Learning Impact of Generative AI (2026) · cites this paper as Liu et al., 2026
Participants who ask for hints score 0.29 SD higher on unaided problems than those who ask for answers (Liu et al., 2026).
“Participants who ask for hints score 0.29 SD higher on unaided problems than those who ask for answers (Liu et al., 2026)”
From Experimental Evidence on the Learning Impact of Generative AI (2026) · cites this paper as Liu et al., 2026
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Buffel, C., van Aalst, J., Bangels, A., Toelen, J., Allegaert, K., Verschueren, S., & Stichele, G. V. (2018) · doi:10.2196/preprints.12431 · Cited by 5,871
A hot/cool-system analysis of delay of gratification: dynamics of willpower
Metcalfe, J., & Mischel, W. (1999) · Psychological Review · doi:10.1037/0033-295x.106.1.3 · Cited by 2,931 · cited 1× · see citing works
“…foundational to effective learning, and is among the strongest predictors of long-term academic achievement, workforce adaptability, and resilience (Metcalfe & Mischel, 1999; Duckworth et al., 2007; Maddux, 2009; Metcalfe, 2009; Andersson & Bergman, 2011; Bjork et al., 2011; Kapur, 2014; Guiso et…”
Lottery winners and accident victims: is happiness relative?
Brickman, P., Coates, D., & Janoff-Bulman, R. (1978) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.36.8.917 · Cited by 2,225 · cited 1× · see citing works
“…tasks in seconds, the reference point for how long a task should take can shift – and as a consequence, unaided work starts to feel counterfactually more effortful, a process structurally analogous to hedonic adaptation (Brickman, 1971; Brickman et al., 1978; Frederick & Loewenstein, 1999).”
Google Effects on Memory: Cognitive Consequences of Having Information at Our Fingertips
Sparrow, B., Liu, J., & Wegner, D. M. (2011) · Science · doi:10.1126/science.1207745 · Cited by 1,762 · cited 1× · see citing works
“However, this improved task performance also risks decline in performance when the cognitive aid is not available (Sparrow et al., 2011; Grinschgl et al., 2021; Richmond & Taylor, 2025).”
Risko, E. F., & Gilbert, S. J. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.07.002 · Cited by 1,502 · cited 1× · see citing works
“Cognitive offloading (Risko & Gilbert, 2016) is the use of physical action (e.g. writing notes, typing in a calculator, using a search engine) to alter the information processing requirements of a task and reduce cognitive demand (Goldin-Meadow et al., 2001; Martin & Schwartz, 2005; Gilbert et al.,…”
Collaborative Plans for Complex Group Action
Grosz, B., & Kraus, S. (1996) · Artificial Intelligence · doi:10.1016/0004-3702(95)00103-4 · Cited by 1,267 · cited 1× · see citing works
“Good collaborators optimize for long-term objectives (Bratman, 1992; Grosz & Kraus, 1996; Balcazar & Keys, 2014; Mattessich & Johnson, 2018).”
AI Tools in Society: Impacts on Cognitive Offloading and the Future of Critical Thinking
Gerlich, M. (2025) · Societies · doi:10.3390/soc15010006 · Cited by 1,248 · cited 2× · see citing works
“Existing evidence, however, is largely correlational through surveys or interviews (Gerlich, 2025; Lee et al., 2025).”
Brynjolfsson, E., Li, D., & Raymond, L. (2025) · The Quarterly Journal of Economics · doi:10.1093/qje/qjae044 · Cited by 1,083 · cited 1× · see citing works
“They rarely refuse to help, and provide instant answers to almost any query, across domains ranging from writing to coding to tutoring (Brynjolfsson et al., 2025; Buc¸inca et al., 2024; OECD, 2026; Shapira et al., 2026).”
Bratman, M. (1991) · The Philosophical Review · doi:10.2307/2185537 · Cited by 998 · cited 1× · see citing works
“Good collaborators optimize for long-term objectives (Bratman, 1992; Grosz & Kraus, 1996; Balcazar & Keys, 2014; Mattessich & Johnson, 2018).”
Guiso, L., Sapienza, P., & Zingales, L. (2008) · doi:10.2139/ssrn.1259859 · Cited by 968 · cited 1×
“…and is among the strongest predictors of long-term academic achievement, workforce adaptability, and resilience (Metcalfe & Mischel, 1999; Duckworth et al., 2007; Maddux, 2009; Metcalfe, 2009; Andersson & Bergman, 2011; Bjork et al., 2011; Kapur, 2014; Guiso et al., 2016; Mooradian et al., 2016).”
Generative artificial intelligence enhances creativity but reduces the diversity of novel content
Doshi, A., & Hauser, O. (2023) · doi:10.2139/ssrn.4535536 · Cited by 887 · cited 1× · see citing works
“…of AI usage to reduce human agency in interpersonal relationships (Kirk et al., 2025a; Sharma et al., 2026), creative output (Padmakumar & He, 2023; Doshi & Hauser, 2024), and personal beliefs (Jakesch et al., 2023; Williams et al., 2024; Guingrich et al., 2026), no prior work has examined how AI…”
Explaining Math: Gesturing Lightens the Load
Goldin-Meadow, S., Nusbaum, H., Kelly, S. D., & Wagner, S. (2001) · Psychological Science · doi:10.1111/1467-9280.00395 · Cited by 842 · cited 1× · see citing works
“…offloading (Risko & Gilbert, 2016) is the use of physical action (e.g. writing notes, typing in a calculator, using a search engine) to alter the information processing requirements of a task and reduce cognitive demand (Goldin-Meadow et al., 2001; Martin & Schwartz, 2005; Gilbert et al., 2020).”
Metacognition in human decision-making: confidence and error monitoring
Yeung, N., & Summerfield, C. (2012) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2011.0416 · Cited by 667 · cited 1× · see citing works
“Without opportunities to work independently, people never learn what they are capable of, undermining the metacognitive calibration that sustains persistence (Yeung & Summerfield, 2012; Fleming & Daw, 2017; Dubey et al., 2021; Elizondo et al., 2024).”
Self-Efficacy: The Power of Believing You Can
Maddux, J. E. (2009) · doi:10.1093/oxfordhb/9780195187243.013.0031 · Cited by 651 · cited 1× · see citing works
“…and is among the strongest predictors of long-term academic achievement, workforce adaptability, and resilience (Metcalfe & Mischel, 1999; Duckworth et al., 2007; Maddux, 2009; Metcalfe, 2009; Andersson & Bergman, 2011; Bjork et al., 2011; Kapur, 2014; Guiso et al., 2016; Mooradian et al., 2016).”
Exploring the Assistance Dilemma in Experiments with Cognitive Tutors
Koedinger, K. R., & Aleven, V. (2007) · Educational Psychology Review · doi:10.1007/s10648-007-9049-0 · Cited by 632 · cited 1× · see citing works
“In essence, the best collaborators maintain a balance between helping and fostering autonomy; they know when not to help (Koedinger & Aleven, 2007; Van de Pol et al., 2010; Soderstrom & Bjork, 2015).”
Lee, H.-P. (., Sarkar, A., Tankelevitch, L., Drosos, I., Rintel, S., Banks, R., & Wilson, N. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713778 · Cited by 490 · cited 1× · see citing works
“Existing evidence, however, is largely correlational through surveys or interviews (Gerlich, 2025; Lee et al., 2025).”
Self-Evaluation of Decision-Making: A General Bayesian Framework for Metacognitive Computation
Fleming, S. M., & Daw, N. D. (2017) · Psychological Review · doi:10.1037/rev0000045 · Cited by 489 · cited 1× · see citing works
“Without opportunities to work independently, people never learn what they are capable of, undermining the metacognitive calibration that sustains persistence (Yeung & Summerfield, 2012; Fleming & Daw, 2017; Dubey et al., 2021; Elizondo et al., 2024).”
Productive Failure in Learning Math
Kapur, M. (2014) · Cognitive Science · doi:10.1111/cogs.12107 · Cited by 453 · cited 1× · see citing works
“…and is among the strongest predictors of long-term academic achievement, workforce adaptability, and resilience (Metcalfe & Mischel, 1999; Duckworth et al., 2007; Maddux, 2009; Metcalfe, 2009; Andersson & Bergman, 2011; Bjork et al., 2011; Kapur, 2014; Guiso et al., 2016; Mooradian et al., 2016).”
Managing extreme AI risks amid rapid progress
Bengio, Y., Hinton, G., Yao, A., Song, D., Abbeel, P., Darrell, T., Harari, Y. N., Zhang, Y.-Q., Xue, L., Shalev-Shwartz, S., et al. (2024) · Science · doi:10.1126/science.adn0117 · Cited by 349 · cited 1× · see citing works
“AI safety research has traditionally focused on abrupt, dire events caused by advanced AI systems (Bucknall & Dori-Hacohen, 2022; Carlsmith, 2022; Bengio et al., 2024).”
Martin, T., & Schwartz, D. (2005) · Cognitive Sciences · doi:10.1207/s15516709cog0000_15 · Cited by 322 · cited 1× · see citing works
“…offloading (Risko & Gilbert, 2016) is the use of physical action (e.g. writing notes, typing in a calculator, using a search engine) to alter the information processing requirements of a task and reduce cognitive demand (Goldin-Meadow et al., 2001; Martin & Schwartz, 2005; Gilbert et al., 2020).”
Budzyń, K., Romańczyk, M., Kitala, D., Kołodziej, P., Bugajski, M., Adami, H. O., Blom, J., Buszkiewicz, M., Halvorsen, N., Hassan, C., et al. (2025) · The Lancet Gastroenterology & Hepatology · doi:10.1016/s2468-1253(25)00133-5 · Cited by 313 · cited 2× · see citing works
“AI accelerates this dynamic across virtually every reasoning domain (Kosmyna et al., 2025; Shen & Tamkin, 2026), raising concerns of overreliance (Ibrahim et al., 2025; Kim et al., 2025) and deskilling (Budzy´n et al., 2025; Shen & Tamkin, 2026).”
Generative AI without guardrails can harm learning: Evidence from high school mathematics
Bastani, H., Bastani, O., Sungu, A., Ge, H., Kabakcı, Ö., & Mariman, R. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2422633122 · Cited by 309 · cited 1× · see citing works
“Recent RCT-based work has begun to establish causal evidence: Bastani et al. (2025) found that GPT-4 assistance during math practice degraded later unaided performance in high school students, though a scaffolded tutor condition partially mitigated this harm; Barcaui (2025) similarly showed lasting…”
Okabe‐Miyamoto, K., & Boehm, J. K. (2020) · The Wiley Encyclopedia of Personality and Individual Differences · doi:10.1002/9781118970843.ch40 · Cited by 282 · cited 1× · see citing works
“…tasks in seconds, the reference point for how long a task should take can shift – and as a consequence, unaided work starts to feel counterfactually more effortful, a process structurally analogous to hedonic adaptation (Brickman, 1971; Brickman et al., 1978; Frederick & Loewenstein, 1999).”
Co-Writing with Opinionated Language Models Affects Users’ Views
Jakesch, M., Bhat, A., Buschek, D., Zalmanson, L., & Naaman, M. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581196 · Cited by 265 · cited 1× · see citing works
“…relationships (Kirk et al., 2025a; Sharma et al., 2026), creative output (Padmakumar & He, 2023; Doshi & Hauser, 2024), and personal beliefs (Jakesch et al., 2023; Williams et al., 2024; Guingrich et al., 2026), no prior work has examined how AI use erodes cognitive processes and undermines…”
How Can Students Improve Their Reading Comprehension Skill
Gilakjani, A. P., & Sabouri, N. B. (2016) · doi:10.5296/jse.v6i2.9201 · Cited by 241 · cited 1×
“…3 replicated our design in the domain of reading comprehension – a task that draws on fundamentally different cognitive skills, namely meaning-making and mental model construction (Pourhosein Gilakjani & Sabouri, 2016; Kintsch, 1998), and one with clear stakes for academic success (Bastug, 2014).”
Moore, F. C., Obradovich, N., Lehner, F., & Baylis, P. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1816541116 · Cited by 237 · cited 1× · see citing works
“This is analogous to the “boiling frog” effect, where each incremental act feels costless, until the cumulative effect becomes overwhelming to address (Moore et al., 2019; Kasirzadeh, 2025; Liu et al., 2025).”
Kosmyna, N., Hauptmann, E., Yuan, Y. T., Situ, J., Liao, X.-H., Beresnitzky, A. V., Braunstein, I., & Maes, P. (2025) · arXiv · doi:10.48550/arxiv.2506.08872 · Cited by 220 · cited 2× · see citing works
“AI accelerates this dynamic across virtually every reasoning domain (Kosmyna et al., 2025; Shen & Tamkin, 2026), raising concerns of overreliance (Ibrahim et al., 2025; Kim et al., 2025) and deskilling (Budzy´n et al., 2025; Shen & Tamkin, 2026).”
Sycophantic AI decreases prosocial intentions and promotes dependence
Cheng, M., Lee, C., Khadpe, P., Yu, S., Han, D., & Jurafsky, D. (2026) · Science · doi:10.1126/science.aec8352 · Cited by 185 · cited 1× · see citing works
“Short-term optimization often produces misalignment between what AI systems are rewarded for and what users need (Christian et al., 2026), giving rise to sycophancy (Cheng et al., 2025a;b; Rathje et al., 2025), manipulation (Williams et al., 2024), and deception (Zhou et al., 2025).”
Consequences of cognitive offloading: Boosting performance but diminishing memory
Grinschgl, S., Papenmeier, F., & Meyerhoff, H. S. (2021) · Quarterly Journal of Experimental Psychology · doi:10.1177/17470218211008060 · Cited by 147 · cited 1× · see citing works
“However, this improved task performance also risks decline in performance when the cognitive aid is not available (Sparrow et al., 2011; Grinschgl et al., 2021; Richmond & Taylor, 2025).”
Why human–AI relationships need socioaffective alignment
Kirk, H. R., Gabriel, I., Summerfield, C., Vidgen, B., & Hale, S. A. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-04532-5 · Cited by 146 · cited 1× · see citing works
“Mitigating these risks requires rethinking how AI systems collaborate with people long-term and broadening objectives beyond short-term user satisfaction (Zhi-Xuan et al., 2025; Kirk et al., 2025b) toward an ethos of empowerment and care (Kleiman-Weiner, 2024; Christian, 2025).”
Optimal use of reminders: Metacognition, effort, and cognitive offloading.Preprint
Gilbert, S., Bird, A., Carpenter, J., Fleming, S., Sachdeva, C., & Tsai, P.-C. (2018) · Journal of experimental psychology. General · doi:10.31234/osf.io/7fxrg · Cited by 130 · cited 1× · see citing works
“…offloading (Risko & Gilbert, 2016) is the use of physical action (e.g. writing notes, typing in a calculator, using a search engine) to alter the information processing requirements of a task and reduce cognitive demand (Goldin-Meadow et al., 2001; Martin & Schwartz, 2005; Gilbert et al., 2020).”
Perspiration and inspiration: Grit and innovativeness as antecedents of entrepreneurial success
Mooradian, T., Matzler, K., Uzelac, B., & Bauer, F. (2016) · Journal of Economic Psychology · doi:10.1016/j.joep.2016.08.001 · Cited by 121 · cited 1× · see citing works
“…and is among the strongest predictors of long-term academic achievement, workforce adaptability, and resilience (Metcalfe & Mischel, 1999; Duckworth et al., 2007; Maddux, 2009; Metcalfe, 2009; Andersson & Bergman, 2011; Bjork et al., 2011; Kapur, 2014; Guiso et al., 2016; Mooradian et al., 2016).”
Developmental and Individual Differences in Understanding of Fractions
Siegler, R., & Pyke, A. A. (2012) · Developmental Psychology · doi:10.1037/a0031200 · Cited by 111 · cited 1× · see citing works
“…their difficulty is easy to experimentally manipulate, they are a foundational mathematical skill (Braithwaite & Siegler, 2021), struggles with fractions predict later difficulties in mathematics (Siegler & Pyke, 2013), and critically, performance on fraction problems improves with practice.”
Andersson, H., & Bergman, L. (2011) · Developmental Psychology · doi:10.1037/a0023786 · Cited by 105 · cited 2× · see citing works
“A rich body of literature in cognitive science and education has shown that the capacity to regulate effort and persist through difficulty is foundational to effective learning, and is among the strongest predictors of long-term academic achievement, workforce adaptability, and resilience (Metcalfe…”
Building machines that learn and think with people
Collins, K. M., Sucholutsky, I., Bhatt, U., Chandra, K., Wong, L., Lee, M., Zhang, C. E., Zhi‐Xuan, T., Ho, M. K., Mansinghka, V. K., et al. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-01991-9 · Cited by 93 · cited 1× · see citing works
“A growing line of work considers how to design human-AI systems that optimize for long-term outcomes rather than short-term preference satisfaction (Sumers et al., 2022; Collins et al., 2024; Sucholutsky et al., 2025; Steyvers & Mayer, 2025; Zhao & Hawkins, 2025; Cheng et al., 2026).”
Beyond Preferences in AI Alignment
Zhi-Xuan, T., Carroll, M., Franklin, M., & Ashton, H. (2024) · Philosophical Studies · doi:10.1007/s11098-024-02249-w · Cited by 85 · see citing works
Gradual Disempowerment: Systemic Existential Risks from Incremental AI DevelopmentPreprint
Kulveit, J., Douglas, R., Ammann, N., Turan, D., Krueger, D., & Duvenaud, D. (2025) · arXiv.org · doi:10.48550/arxiv.2501.16946 · Cited by 81 · cited 1× · see citing works
“A growing literature instead considers the possibility of AI risks manifesting gradually through an incremental series of misalignment in objectives between human preferences and AI-dependent societal systems (Kasirzadeh, 2025; Kulveit et al., 2025).”
Two types of AI existential risk: decisive and accumulative
Kasirzadeh, A. (2024) · Philosophical Studies · doi:10.1007/s11098-025-02301-3 · Cited by 71 · cited 2× · see citing works
“A growing literature instead considers the possibility of AI risks manifesting gradually through an incremental series of misalignment in objectives between human preferences and AI-dependent societal systems (Kasirzadeh, 2025; Kulveit et al., 2025).”
Braithwaite, D. W., & Siegler, R. (2020) · Journal of Educational Psychology · doi:10.1037/edu0000477 · Cited by 64 · cited 1× · see citing works
“…problems as our task for several reasons: their difficulty is easy to experimentally manipulate, they are a foundational mathematical skill (Braithwaite & Siegler, 2021), struggles with fractions predict later difficulties in mathematics (Siegler & Pyke, 2013), and critically, performance…”
OECD Digital Education Outlook 2026: Exploring Effective Uses of Generative AI in Education
Sangral, M. (2026) · Education, Innovation and Social Futures · doi:10.66558/eisf.2026.1.3 · Cited by 63 · cited 1× · see citing works
“They rarely refuse to help, and provide instant answers to almost any query, across domains ranging from writing to coding to tutoring (Brynjolfsson et al., 2025; Buc¸inca et al., 2024; OECD, 2026; Shapira et al., 2026).”
Kim, S. S. Y., Vaughan, J. W., Liao, Q. V., Lombrozo, T., & Russakovsky, O. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714020 · Cited by 58 · see citing works
ChatGPT as a cognitive crutch: Evidence from a randomized controlled trial on knowledge retention
Barcaui, A. (2025) · Social Sciences & Humanities Open · doi:10.1016/j.ssaho.2025.102287 · Cited by 51 · cited 1× · see citing works
“…al. (2025) found that GPT-4 assistance during math practice degraded later unaided performance in high school students, though a scaffolded tutor condition partially mitigated this harm; Barcaui (2025) similarly showed lasting performance decrements after AI-assisted coursework in undergraduates.”
Current and Near-Term AI as a Potential Existential Risk Factor
Bucknall, B. S., & Dori-Hacohen, S. (2022) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3514094.3534146 · Cited by 48 · see citing works
Binary climate data visuals amplify perceived impact of climate change
Liu, G., Snell, J. C., Griffiths, T. L., & Dubey, R. (2025) · Nature Human Behaviour · doi:10.1038/s41562-025-02183-9 · Cited by 45 · cited 1× · see citing works
“This is analogous to the “boiling frog” effect, where each incremental act feels costless, until the cumulative effect becomes overwhelming to address (Moore et al., 2019; Kasirzadeh, 2025; Liu et al., 2025).”
Self-citationIs Power-Seeking AI an Existential Risk?
Carlsmith, J. (2022) · arXiv · doi:10.48550/arxiv.2206.13353 · Cited by 37 · cited 1× · see citing works
“AI safety research has traditionally focused on abrupt, dire events caused by advanced AI systems (Bucknall & Dori-Hacohen, 2022; Carlsmith, 2022; Bengio et al., 2024).”
AI-induced never-skilling in medical education
Ke, Y., Jin, L., Ong, J. C. L., Thirunavukarasu, A. J., Car, J., Cheung, C. Y., Tham, Y. C., Ting, D. S. W., Ong, M. E. H., Compton, S., et al. (2026) · Nature Medicine · doi:10.1038/s41591-026-04438-y · Cited by 35 · cited 1× · see citing works
“…persistence and independent ability for all tasks; nonetheless, at minimum, our findings suggest that AI assistance displaces the very practice opportunities through which people develop lasting competence, a concern echoed in recent perspectives on AI use in medical training (Ke et al., 2026).”
Elizondo, K., Valenzuela, R., Pestana, J., & Codina, N. (2023) · Psychology in the schools (Print) · doi:10.1002/pits.23088 · Cited by 35 · cited 1× · see citing works
“Without opportunities to work independently, people never learn what they are capable of, undermining the metacognitive calibration that sustains persistence (Yeung & Summerfield, 2012; Fleming & Daw, 2017; Dubey et al., 2021; Elizondo et al., 2024).”
Neural steering vectors reveal dose and exposure-dependent impacts of human-AI relationshipsPreprint
Kirk, H. R., Davidson, H., Saunders, E., Luettgau, L., Vidgen, B., Hale, S. A., & Summerfield, C. (2025) · arXiv.org · doi:10.48550/arxiv.2512.01991 · Cited by 31 · cited 1× · see citing works
“Although related work has explored the potential of AI usage to reduce human agency in interpersonal relationships (Kirk et al., 2025a; Sharma et al., 2026), creative output (Padmakumar & He, 2023; Doshi & Hauser, 2024), and personal beliefs (Jakesch et al., 2023; Williams et al., 2024; Guingrich…”
How to talk so AI will learn: Instructions, descriptions, and autonomy
Sumers, T., Hawkins, R. D., Ho, M. K., Griffiths, T., & Hadfield-Menell, D. (2022) · Neural Information Processing Systems · doi:10.52202/068431-2519 · Cited by 30 · cited 1×
“A growing line of work considers how to design human-AI systems that optimize for long-term outcomes rather than short-term preference satisfaction (Sumers et al., 2022; Collins et al., 2024; Sucholutsky et al., 2025; Steyvers & Mayer, 2025; Zhao & Hawkins, 2025; Cheng et al., 2026).”
Shapira, I., Benade, G., & Procaccia, A. D. (2026) · arXiv.org · doi:10.48550/arxiv.2602.01002 · Cited by 27 · cited 1×
“They rarely refuse to help, and provide instant answers to almost any query, across domains ranging from writing to coding to tutoring (Brynjolfsson et al., 2025; Buc¸inca et al., 2024; OECD, 2026; Shapira et al., 2026).”
On Targeted Manipulation and Deception when Optimizing LLMs for User FeedbackPreprint
Williams, M., Carroll, M., Narang, A., Weisser, C. N., Murphy, B. J., & Dragan, A. D. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2411.02306 · Cited by 24 · cited 2× · see citing works
“Short-term optimization often produces misalignment between what AI systems are rewarded for and what users need (Christian et al., 2026), giving rise to sycophancy (Cheng et al., 2025a;b; Rathje et al., 2025), manipulation (Williams et al., 2024), and deception (Zhou et al., 2025).”
The benefits and potential costs of cognitive offloading for retrospective information
Richmond, L. L., & Taylor, R. G. (2025) · Nature Reviews Psychology · doi:10.1038/s44159-025-00432-2 · Cited by 24 · cited 1× · see citing works
“However, this improved task performance also risks decline in performance when the cognitive aid is not available (Sparrow et al., 2011; Grinschgl et al., 2021; Richmond & Taylor, 2025).”
Does Writing with Language Models Reduce Content Diversity?
Padmakumar, V., & He, H. (2023) · arXiv · doi:10.48550/arxiv.2309.05196 · Cited by 21 · cited 1× · see citing works
“…explored the potential of AI usage to reduce human agency in interpersonal relationships (Kirk et al., 2025a; Sharma et al., 2026), creative output (Padmakumar & He, 2023; Doshi & Hauser, 2024), and personal beliefs (Jakesch et al., 2023; Williams et al., 2024; Guingrich et al., 2026), no prior…”
Goals in mentoring relationships
Balcazar, F., & Keys, C. B. (2013) · Sage eBooks · doi:10.4135/9781412996907.n6 · Cited by 20 · cited 1× · see citing works
“Good collaborators optimize for long-term objectives (Bratman, 1992; Grosz & Kraus, 1996; Balcazar & Keys, 2014; Mattessich & Johnson, 2018).”
Aha! moments correspond to metacognitive prediction errors.
Dubey, R., Ho, M. K., Mehta, H., & Griffiths, T. L. (2021) · Cognition · doi:10.31234/osf.io/c5v42 · Cited by 19 · cited 1×
“Without opportunities to work independently, people never learn what they are capable of, undermining the metacognitive calibration that sustains persistence (Yeung & Summerfield, 2012; Fleming & Daw, 2017; Dubey et al., 2021; Elizondo et al., 2024).”
Self-citationComparing human and LLM politeness strategies in free production
Zhao, H., & Hawkins, R. D. (2025) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2506.09391 · Cited by 16 · cited 1×
“A growing line of work considers how to design human-AI systems that optimize for long-term outcomes rather than short-term preference satisfaction (Sumers et al., 2022; Collins et al., 2024; Sucholutsky et al., 2025; Steyvers & Mayer, 2025; Zhao & Hawkins, 2025; Cheng et al., 2026).”
Using LLMs to advance the cognitive science of collectives
Sucholutsky, I., Collins, K. M., Jacoby, N., Thompson, B. D., & Hawkins, R. D. (2025) · Nature Computational Science · doi:10.1038/s43588-025-00848-z · Cited by 12 · cited 2× · see citing works
“A growing line of work considers how to design human-AI systems that optimize for long-term outcomes rather than short-term preference satisfaction (Sumers et al., 2022; Collins et al., 2024; Sucholutsky et al., 2025; Steyvers & Mayer, 2025; Zhao & Hawkins, 2025; Cheng et al., 2026).”
Belief Offloading in Human-AI Interaction
Guingrich, R. E., Mehta, D., & Bhatt, U. (2026) · arXiv.org · doi:10.48550/arxiv.2602.08754 · Cited by 5 · cited 1×
“…(Kirk et al., 2025a; Sharma et al., 2026), creative output (Padmakumar & He, 2023; Doshi & Hauser, 2024), and personal beliefs (Jakesch et al., 2023; Williams et al., 2024; Guingrich et al., 2026), no prior work has examined how AI use erodes cognitive processes and undermines autonomous thought.”
How AI Impacts Skill Formation
Shen, J. H., & Tamkin, A. (2026) · arXiv · doi:10.48550/arxiv.2601.20245 · Cited by 4 · cited 2× · see citing works
“AI accelerates this dynamic across virtually every reasoning domain (Kosmyna et al., 2025; Shen & Tamkin, 2026), raising concerns of overreliance (Ibrahim et al., 2025; Kim et al., 2025) and deskilling (Budzy´n et al., 2025; Shen & Tamkin, 2026).”
Reward Models Inherit Value Biases from Pretraining
Christian, B., Thompson, J., Yang, E. M., Adam, V., Kirk, H. R., Summerfield, C., & Dumbalska, T. (2026) · International Conference on Learning Representations · doi:10.48550/arxiv.2601.20838 · Cited by 4 · cited 1×
“Short-term optimization often produces misalignment between what AI systems are rewarded for and what users need (Christian et al., 2026), giving rise to sycophancy (Cheng et al., 2025a;b; Rathje et al., 2025), manipulation (Williams et al., 2024), and deception (Zhou et al., 2025).”
Self-citationWhen not to help: planning for lasting human-AI collaboration
Steyvers, M., & Mayer, L. W. (2025) · arXiv.org · doi:10.48550/arxiv.2508.01837 · Cited by 4 · cited 1×
“A growing line of work considers how to design human-AI systems that optimize for long-term outcomes rather than short-term preference satisfaction (Sumers et al., 2022; Collins et al., 2024; Sucholutsky et al., 2025; Steyvers & Mayer, 2025; Zhao & Hawkins, 2025; Cheng et al., 2026).”
Computational Frameworks for Human Care
Christian, B. (2025) · Daedalus · doi:10.1162/daed_a_02131 · Cited by 3 · cited 1×
“Mitigating these risks requires rethinking how AI systems collaborate with people long-term and broadening objectives beyond short-term user satisfaction (Zhi-Xuan et al., 2025; Kirk et al., 2025b) toward an ethos of empowerment and care (Kleiman-Weiner, 2024; Christian, 2025).”
Self-citationWho's in Charge? Disempowerment Patterns in Real-World LLM Usage
Sharma, M., McCain, M., Douglas, R., & Duvenaud, D. (2026) · arXiv · doi:10.48550/arxiv.2601.19062 · Cited by 2 · cited 1× · see citing works
“Although related work has explored the potential of AI usage to reduce human agency in interpersonal relationships (Kirk et al., 2025a; Sharma et al., 2026), creative output (Padmakumar & He, 2023; Doshi & Hauser, 2024), and personal beliefs (Jakesch et al., 2023; Williams et al., 2024; Guingrich…”
Buçinca, Z., Swaroop, S., Paluch, A. E., Murphy, S. A., & Gajos, K. Z. (2024) · arXiv · doi:10.48550/arxiv.2403.05911 · Cited by 2 · cited 1× · see citing works
“They rarely refuse to help, and provide instant answers to almost any query, across domains ranging from writing to coding to tutoring (Brynjolfsson et al., 2025; Buc¸inca et al., 2024; OECD, 2026; Shapira et al., 2026).”
Walter, K. (2016) · Scientists Making a Difference · doi:10.1017/cbo9781316422250.039 · cited 1×
“…3 replicated our design in the domain of reading comprehension – a task that draws on fundamentally different cognitive skills, namely meaning-making and mental model construction (Pourhosein Gilakjani & Sabouri, 2016; Kintsch, 1998), and one with clear stakes for academic success (Bastug, 2014).”
Cheng, M., Hawkins, R. D., & Jurafsky, D. (2026) · arXiv · doi:10.48550/arxiv.2601.04435 · cited 1×
“A growing line of work considers how to design human-AI systems that optimize for long-term outcomes rather than short-term preference satisfaction (Sumers et al., 2022; Collins et al., 2024; Sucholutsky et al., 2025; Steyvers & Mayer, 2025; Zhao & Hawkins, 2025; Cheng et al., 2026).”
Flagged first, then by citations
22 of the 88 references couldn’t be matched to a known paper.
Research works printed but not linked: 12
- Muhammet Bastug. The structural relationship of reading attitude, reading comprehension and academic achievement. International Journal of Social Sciences and Education, 4(4):931-946, 2014.
- Elizabeth L Bjork, Robert A Bjork, et al. Making things hard on yourself, but in a good way: Creating desirable difficulties to enhance learning. Psychology and the real world: Essays illustrating fundamental contributions to society, 2(59-68):56-64, 2011.
- Philip Brickman. Hedonic relativism and planning the good society. Adaptation level theory, pp. 287-301, 1971.
- Myra Cheng, Sunny Yu, Cinoo Lee, Pranav Khadpe, Lujain Ibrahim, and Dan Jurafsky. Social sycophancy: A broader understanding of llm sycophancy. arXiv preprint arXiv:2505.13995, 2025b. · arXiv
- Angela L Duckworth, Christopher Peterson, Michael D Matthews, and Dennis R Kelly. Grit: perseverance and passion for long-term goals. Journal of Personality and Social Psychology, 92(6):1087, 2007.
- Lujain Ibrahim, Katherine M Collins, Sunnie SY Kim, Anka Reuel, Max Lamparth, Kevin Feng, Lama Ahmad, Prajna Soni, Alia El Kattan, Merlin Stein, et al. Measuring and mitigating overreliance is necessary for building human-compatible AI. arXiv preprint arXiv:2509.08010, 2025. · arXiv
- Max Kleiman-Weiner. Computational principles of caregiving. In Proceedings of the Annual Meeting of the Cognitive Science Society, volume 46, 2024.
- Paul W. Mattessich and Kirsten M. Johnson. Collaboration: What Makes It Work. Turner Publishing Company, 3rd edition, 2018.
- Janet Metcalfe. Metacognitive judgments and control of study. Current Directions in Psychological Science, 18(3):159-163, 2009.
- Steve Rathje, Meryl Ye, Laura K. Globig, Raunak M. Pillai, Victoria Oldemburgo de Mello, and Jay J. Van Bavel. Sycophantic AI increases attitude extremity and overconfidence, 2025. Preprint, PsyArXiv.
- Nicholas C Soderstrom and Robert A Bjork. Learning versus performance: An integrative review. Perspectives on Psychological Science, 10(2):176-199, 2015.
- Janneke Van de Pol, Monique Volman, and Jos Beishuizen. Scaffolding in teacher-student interaction: A decade of research. Educational Psychology Review, 22(3):271-296, 2010.
Cited by
Sorted by citations
Rismanchian, S., Uzun, H., Matayoshi, J., Cosyn, E., & Kurd-Misto, E. (2026) · arXiv.org · doi:10.48550/arxiv.2605.21629 · Cited by 6 · see citing works
“These results complement and extend recent experimental evidence from Bastani et al. (2025) and Liu et al. (2026), who found that unrestricted AI chatbot access during practice improved assisted performance but reduced unassisted exam scores in randomized trials.”
Yu, S., Cheng, M., Jabbar, A., Sucholutsky, I., Collins, K. M., Jurafsky, D., & Hawkins, R. D. (2026) · arXiv.org · doi:10.48550/arxiv.2605.22687 · Cited by 4 · see citing works
“A high rate of AI use, especially on simple tasks, poses risks such as cognitive deskilling [14], reduced confidence [15], and impairments in independent performance [16], knowledge retention [17] and learning abilities [18].”
Modeling the Coevolution of Human Skills and AI Adoption
Frigerio, G., Caruso, S., Livan, G., & Latora, V. (2026) · doi:10.48550/arxiv.2610.24794 · Cited by 1
“A separate set of randomized experiments by Liu et al. found that AI assistance in mathematical reasoning and reading comprehension improved assisted performance but could reduce subsequent unaided performance [5].”
Designing Against Deskilling: Metacognitive Feedback Reduces Cognitive Offloading to LLM Assistants
Maier, S., Schwabe, K., Schneider, M., & Feuerriegel, S. (2026) · doi:10.48550/arxiv.2609.20143 · Cited by 1
“Similar patterns have been observed, for example, in divergent and convergent creativity [45], coding [78], and reading comprehension and fraction problems [53].”
InfluentialHow AI Assistance Affects Human Skill Development: A Study of Learning with Logic Puzzles
Wu, S., Belém, C. G., Fu, S.-C., Steyvers, M., & Smyth, P. (2026) · Proceedings of the 2026 ACM Conference on Human-AI Complementarity and Alignment · doi:10.1145/3834580.3838741 · Cited by 1
“In mathematical reasoning and reading-comprehension tasks, Liu et al. [19] find that AI assistance improves short-run performance but reduces persistence and impairs later independent performance.”
Kuhn, J., Gerjets, P., Trautwein, U., Greene, J., Malone, S., Vogt, P., & Fütterer, T. (2026) · arXiv.org · doi:10.48550/arxiv.2608.21618 · Cited by 1
“In the withdrawal experiments described above (Liu et al., 2026), participants who had worked with AI did not merely perform worse once it was removed.”
InfluentialEpistemic Transfer in AI-Assisted Verification: A Framework and Evaluation Protocol
Trattner, C. (2026) · arXiv.org · doi:10.48550/arxiv.2608.08882 · Cited by 1
“Time alone does not establish cognitive engagement; report it alongside accuracy and distinguish time to initial and final judgments (Liu et al., 2026; Lee et al., 2025).”
Babar, A., Davin, K. J., & Dornburg, A. (2026) · arXiv · doi:10.48550/arxiv.2608.27638
“Overreliance on GenAI has been associated with cognitive offloading, reduced critical engagement, and weaker independent reasoning when learners rely on generated outputs rather than interrogating or extending them (Bastani et al. 2025; Lee et al. 2025; Choudhuri et al. 2026; Liu et al. 2026).”
Use and Effects of LLMs in Peer Review: A Randomized Experiment and Survey at ICML 2026
Kim, S. S. Y., Deng, W. H., Vaughan, J. W., Su, B., Su, W., Agarwal, A., Li, S., Jaggi, M., Goldstein, D. G., Shah, N. B., et al. (2026) · arXiv · doi:10.48550/arxiv.2609.19420
“These concerns are supported by prior work in other domains suggesting that AI assistance can bias human judgments [45], encourage (over)reliance on AI outputs [32, 48, 49], and reduce opportunities to develop expertise and critical-thinking skills [26, 51, 55, 78, 90].”
Experimental Evidence on the Learning Impact of Generative AI
Contractor, Z., & Reyes, G. (2026) · arXiv · doi:10.48550/arxiv.2607.08849
Modelling lock-in of AI adoption through skill erosion
Lambiotte, R. (2026) · doi:10.48550/arxiv.2611.04886
“At the individual level, relying on AI may reduce the practice that maintains one’s capacity to work independently: AI assistance can help with a task yet reduce persistence and subsequent independent performance [1].”
What's Old Is New: Improved Learning from Small-Group Tutorials
Duchi, J. C., Hartog, W., & Sun, D. L. (2026) · doi:10.48550/arxiv.2610.39538
“Finally, preliminary work suggests LLMs reduce persistence and hinder unassisted performance (Liu et al. 2026).”
Riva, G., Rocca, S. L., Wiederhold, B. K., & Gaggioli, A. (2026) · doi:10.48550/arxiv.2610.38647
Optimizing for happiness in EU technology policy to repay public subsidies for AI
Wachter, S., Mittelstadt, B., Onitiu, D., & Weinstein, N. (2026) · Royal Society Open Science · doi:10.1098/rsos.261323
Who Thinks First? Designing Productive Friction with Engage-to-Unlock GenAI
Su, X.-T., Rimell, L., Li, J., Rannen-Triki, A., Paquet, U., Hendricks, L. A., Qadri, R., Ippolito, D., & Mirowski, P. (2026) · doi:10.48550/arxiv.2610.01518
Suppressed inquiry: The hidden toll of working with satisfaction-optimized AI
Carmon, Z., Linzen, I., Sela, A., & Steinhart, Y. (2026) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2026.102453
Chauncey, S. (2026) · Frontiers of Computer Science · doi:10.3389/fcomp.2026.1947835
Process-Constituted Intelligence: A Shared Criterion for Humans and Machines
Richardson, M. J., Varlet, M., Alhasan, A., Crone, C. L., Monfort, M., Nalepka, P., Dras, M., Kallen, R., & Kaplan, D. (2026) · arXiv.org · doi:10.48550/arxiv.2608.16213
“However, after completing a single 10–15 minute session, participants solved fewer problems without it and, in two of the three experiments, were more likely to give up 88 .”
The System 3 Method: integrating intuition, reason and creative metacognition for deep learning
Chávez-Autor, J. C. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1891793
How to Craft the Right Language AI Policy For Your Research Group (Some Assembly Required)
Ntampaka, M., Burke-Spolaor, S., Ciuca, I., Delgado, A. M., Iyer, K. G., Lockhart, K., Plunkett, A., L'opez-Morales, M., Mahabal, A., Mullally, S., et al. (2026) · doi:10.48550/arxiv.2607.20836
“Liu et al. (2026) shows that, while AI assistance improves short-term performance across several tasks, people perform significantly worse when the AI is taken away, and they are far more likely to give up.”
Teo, V., Jain, R., Gerstenberg, T., & Kleiman-Weiner, M. (2026) · arXiv.org · doi:10.48550/arxiv.2607.21306
“More broadly, delegating mental work to external tools can erode independent analytical capacity over time (Liu et al., 2026; Risko and Gilbert, 2016).”
PAUSE: A Privacy-Preserving Self-Reflection Tool for AI-Associated Cognitive Offloading
Alam, M. (2026) · doi:10.48550/arxiv.2609.13155
“Liu et al. (2026) provide causal evidence for the same pattern in randomised controlled trials ( N = 1 , 222 ), adding that AI assistance also reduced persistence.”
AIED's Unfinished Mission: Centering Agency and Motivation in the Age of Effortless Bypass
Lane, H. C. (2026) · arXiv.org · doi:10.1007/978-3-032-29791-4_38
“Liu et al. [21] enrich the picture with randomized experiments showing that brief AI-assisted practice not only reduces immediate engagement but carries over: participants who lost access to AI afterward solved fewer problems and gave up more often than participants who never had AI assistance.”
- Authors
- Liu, G., Christian, B., Dumbalska, T., Bakker, M. A., & Dubey, R.
- Affiliations
- Carnegie Mellon University (US)
- University of Oxford (GB)
- Massachusetts Institute of Technology (US)
- University of California, Los Angeles (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2026
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2604.04721
- OpenAlex
- W7151561914
- Cited by
- 3
- References
- 88
- Citations by year
- 2026: 3
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (2140739)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Physical Sciences › Computer Science › Information Systems › Artificial Intelligence in Education
- Keywords
- human-AI interaction, AI assistance, persistence, giving up, mathematical reasoning, reading comprehension, instructional scaffolding, skill acquisition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
