The Impact of Generative AI on Critical Thinking: Self-Reported Reductions in Cognitive Effort and Confidence Effects From a Survey of Knowledge Workers
Open accessThe DOI matches its Crossref record; 132 of the 132 references it cites were found in a registry or an index; 23 of the 39 sources its claims cite were checked for support.
Abstract
The rise of Generative AI (GenAI) in knowledge workflows raises questions about its impact on critical thinking skills and practices.We survey 319 knowledge workers to investigate 1) when and how they perceive the enaction of critical thinking when using GenAI, and 2) when and why GenAI affects their effort to do so.Participants shared 936 first-hand examples of using GenAI in work tasks.Quantitatively, when considering both task-and user-specific factors, a user's task-specific self-confidence and confidence in GenAI are predictive of whether critical thinking is enacted and the effort of doing so in GenAI-assisted tasks.Specifically, higher confidence in GenAI is associated with less critical thinking, while higher self-confidence is associated with more critical thinking.Qualitatively, GenAI shifts the nature of critical thinking toward information verification, response integration, and task stewardship.Our insights reveal new design challenges and opportunities for developing GenAI tools for knowledge work.
Overview
CoChat Summary
TL;DR
A survey of 319 knowledge workers who use GenAI at work at least weekly, drawing on 936 real-world examples, finds that higher confidence in GenAI is associated with less critical thinking, while higher self-confidence is associated with more. GenAI also shifts perceived critical-thinking effort toward information verification, response integration, and task stewardship.
Key findings
- Participants reported enacting critical thinking in 555 of 936 examples (59.29%). Higher confidence in AI doing the task negatively correlated with perceived enaction of critical thinking (β = -0.69, p < 0.001); confidence in doing the task oneself (β = 0.26, p = 0.026), confidence in evaluating AI responses (β = 0.31, p = 0.046), and overall tendency to reflect on work (β = 0.52, p < 0.001) positively correlated with perceived enaction.
- Perceived effort decreased in the majority of examples: “much less effort” or “less effort” comprised 72% for Knowledge, 79% for Comprehension, 69% for Application, 72% for Analysis, 76% for Synthesis, and 55% for Evaluation. Higher confidence in AI negatively correlated with perceived effort for five of six activities (all except Application): Knowledge (β = -0.11, p = 0.029), Comprehension (β = -0.13, p = 0.014), Analysis (β = -0.15, p = 0.003), Synthesis (β = -0.12, p = 0.026), and Evaluation (β = -0.23, p < 0.001).
- Qualitatively, GenAI shifted critical-thinking effort in three ways: for Knowledge and Comprehension, from information gathering to information verification; for Application, from problem-solving to AI response integration; and for Analysis, Synthesis, and Evaluation, from task execution to task stewardship.
- Motivators for critical thinking included work quality (74/319), potential negative outcomes (116/319), and skill development (13/319). Inhibitors included awareness barriers such as secondary use of GenAI (14/319), trivial tasks (55/319), and trust/reliance on GenAI (83/319); motivation barriers such as lack of time (44/319) and not being part of job responsibilities (11/319); and ability barriers such as barriers to inspecting AI responses (58/319) and revising queries/improving responses (72/319).
Methods
- Online survey on Prolific of 319 knowledge workers who self-reported using GenAI tools at work at least once per week. The study received 333 responses and excluded 14 for low response quality; retained participants spent an average of 43.19 minutes (SD = 23.13) completing the survey and were compensated GBP £10.
- Participants shared three real-world GenAI work examples each. The study collected 957 examples, removed 11 lacking sufficient detail and 11 duplicated or non-GenAI examples, retaining 936: 374 Creation (39.96%), 303 Information (32.37%), and 259 Advice (27.67%).
- Quantitative analysis used one random-intercepts logistic regression for perceived enaction of critical thinking and six random-intercepts linear regressions for perceived effort across Bloom’s taxonomy activities, with Participant ID as a random intercept. Benjamini-Hochberg correction was applied across 98 hypothesised predictors, yielding a corrected p-value threshold of 0.007. Qualitative analysis used open coding of free-text responses; one researcher initially coded 50 responses with three others to build a codebook, then two researchers coded the remaining 269 responses.
Limitations
- The paper states that participants occasionally conflated reduced effort in using GenAI with reduced effort in critical thinking with GenAI, potentially leading to inaccurate self-reporting; future studies could use think-aloud protocols or task-based assessments.
- The paper states that subjective task confidence may not be well-calibrated with objective expertise, and that the survey was English-only, with no representation of non-English-speaking or multilingual contexts.
- The paper states that the sample was biased toward younger, more technologically skilled participants who use GenAI at work at least weekly, and that GenAI tools are constantly evolving; the task taxonomy was coarse-grained, and future longitudinal or telemetry/experience-sampling work is suggested. The text also makes evident that the analysis does not establish causation, as the paper itself notes.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
12 Valid · 5 Not valid · 9 Not checked · 146 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“These findings suggest that a reflective approach toward the use of GenAI tools, which can lead to what prior work refers to as”
§ The Impact of Generative AI on Critical Thinking: Self-Reported Reductions in Cognitive Effort and Confidence Effects From a Survey of Knowledge Workers > 4.2.1 Task Factors.
What the sources say
- Partly supportedcites [20] 20. Valerie Chen, Q. Vera Liao, Jennifer Wortman Vaughan, and Gagan Bansal. 2023. Understanding the Role of Human Intuition on Reliance in Human- AI Decision-Making with Explanations. Proceedings of the ACM on Human- Computer Interaction 7, CSCW2 (Sept. 2023), 1-32. https://doi.org/10.1145/ 3610219 sourceExperimental — accuracy not yet measured
Section 4.1 (page unavailable) reports that participants with strong intuition sometimes discounted an AI prediction, supporting a link between confidence in their own judgment and critical use of AI. But it also says they sometimes decided quickly without checking explanations when the AI agreed with them. The study concerns two AI-assisted prediction tasks, not GenAI use by knowledge workers, and does not establish the claim’s general likelihood comparison. (LLM, conf=0.86)
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on 2 assumptions not shown here.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Quantitatively, when considering both task-and user-specific factors, a user's task-specific self-confidence and confidence in GenAI are predictive of whether critical thinking is enacted and the effort of doing so in GenAI-assisted tasks.”
§ The Impact of Generative AI on Critical Thinking: Self-Reported Reductions in Cognitive Effort and Confidence Effects From a Survey of Knowledge Workers > Abstract
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Specifically, higher confidence in GenAI is associated with less critical thinking, while higher self-confidence is associated with more critical thinking.”
§ The Impact of Generative AI on Critical Thinking: Self-Reported Reductions in Cognitive Effort and Confidence Effects From a Survey of Knowledge Workers > Abstract
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The data shows a shift in cognitive effort as knowledge workers increasingly move from task execution to oversight when using GenAI.”
§ The Impact of Generative AI on Critical Thinking: Self-Reported Reductions in Cognitive Effort and Confidence Effects From a Survey of Knowledge Workers > 1 Introduction
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the study reveals that knowledge workers engage in critical thinking when using GenAI tools primarily to ensure the quality of their work.”
§ The Impact of Generative AI on Critical Thinking: Self-Reported Reductions in Cognitive Effort and Confidence Effects From a Survey of Knowledge Workers > 1 Introduction
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
78 more claims
Create a free account to see all 172 claims and to verify the 1 reference still open.
- Probably not a substantial claim. 68
- It may state two separate claims as one. 35
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“our findings show that GenAI may undermine students’ motivation to engage in the cognitive effort that is necessary for deeper intellectual enjoyment (contra Lee et al., 2025; see also Stadler et al., 2024).”
From If ChatGPT can do it, where is my creativity? generative AI boosts performance but diminishes experience in creative writing (2025) · cites this paper as Lee et al., 2025
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“We might also be concerned about mechanised convergence in the increased use of GenAI; that AI generation tends to result in less diverse textual output (Lee et al., 2025).”
From If ChatGPT can do it, where is my creativity? generative AI boosts performance but diminishes experience in creative writing (2025) · cites this paper as Lee et al., 2025
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Further, GenAI tools can increase developers' perceived productivity [Ziegler et al. 2024] and level of understanding [Prather et al. 2024] without delivering actual improvements, potentially leading to a false sense of confidence [Lee et al. 2025] among novices.”
From How Do Programming Students Use Generative AI? (2025) · cites this paper as Lee et al. 2025
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Lee et al. [8] found that professionals using GenAI tools reported reduced cognitive effort but increased confidence in the quality of their outputs, revealing a mismatch between perceived and actual engagement.”
From From Offloading to Engagement: An Experimental Study on Structured Prompting and Critical Reasoning with Generative AI (2025) · cites this paper as [8]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In the present study, this same pattern was evident in the unguided condition. Although participants often believed they had 'used AI to check their ideas,' interview data revealed that many had in fact accepted the AI's structure wholesale.”
From From Offloading to Engagement: An Experimental Study on Structured Prompting and Critical Reasoning with Generative AI (2025) · cites this paper as Lee et al. [8]
Experimental — accuracy not yet measured
20 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482 · cited 1×
“To correct for multiple comparisons, we apply the Benjamini–Hochberg procedure [9] with a total of 98 hypothesised predictors across the seven models, yielding a corrected p-value threshold of 0.007.”
InfluentialBasics of Qualitative Research
Ozanne, J. L., Strauss, A., & Corbin, J. (1992) · Journal of Marketing Research · doi:10.2307/3172751 · Cited by 17,850
Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-019-0171-0 · Cited by 7,242 · cited 1×
“To mitigate this, using GenAI for individualised, content-focused feedback may help novice writers develop writing skills while improving productivity [58, 86, 144].”
Binder, J. R., Desai, R. H., Graves, W. W., & Conant, L. L. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhp055 · Cited by 4,060 · cited 1×
“Cognitive science shows that effective learning requires “grounding” information through multiple perspectives and examples [10, 11, 68], and GenAI can offer personalised analogies to aid this process [77, 90].”
Dewey, J. (1910) · D C Heath eBooks · doi:10.1037/10903-000 · Cited by 3,998
Human trust in artificial intelligence: Review of empirical research
Glikson, E., & Woolley, A. W. (2020) · Academy of Management Annals · doi:10.5465/annals.2018.0057 · Cited by 2,921 · cited 1×
“We measure participants’ overall trust in GenAI, which has been shown to correlate with users’ attitudes and adoption of the use of the technologies [43, 76].”
Experimental Evidence on the Productivity Effects of Generative Artificial Intelligence
Noy, S., & Zhang, W. (2023) · doi:10.2139/ssrn.4375283 · Cited by 2,157
The neurobiology of semantic memory
Binder, J. R., & Desai, R. H. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.10.001 · Cited by 2,114 · cited 1×
“Cognitive science shows that effective learning requires “grounding” information through multiple perspectives and examples [10, 11, 68], and GenAI can offer personalised analogies to aid this process [77, 90].”
Principles of mixed-initiative user interfaces
Horvitz, E. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.303030 · Cited by 1,490 · cited 1×
“Proactive systems take the initiative [52] to interrupt the user to highlight the need and opportunity for critical thinking in situations where it is likely to be overlooked; a reactive approach would allow the user to explicitly request critical thinking assistance when it is consciously needed.”
Generative artificial intelligence enhances creativity but reduces the diversity of novel content
Doshi, A., & Hauser, O. (2023) · doi:10.2139/ssrn.4535536 · Cited by 1,350
Research works printed but not linked: 19
- 12. Benjamin S Bloom, Max D Engelhart, Edward J Furst, Walquer H Hill, David R Krathwohl, et al. 1956. Taxonomy of educational objetives: the classification of educational goals: handbook I: cognitive domain. Technical Report. New York, US: D. Mckay.
- 19. Michael Castelluccio. 2022. IS DIGITAL AMNESIA REAL? Strategic Finance 104, 3 (2022), 57-58.
- 21. Ooi Yan Chiew, An Qi Lai, and Wen Xin Liew. 2020. Digital technology overuse as a predictor of digital amnesia and productivity. Ph. D. Dissertation. UTAR.
- 27. Amir Dirin, Ari Alamäki, and Jyrki Suomala. 2019. Digital amnesia and personal dependency in smart devices: A challenge for AI. Proceedings of Fake Intelligence Online Summit 2019 (2019).
- 37. Peter A Facione et al. 2011. Critical thinking: What it is and why it counts. Insight assessment 1, 1 (2011), 1-23.
- 38. Peter A Facione, Carol A Sanchez, Noreen C Facione, and Joanne Gainen. 1995. The disposition toward critical thinking. The Journal of General Education 44, 1 (1995), 1-25.
- 40. Mary Forehand. 2010. Bloom's taxonomy. Emerging perspectives on learning, teaching, and technology 41, 4 (2010), 47-56.
- 54. William Huitt. 2011. Bloom et al. 's taxonomy of the cognitive domain. Educa- tional psychology interactive 22 (2011), 1-4.
- 58. Hong Jiao and Robert W Lissitz. 2020. Application of Artificial Intelligence to Assessment. IAP.
- 70. Patricia M King. 1997. The reflective judgment model: Transforming assump- tions about knowing. College student development and academic life: psychologi- cal, intellectual, social, and moral issues 4 (1997), 141.
- 74. Deanna Kuhn. 1993. Connecting scientific and informal reasoning. Merrill- Palmer Quarterly (1982-) (1993), 74-103.
- 77. George Lakoff and Mark Johnson. 2008. Metaphors we live by. University of Chicago press.
- 86. Jill Burstein McCaffrey, Brian Riordan, and Daniel. 2020. Expanding Automated Writing Evaluation. In Handbook of Automated Scoring. Chapman and Hall/CRC.
- 92. Richard L Miller and William Wozniak. 2001. Counter-attitudinal advocacy: Effort vs. self-generation of arguments. Current Research in Social Psychology 6, 4 (2001), 46-55.
- 102. Samir Passi and Mihaela Vorvoreanu. 2022. Overreliance on AI literature review. Microsoft Research (2022).
- 103. Richard Paul and Linda Elder. 2020. The miniature guide to critical thinking concepts and tools (8th edition ed.). Rowman & Littlefield, Lanham, Md. OCLC: on1132213785.
- 108. Sebastian Raisch and Kateryna Fomina. 2023. Combining human and artificial intelligence: Hybrid problem-solving in organizations. Academy of Management Review ja (2023), amr-2021.
- 118. Advait Sarkar. 2024. Large Language Models Cannot Explain Themselves. In ACM CHI 2024 Workshop on Human-Centered Explainable AI (HCXAI).
- 139. Donna Wilson and Marcus Conyers. 2016. Teaching students to drive their brains: Metacognitive strategies, activities, and lesson ideas. Ascd.
Cited by
Items 201–300 of 517
‘AI veganism’: Some people’s issues with AI parallel vegans’ concerns about diet
Joyner, D. A. (2025) · The Conversation · doi:10.64628/aai.yd9kwmxgv · Cited by 1
Temp access: Reflecting on multimodal GAI as an accessibility technology for temporary disability
Glazko, K. S. (2025) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3663547.3749830 · Cited by 1
“With studies linking GAI use by students to reduce critical thinking, these concerns are not unfounded [31].”
Designing and Evaluating Generative AI Search Tools for Human Cognitive Augmentation
Guan, Z. (2026) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3786304.3787938
Colazzo, L. (2026) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3742414.3789234
Cao, H. J., Chen, M., Peng, W., & Lee, H. R. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791602 · Cited by 1
Self-citationLi, Y., Li, S., He, Z., & Wang, D. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790350
Mathews, C. W., O'Hara, K. P., Duckers, J. M., & O’Kane, A. A. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791021 · Cited by 1
“LLM-enabled chat agents could support critical thinking around CF and SRH [70], assisting both individuals and clinicians in navigating convergent health concerns.”
Pataranutaporn, P., Lee, E., Amores, J., & Maes, P. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791851 · Cited by 1
TAN, K. H. (2026) · Open Access Journal of Multidisciplinary Research · doi:10.47760/oajmr.2026.v02i09.001 · Cited by 1
A metacognitive approach to learning and performance in human-AI interaction
Fan, Y., Yan, L., Molenaar, I., Greiff, S., & Gašević, D. (2026) · Communications Psychology · doi:10.1038/s44271-026-00548-y · Cited by 1
Jung, W., Jeon, K., & Babon-Ayeng, P. (2026) · Proceedings of the 2026 ACM Sustainability Week · doi:10.1145/3765611.3815499
Ren, S. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1926110
Panchanadikar, R., Hu, Y., & Freeman, G. (2026) · Proceedings of the 2026 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3805689.3812248 · Cited by 1
“By analyzing the experiences of indie game developers, our findings reveal how generative AI systems do not merely serve as neutral productivity aids or standalone social technologies, but increasingly occupy multiple, overlapping roles within creative labor such as indie game development.”
Mine over Yours: How Authorship Biases Evaluation in Generative Information Retrieval
Ryu, J., Kim, K., Kim, S., Eun, J., Oh, C., & Suh, B. (2026) · Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3805712.3809948
“This aligns with findings that generative AI reduces critical evaluation capacity [18] and that human-AI feedback loops amplify existing biases over time [11].”
Xu, X., Zheng, S., Yang, L. F., hao, J., Wang, X., Kang, H., Ma, C., Lü, X., & Li, J. (2025) · Research Square · doi:10.21203/rs.3.rs-5606661/v1
Sztuczne inteligencje i biologiczne mózgi
Durka, P. J. (2025) · Postępy Fizyki · doi:10.61947/uw.pf.2025.76.1.3-12
“7 Ostatnie badania wydają się też potwierdzać tezę, że do tego punktu zbliżamy się z dwu stron: o ile LLM, dzięki konwersacjom z ludźmi, gromadzą coraz więcej danych, to ludzie korzystający na co dzień z narzędzi AI wydają się zatracać zdolności krytycznego myślenia [14].”
Many roads to Rome: cautious considerations on the computability of creativity
Abraham, A. (2025) · Journal of Cognitive Psychology · doi:10.1080/20445911.2025.2497322 · Cited by 2
Large Language Models and the Problem of Rhetorical DebtPreprint
MacArthur, M. J. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5208174
The Stories We Tell: A Student-Driven Systematic Analysis of Writing Center “AI” Policies
Mohan, T., Phan, V., Wilson, S., & Matzke, A. (2025) · IGI Global eBooks · doi:10.4018/979-8-3693-8059-8.ch008
“Don’t Ban, Teach”: Two Pilot Studies on AI Instruction in Business Communication
DeJeu, E. B., Walter, B. A., & Melville, M. C. (2025) · Business and Professional Communication Quarterly · doi:10.1177/23294906251336719 · Cited by 2
Philosophical Proposals for the Establishment of an Intelligent Robot Ethics Charter
Koo, K.-S., & Han, J. (2025) · The Journal of Korea Robotics Society · doi:10.7746/jkros.2025.20.2.153
Generative AI in Project-Based Learning for Sustainable Development
Hernández‐Leo, D., Theophilou, E., & Alkhasawneh, S. N. (2025) · Computer-supported collaborative learning/The Computer-Supported Collaborative Learning Conference · doi:10.22318/cscl2025.592902 · Cited by 1
AI-litteracitet och didaktik i lärarutbildningen
Stolpe, K., & Stenliden, L. (2025) · doi:10.3384/rapport-215623 · Cited by 2
Accounting research in the age of AI *Preprint
Keloharju, M., & Keloharju, R. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5335894 · Cited by 1
Generative artificial intelligence and sustainability - The challenges
Thomforde, D. W. (2025) · Work · doi:10.1177/10519815251353456
MỘT SỐ PHƯƠNG PHÁP ỨNG DỤNG TƯ DUY PHẢN BIỆN KHI SỬ DỤNG AI TẠO SINH TRONG GIÁO DỤC PHỔ THÔNG
Thùy, K. P., Ân, N. K., & Giang, V. T. (2025) · Journal of Science Educational Science · doi:10.18173/2354-1075.2025-0060 · Cited by 1
Antisera for Misconceptions Around Agentic Technology
Greenberg, A. M. (2025) · Conference on Algebraic Informatics · doi:10.1109/cai64502.2025.00210 · Cited by 1
“In so doing, the deliberator is practicing and thereby improving their faculties, including critical thinking [18] and conscientiousness, while also fostering their sense of agency in exerting it toward a decision.”
Accounting Research in the Age of AIPreprint
Keloharju, M., & Keloharju, R. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5345050 · Cited by 4
The Soul of the AI: Governance, Ethics, and the Future of Human–AI IntegrationPreprint
Mahajan, P. T. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5339891
Erslev, M. S., & Tretow-Fish, T. A. B. (2025) · Decennial Aarhus Conference · doi:10.1145/3744169.3744195 · Cited by 2
Rossi, V., Scantamburlo, T., & Melonio, A. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-98459-4_12 · Cited by 2
Perceived Impact of Integrating Artificial Intelligence in Teaching-Learning
Ablin, N. L., & Mediodia, H. B. (2025) · Psychology and Education A Multidisciplinary Journal · doi:10.70838/pemj.431006 · Cited by 7
Albert, L. R., & Son, K. (2025) · IGI Global eBooks · doi:10.4018/979-8-3373-5337-1.ch004 · Cited by 1
Mahajan, P. T. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5386814 · Cited by 5
Universities could bolster democracy by fostering students’ AI literacy
Till, L. (2025) · The Conversation · doi:10.64628/aam.u6atpgmsd
Saar, M., Ljalikova, A., Theophilou, E., Alkhasawneh, S. N., & Hernández‐Leo, D. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-03870-8_30 · Cited by 11
Pythia: Facilitating Access to Internet Data Using LLMs and IYP
Giakatos, D. P., Tashiro, M., & Fontugne, R. (2025) · Conference on Local Computer Networks · doi:10.1109/lcn65610.2025.11146364 · Cited by 3
Pang, X., Liu, C., Huang, Y. Y., Liu, M., & Liu, J. (2025) · doi:10.2196/preprints.83785
Nault, K., Nieto-Taborda, M., & Ruhi, U. (2025) · doi:10.1109/icaie64856.2025.11158527 · Cited by 1
“Despite immediate benefits to improve task outcomes and time requirements, we bring forward the concern that individuals may over-rely on AI tools without engaging cognition to advance their own awareness or knowledge [9], [10], [11], [12] of the tasks at hand.”
Williams, A. (2025) · Springer eBooks · doi:10.1007/978-3-032-02665-1_4
The Philosophical Challenges of AI: Initial Considerations
Urquieta, J. D. A., & Horne, J. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-97907-1_24
Sacconi, M. (2025) · European View · doi:10.1177/17816858251380924
“According to researchers, ‘a key irony of automation is that by mechanising routine tasks and leaving exception handling to human users, you deprive them of opportunities to exercise their judgement and strengthen their cognitive abilities’ (Lee et al. 2025, 1).”
InfluentialRickmann, J., & Tröster, V. (2025) · Zeitschrift für die gesamte Versicherungswissenschaft · doi:10.3790/zverswiss.2025.1469701
AI tools promise efficiency at work, but they can erode trust, creativity and agency
Loewen-Colón, J., & Sellick, M. (2025) · The Conversation · doi:10.64628/aam.sanhwfneq
Outsourcing Judgment: Hidden Anxieties and the Rise of Cognitive Offloading in the Age of AI
Gerlich, M. (2025) · Springer proceedings in business and economics · doi:10.1007/978-3-032-07163-7_3 · Cited by 2
History-grounded Design Speculation as a Method for AIImpact Anticipation
Lupetti, M. L., van der Maden, W., Sanni, J., Martinez, L., Cavallin, E., Cangiano, S., Mela, A., & Murray-Rust, D. (2025) · Biannual Conference of the Italian SIGCHI Chapter (CHItaly) · doi:10.1145/3750069.3750151
“Recent studies, for instance, have found that integrating AI in work pipelines, i.e., for coding and other types of knowledge work, can lead to a reduction of personal confidence [50] and lower enactment of critical thinking [40].”
Investigating the Division of Labour in Student-AI-Collaboration on Critical Thinking Tasks
Seufert, S., Rohwer, K., & Zimmermann, A. (2025) · IEEE International Conference on Advanced Learning Technologies (ICALT) · doi:10.1109/icalt64023.2025.00079 · Cited by 1
Teaching Machine Learning to Undergraduate Electrical Engineering Students
Fudge, G. L., Rimu, A. J., Zorn, W., Ringle, J., & Barnett, C. (2025) · Computers · doi:10.3390/computers14110465 · Cited by 4
“However, using generative AI as a tool to improve productivity has some significant drawbacks, including (1) reliability due to the possibility of hallucinations as discussed earlier, (2) potential negative impact on critical thinking skills [15,48], and (3) intellectual property (IP) concerns [13].”
Teaching Skills and Intellectual Virtues with Generative AI
Naeem, H. (2025) · Episteme · doi:10.1017/epi.2025.10089 · Cited by 7
“While education aims to teach students intellectual skills, relying on generative AI is deskilling them (Sternberg 2024; Krook 2025; Ahmad et al. 2023; Zhai et al. 2024; Shukla et al. 2025; Lee et al. 2025; Laak et al. 2024; Cassinadri 2024; Kasneci et al. 2023).”
A Meta-Model Analysis of Students’ Autonomous Interaction With General-Purpose LLMs
Cloux, M., Monticolo, D., & Bary, R. (2025) · International Generative AI and Computational Language Modelling Conference (GACLM) · doi:10.1109/gaclm67198.2025.11232237
Mitrevska, T., Kobiella, C., Feckl, J., Sakel, S., Butz, A. M., & Schneegass, C. (2025) · Australian Conference on Human-Computer Interaction (OzCHI) · doi:10.1145/3764687.3764696 · Cited by 2
From mechanics to meaning: Designing writing assignments in political science education
Pittoors, G. (2025) · Politics · doi:10.1177/02633957251393144
Verantwortungsvoller Umgang mit KI: Wir brauchen ein gemeinsames (Spiel-)Verständnis
Coester, U., & Anderle, L. (2025) · Springer eBooks · doi:10.1007/978-3-658-46399-1_42-1
Putra, M. A. P., Suyasa, I. P. B., Artana, I. M., & Utami, N. W. (2025) · International Journal of Advances in Data and Information Systems · doi:10.59395/ijadis.v6i3.1407 · Cited by 1
Ma, Q., Chai, M., Tan, Y., Choi, J., Kim, J., Harpstead, E., Kauffman, G., & Wu, T. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-29763-1 · Cited by 3
From Essay to AI-Augmented Writing: Reframing Pedagogy and Feedback Through the AAWP ModelPreprint
Askari, M., & Rahim, A. S. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5771957
Generative AI and IT Professionals: Work Tasks and Ethical Reflections
Spens, A.-S. F., Mikkelsen, K. G., Lykke, M., & Svarre, T. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-26717-7_18
Sustainable Urban Mobility: Co-Designing a Responsible AI Recommender System
Patelli, A., Ekárt, A., Chli, M., Ferariu, L.-E., Hamilton, J. R., Kanyi, M., Lee, R., Lewis, P., Lumsden, J., & Owen, S. (2025) · International Conference on Information Technology for Social Good (GoodIT) · doi:10.1145/3748699.3749783
“…systematic ways of co-creating responsible AI has been addressed from relevant yet disjointed perspectives such as explainability [31], environmental sustainability [22], and impact on cognition [12, 20], integrated approaches that tackle the problem from a holistic standpoint are relatively rare.”
Evaluating LLM “Research Assistants” and Their Risks for Novice Researchers
DeRewal, T. (2025) · Critical AI · doi:10.1215/2834703x-12095982 · Cited by 7
Keyframer: A Design Probe for Exploring LLM Assistance in 2D Animation Design
Tseng, T., Cheng, R., McNutt, A. M., & Nichols, J. W. (2025) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vl-hcc65237.2025.00014 · Cited by 3
“However, recent work has demonstrated how the use of LLMs more broadly might contribute to homogenization of creative output or a reduction in critical thinking [32], especially when LLMs present ‘complete-seeming’ ideas [33, 34], which we argue automated approaches to animation lean towards.”
Moon, J., Choi, Y., Hong, J.-H., & Kim, K.-J. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2596857 · Cited by 3
“…costs for some participants by offloading early semantic arrangement, a pattern consistent with recent field evidence that GenAI often shifts cognitive effort away from material production toward oversight and integration while decreasing perceived effort for many activities (Lee et al., 2025).”
Perceived Effects of Artificial Intelligence on Students' Learning Efficiency in Social Studies 10
Antonio, B. M., Ebora, R., & Reyes, J. (2025) · Psychology and Education A Multidisciplinary Journal · doi:10.70838/pemj.510404
Çakmak, R. N., & Baydere, M. (2025) · Çeviribilim ve Uygulamaları Dergisi · doi:10.37599/ceviri.1793812
How AI Is Shaping Society and Why We Must Keep It at Bay!
Matthies, D. J. C., Schlonsak, R., & Gabrecht, M. T. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-13312-0_3
A.I.’s Impact on Nursing Practice and Care
Walker, R., Khastar, S. M., Kuehnle, F., & Shen, M. (2026) · Springer eBooks · doi:10.1007/978-3-032-12402-9_6
Locally Hosted DeepSeek and Llama3.2 Code Generation and Computer Science Pedagogy
Wolfer, J. (2025) · Experiment@International Conference · doi:10.1109/exp.at2565440.2025.11348352
“2 and DeepSeek, used the 1 Listings placed at end of document for readability same sequence of numbers to sort in their respective example programs: 64,34,25,12,22,11,90.”
Two Years to Madness: A 30-Month Journal of Human–Machine Communication and Second-Hand Reality
Prahl, A. (2026) · Human-Machine Communication · doi:10.30658/hmc.12.4
“In a survey of knowledge workers, the more confident employees felt in ChatGPT’s answers, the less mental effort they invested in independent analysis (Lee et al., 2025 ).”
Betting blind on AI and the scientific mind
Requarth, T. (2026) · The Transmitter · doi:10.53053/ulvj2180
AI's Potential Impact on Critical Thinking and Creativity in Online Higher Education
Register, A. D., & Cooper, L. J. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-9195-3.ch002
Generative AI in Design Education: Pedagogical Uses and Critical Thinking
Bouchereau, A. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-17557-1_1
Encounters between Artificial and Human Intelligences in Early‐Stage Innovation Work
Notini, W., Kochoska, A., & Perkel, D. (2025) · Ethnographic Praxis in Industry Conference Proceedings · doi:10.1111/epic.70015
The Evolving World of Enterprise Knowledge Management: History, Implications, and Emerging Issues
O’Leary, D. E., French, A. M., & Storey, V. C. (2026) · Knowledge management and organizational learning · doi:10.1007/978-3-032-14721-9_4
Collaborating with AI as a Team Member in Qualitative Research Analysis
Barnard, K., Han, Q., Louch, E., & Raijmakers, B. (2025) · Ethnographic Praxis in Industry Conference Proceedings · doi:10.1111/epic.70001
On the Dangers of Large‐Language Model Mediated Learning for Human Capital
Lindebaum, D., Nolan, E., & Swart, J. (2026) · Human Resource Management Journal · doi:10.1111/1748-8583.70036 · Cited by 2
Rizvi, S. W. F., Yankouskaya, A., Alshakhsi, S. A. A., Al‐Thani, D., & Ali, R. (2025) · International Conference on Foundation and Large Language Models (FLLM) · doi:10.1109/fllm67465.2025.11391019
“This can become a concern as higher confidence in the result produced by an LLM is associated with reduced critical thinking [13].”
Expertise, opacity, and trust in AI systems
Boisseau, É. (2026) · Synthese · doi:10.1007/s11229-026-05484-2 · Cited by 3
“…(2009 ) refer to this first risk when they express the fear – rightly and increasingly dis - cussed today in the context of generative AI (see also Friedman & Kahn, 1992; and more recently; Lee et al., 2025) – of a loss of capacity on the part of the people who rely excessively on these systems.”
Tres reflexiones éticas y prácticas sobre cómo usar la inteligencia artificial en educación
Cardoso, M. E. (2025) · Signo y Pensamiento · doi:10.11144/javeriana.syp44.trep
From essay to AI-augmented writing: reframing pedagogy and feedback through the AAWP model
Askari, M., & Rahim, A. S. (2026) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2026.2638914 · Cited by 1
Ruffin, M. A., Davenport, M. K., & Beier, M. E. (2026) · Behaviour and Information Technology · doi:10.1080/0144929x.2026.2638916
Pang, X., Liu, C., Huang, Y., Liu, M., & Liu, J. (2026) · JMIR Medical Informatics · doi:10.2196/83785
“Overreliance may lead to cognitive offloading, impairing learners’ ability to critically evaluate artificial intelligence–generated outputs [9-12]—a particularly concerning issue in medical education, where independent clinical reasoning is essential.”
Scott, I. K. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6353318 · Cited by 1
Chapman, R. M., Chapman, C., Johnson, H. E., & Chapman, D. D. (2026) · AI · doi:10.3390/ai7030106 · Cited by 2
Pompei, A., Battistella, C., & Nonino, F. (2026) · International Journal of Managing Projects in Business · doi:10.1108/ijmpb-10-2025-0451 · Cited by 3
Motivators and detractors to integration of the user AI experience
Mueller, T. S. (2026) · Advances in Computational Intelligence · doi:10.1007/s43674-026-00088-2
“Higher self-confidence is related to increased critical thinking (Lee et al. 2025).”
Allen, B. H., Figueras, H., Therrien, M. C. S., & Wood, C. L. (2026) · Perspectives of the ASHA Special Interest Groups · doi:10.1044/2026_persp-25-00197 · Cited by 1
Goglin, C. (2026) · RIMHE Revue Interdisciplinaire Management Homme(s) & Entreprise · doi:10.3917/rimhe.061.0079
Broussard, M. J. S. (2026) · Internet Reference Services Quarterly · doi:10.1080/10875301.2026.2651693 · Cited by 1
AI-Enabled Learning and Critical Thinking: A Study among Indian Engineering Students
Singh, M., & Kumar, D. (2026) · IEEE International Conference on Interdisciplinary Approaches in Technology and Management for Social Innovation (IATMSI) · doi:10.1109/iatmsi68868.2026.11465949
“Generative AI, including models like Generative Pretrained Transformers (e.g., GPT-3, GPT-4), is leading a transformative change in 979-8-3315-4970-1/26/$31.00 ©2026 IEEE education by using machine learning methods to produce replies and material derived from extensive training data [2].”
InfluentialHow Could AI Supply Chain Research Shape HCI Inquiries And Vice-Versa?
Cha, I., Widder, D. G., Attard-Frost, B., Singh, J., & Balayn, A. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3778800
Zhang, Z. T., von Felten, N., Reicherts, L., Tankelevitch, L., Guan, Z., Rintel, S., Fu, Y., He, J., Holstein, K., Sarkar, A., et al. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3778733
Self-citationGlanceable Verification Indicators for AI-Assisted Storytelling
Xu, M., Zhao, Z., Zeng, J., Wang, T. Y., Panetta, F., Fiebrink, R. A., Bryan–Kinns, N., & Grierson, M. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3798491
“Under deadline pressure or when tasks are perceived as lower-stakes, users risk reduced critical engagement and verification effort [26, 46].”
InfluentialFrom Workslop to Work: How AI Explanations Reconfigure Human Judgment in Creative Tasks
Lim, S., & Jun, S. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3798328 · Cited by 1
“Furthermore, recent work demonstrates that AI assistance can reduce perceived mental effort while simultaneously producing metacognitive calibration issues [12], and that structured or partial explanations can reshape decision behavior and reduce overreliance [4, 6, 23].”
Diefenbach, S., Ullrich, D., & Veihelmann, M. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3798582
Chick, J. (2026) · Journal of Transformative Education · doi:10.1177/15413446261442461 · Cited by 3
Participatory, not Punitive: Student-Driven AI Policy Recommendations in a Design Classroom
Seki, K., Vijay, M., & Kotturi, Y. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790691 · Cited by 3
Wei, J., & Nishimoto, K. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791355 · Cited by 2
“In HCI research, most cognitive assistance studies focus on technical implementation or average effects while rarely considering individual cognitive differences as moderators [10, 17, 23, 34, 69].”
Beyond the Black Box: Equipping Users to Recognize and Challenge AI Bias in Hiring
Volini, E., Lemmon, G., & Hwang, Y. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2650563 · Cited by 1
Metadata
- Authors
- Lee, H.-P. (., Sarkar, A., Tankelevitch, L., Drosos, I., Rintel, S., Banks, R., & Wilson, N.
- Affiliations
- Carnegie Mellon University (US)
- Microsoft Research (United Kingdom) (GB)
- ORCID
- Venue
- Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2025-04-25
- Pages
- 1-22
- OpenAlex
- W4409885395
- Cited by
- 490
- References
- 118
- Citations by year
- 2026: 328 · 2025: 166
- FWCI
- 573.88
- Type
- conference paper
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Social Sciences › Education › Education and Critical Thinking Development
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Keywords
- generative AI, critical thinking, knowledge workers, self-confidence, cognitive effort, fact-checking, response integration, AI tool design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-28, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-28 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

