The Impact of Generative AI on Critical Thinking: Self-Reported Reductions in Cognitive Effort and Confidence Effects From a Survey of Knowledge Workers
Open accessThe DOI matches its Crossref record; 132 of the 132 references it cites were found in a registry or an index; 23 of the 39 sources its claims cite were checked for support.
Abstract
The rise of Generative AI (GenAI) in knowledge workflows raises questions about its impact on critical thinking skills and practices.We survey 319 knowledge workers to investigate 1) when and how they perceive the enaction of critical thinking when using GenAI, and 2) when and why GenAI affects their effort to do so.Participants shared 936 first-hand examples of using GenAI in work tasks.Quantitatively, when considering both task-and user-specific factors, a user's task-specific self-confidence and confidence in GenAI are predictive of whether critical thinking is enacted and the effort of doing so in GenAI-assisted tasks.Specifically, higher confidence in GenAI is associated with less critical thinking, while higher self-confidence is associated with more critical thinking.Qualitatively, GenAI shifts the nature of critical thinking toward information verification, response integration, and task stewardship.Our insights reveal new design challenges and opportunities for developing GenAI tools for knowledge work.
Overview
CoChat Summary
TL;DR
A survey of 319 knowledge workers who use GenAI at work at least weekly, drawing on 936 real-world examples, finds that higher confidence in GenAI is associated with less critical thinking, while higher self-confidence is associated with more. GenAI also shifts perceived critical-thinking effort toward information verification, response integration, and task stewardship.
Key findings
- Participants reported enacting critical thinking in 555 of 936 examples (59.29%). Higher confidence in AI doing the task negatively correlated with perceived enaction of critical thinking (β = -0.69, p < 0.001); confidence in doing the task oneself (β = 0.26, p = 0.026), confidence in evaluating AI responses (β = 0.31, p = 0.046), and overall tendency to reflect on work (β = 0.52, p < 0.001) positively correlated with perceived enaction.
- Perceived effort decreased in the majority of examples: “much less effort” or “less effort” comprised 72% for Knowledge, 79% for Comprehension, 69% for Application, 72% for Analysis, 76% for Synthesis, and 55% for Evaluation. Higher confidence in AI negatively correlated with perceived effort for five of six activities (all except Application): Knowledge (β = -0.11, p = 0.029), Comprehension (β = -0.13, p = 0.014), Analysis (β = -0.15, p = 0.003), Synthesis (β = -0.12, p = 0.026), and Evaluation (β = -0.23, p < 0.001).
- Qualitatively, GenAI shifted critical-thinking effort in three ways: for Knowledge and Comprehension, from information gathering to information verification; for Application, from problem-solving to AI response integration; and for Analysis, Synthesis, and Evaluation, from task execution to task stewardship.
- Motivators for critical thinking included work quality (74/319), potential negative outcomes (116/319), and skill development (13/319). Inhibitors included awareness barriers such as secondary use of GenAI (14/319), trivial tasks (55/319), and trust/reliance on GenAI (83/319); motivation barriers such as lack of time (44/319) and not being part of job responsibilities (11/319); and ability barriers such as barriers to inspecting AI responses (58/319) and revising queries/improving responses (72/319).
Methods
- Online survey on Prolific of 319 knowledge workers who self-reported using GenAI tools at work at least once per week. The study received 333 responses and excluded 14 for low response quality; retained participants spent an average of 43.19 minutes (SD = 23.13) completing the survey and were compensated GBP £10.
- Participants shared three real-world GenAI work examples each. The study collected 957 examples, removed 11 lacking sufficient detail and 11 duplicated or non-GenAI examples, retaining 936: 374 Creation (39.96%), 303 Information (32.37%), and 259 Advice (27.67%).
- Quantitative analysis used one random-intercepts logistic regression for perceived enaction of critical thinking and six random-intercepts linear regressions for perceived effort across Bloom’s taxonomy activities, with Participant ID as a random intercept. Benjamini-Hochberg correction was applied across 98 hypothesised predictors, yielding a corrected p-value threshold of 0.007. Qualitative analysis used open coding of free-text responses; one researcher initially coded 50 responses with three others to build a codebook, then two researchers coded the remaining 269 responses.
Limitations
- The paper states that participants occasionally conflated reduced effort in using GenAI with reduced effort in critical thinking with GenAI, potentially leading to inaccurate self-reporting; future studies could use think-aloud protocols or task-based assessments.
- The paper states that subjective task confidence may not be well-calibrated with objective expertise, and that the survey was English-only, with no representation of non-English-speaking or multilingual contexts.
- The paper states that the sample was biased toward younger, more technologically skilled participants who use GenAI at work at least weekly, and that GenAI tools are constantly evolving; the task taxonomy was coarse-grained, and future longitudinal or telemetry/experience-sampling work is suggested. The text also makes evident that the analysis does not establish causation, as the paper itself notes.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
12 Valid · 5 Not valid · 9 Not checked · 146 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“These findings suggest that a reflective approach toward the use of GenAI tools, which can lead to what prior work refers to as”
§ The Impact of Generative AI on Critical Thinking: Self-Reported Reductions in Cognitive Effort and Confidence Effects From a Survey of Knowledge Workers > 4.2.1 Task Factors.
What the sources say
- Partly supportedcites [20] 20. Valerie Chen, Q. Vera Liao, Jennifer Wortman Vaughan, and Gagan Bansal. 2023. Understanding the Role of Human Intuition on Reliance in Human- AI Decision-Making with Explanations. Proceedings of the ACM on Human- Computer Interaction 7, CSCW2 (Sept. 2023), 1-32. https://doi.org/10.1145/ 3610219 sourceExperimental — accuracy not yet measured
Section 4.1 (page unavailable) reports that participants with strong intuition sometimes discounted an AI prediction, supporting a link between confidence in their own judgment and critical use of AI. But it also says they sometimes decided quickly without checking explanations when the AI agreed with them. The study concerns two AI-assisted prediction tasks, not GenAI use by knowledge workers, and does not establish the claim’s general likelihood comparison. (LLM, conf=0.86)
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on 2 assumptions not shown here.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Quantitatively, when considering both task-and user-specific factors, a user's task-specific self-confidence and confidence in GenAI are predictive of whether critical thinking is enacted and the effort of doing so in GenAI-assisted tasks.”
§ The Impact of Generative AI on Critical Thinking: Self-Reported Reductions in Cognitive Effort and Confidence Effects From a Survey of Knowledge Workers > Abstract
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Specifically, higher confidence in GenAI is associated with less critical thinking, while higher self-confidence is associated with more critical thinking.”
§ The Impact of Generative AI on Critical Thinking: Self-Reported Reductions in Cognitive Effort and Confidence Effects From a Survey of Knowledge Workers > Abstract
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The data shows a shift in cognitive effort as knowledge workers increasingly move from task execution to oversight when using GenAI.”
§ The Impact of Generative AI on Critical Thinking: Self-Reported Reductions in Cognitive Effort and Confidence Effects From a Survey of Knowledge Workers > 1 Introduction
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the study reveals that knowledge workers engage in critical thinking when using GenAI tools primarily to ensure the quality of their work.”
§ The Impact of Generative AI on Critical Thinking: Self-Reported Reductions in Cognitive Effort and Confidence Effects From a Survey of Knowledge Workers > 1 Introduction
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
78 more claims
Create a free account to see all 172 claims and every source verdict.
- Probably not a substantial claim. 68
- It may state two separate claims as one. 35
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“our findings show that GenAI may undermine students’ motivation to engage in the cognitive effort that is necessary for deeper intellectual enjoyment (contra Lee et al., 2025; see also Stadler et al., 2024).”
From If ChatGPT can do it, where is my creativity? generative AI boosts performance but diminishes experience in creative writing (2025) · cites this paper as Lee et al., 2025
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“We might also be concerned about mechanised convergence in the increased use of GenAI; that AI generation tends to result in less diverse textual output (Lee et al., 2025).”
From If ChatGPT can do it, where is my creativity? generative AI boosts performance but diminishes experience in creative writing (2025) · cites this paper as Lee et al., 2025
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Further, GenAI tools can increase developers' perceived productivity [Ziegler et al. 2024] and level of understanding [Prather et al. 2024] without delivering actual improvements, potentially leading to a false sense of confidence [Lee et al. 2025] among novices.”
From How Do Programming Students Use Generative AI? (2025) · cites this paper as Lee et al. 2025
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Lee et al. [8] found that professionals using GenAI tools reported reduced cognitive effort but increased confidence in the quality of their outputs, revealing a mismatch between perceived and actual engagement.”
From From Offloading to Engagement: An Experimental Study on Structured Prompting and Critical Reasoning with Generative AI (2025) · cites this paper as [8]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In the present study, this same pattern was evident in the unguided condition. Although participants often believed they had 'used AI to check their ideas,' interview data revealed that many had in fact accepted the AI's structure wholesale.”
From From Offloading to Engagement: An Experimental Study on Structured Prompting and Critical Reasoning with Generative AI (2025) · cites this paper as Lee et al. [8]
Experimental — accuracy not yet measured
20 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482 · cited 1×
“To correct for multiple comparisons, we apply the Benjamini–Hochberg procedure [9] with a total of 98 hypothesised predictors across the seven models, yielding a corrected p-value threshold of 0.007.”
InfluentialBasics of Qualitative Research
Ozanne, J. L., Strauss, A., & Corbin, J. (1992) · Journal of Marketing Research · doi:10.2307/3172751 · Cited by 17,850
Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-019-0171-0 · Cited by 7,242 · cited 1×
“To mitigate this, using GenAI for individualised, content-focused feedback may help novice writers develop writing skills while improving productivity [58, 86, 144].”
Binder, J. R., Desai, R. H., Graves, W. W., & Conant, L. L. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhp055 · Cited by 4,060 · cited 1×
“Cognitive science shows that effective learning requires “grounding” information through multiple perspectives and examples [10, 11, 68], and GenAI can offer personalised analogies to aid this process [77, 90].”
Dewey, J. (1910) · D C Heath eBooks · doi:10.1037/10903-000 · Cited by 3,998
Human trust in artificial intelligence: Review of empirical research
Glikson, E., & Woolley, A. W. (2020) · Academy of Management Annals · doi:10.5465/annals.2018.0057 · Cited by 2,921 · cited 1×
“We measure participants’ overall trust in GenAI, which has been shown to correlate with users’ attitudes and adoption of the use of the technologies [43, 76].”
Experimental Evidence on the Productivity Effects of Generative Artificial Intelligence
Noy, S., & Zhang, W. (2023) · doi:10.2139/ssrn.4375283 · Cited by 2,157
The neurobiology of semantic memory
Binder, J. R., & Desai, R. H. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.10.001 · Cited by 2,114 · cited 1×
“Cognitive science shows that effective learning requires “grounding” information through multiple perspectives and examples [10, 11, 68], and GenAI can offer personalised analogies to aid this process [77, 90].”
Principles of mixed-initiative user interfaces
Horvitz, E. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.303030 · Cited by 1,490 · cited 1×
“Proactive systems take the initiative [52] to interrupt the user to highlight the need and opportunity for critical thinking in situations where it is likely to be overlooked; a reactive approach would allow the user to explicitly request critical thinking assistance when it is consciously needed.”
Generative artificial intelligence enhances creativity but reduces the diversity of novel content
Doshi, A., & Hauser, O. (2023) · doi:10.2139/ssrn.4535536 · Cited by 1,350
McDonald, N., Schoenebeck, S., & Forte, A. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359174 · Cited by 1,206
Buçinca, Z., Malaya, M. B., & Gajos, K. Z. (2021) · arXiv · doi:10.48550/arxiv.2102.09692 · Cited by 1,124
Ennis, R. H. (1993) · Theory Into Practice · doi:10.1080/00405849309543594 · Cited by 1,101 · cited 1×
“Critical thinking can be measured through self, peer-, or expert evaluation [66], us-ing a range of questionnaires [35, 65, 73, 145, 146], justified multiple choice questions, structured essays, protocols for whole-portfolio assessment, task observation, and peer interaction [34, 105].”
Retrieval Practice Produces More Learning than Elaborative Studying with Concept Mapping
Karpicke, J. D., & Blunt, J. R. (2011) · Science · doi:10.1126/science.1199327 · Cited by 1,019 · cited 1×
“Research shows that summarising material and follow-up writing practice enhance memory by integrating new knowledge with existing knowledge [62, 93, 134], but real-world summary writing is often passive and ineffective [15, 16, 41, 121, 140], and thus may not improve recall in comparison to simply…”
Kiefer, M., & Pulvermüller, F. (2012) · Cortex · doi:10.1016/j.cortex.2011.04.006 · Cited by 869 · cited 1×
“Cognitive science shows that effective learning requires “grounding” information through multiple perspectives and examples [10, 11, 68], and GenAI can offer personalised analogies to aid this process [77, 90].”
Training writing skills: a cognitive developmental perspective
Kellogg, R. T. (2008) · Journal of Writing Research · doi:10.17239/jowr-2008.01.01.1 · Cited by 868 · cited 1×
“However, there are concerns that novice writers may become overly reliant on these tools, potentially impairing their long-term skill development by bypassing critical writing processes such as constructing logical arguments and understanding subject matter [14, 53, 63, 64].”
Critical Thinking: Why Is It so Hard to Teach?
Willingham, D. T. (2008) · Arts Education Policy Review · doi:10.3200/aepr.109.4.21-32 · Cited by 865
Coming of age: A review of embodiment and the neuroscience of semantics
Meteyard, L., Cuadrado, S. R., Bahrami, B., & Vigliocco, G. (2012) · Cortex · doi:10.1016/j.cortex.2010.11.002 · Cited by 862 · cited 1×
“Cognitive science shows that effective learning requires “grounding” information through multiple perspectives and examples [10, 11, 68], and GenAI can offer personalised analogies to aid this process [77, 90].”
Development of a Questionnaire to Measure the Level of Reflective Thinking
Kember, D., Leung, D. Y. P., Jones, A., Loke, A. Y., McKay, J., Sinclair, K., Tse, H., Webb, C., Yuet Wong, F. K., Wong, M., et al. (2000) · Assessment & Evaluation in Higher Education · doi:10.1080/713611442 · Cited by 812 · cited 2×
“We use Kember et al. [65]’s Reflec-tive Thinking Inventory to measure participants’ baseline tendency to think reflectively.”
Concept mapping, mind mapping and argument mapping: what are the differences and do they matter?
Davies, M. (2011) · Higher Education · doi:10.1007/s10734-010-9387-6 · Cited by 771 · cited 1×
“Despite concerns about whether critical thinking can be taught [138], research in education has developed a number of approaches to teaching critical thinking [104, 139], such as structured argumentation exercises [25, 70, 72, 133].”
An integrated critical thinking framework for the 21st century
Dwyer, C. P., Hogan, M. J., & Stewart, I. (2014) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2013.12.004 · Cited by 765
Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
(2023) · doi:10.1145/3544548 · Cited by 735
Macrorules for summarizing texts: the development of expertise
Brown, A. L., & Day, J. D. (1983) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(83)80002-4 · Cited by 711 · cited 1×
“…material and follow-up writing practice enhance memory by integrating new knowledge with existing knowledge [62, 93, 134], but real-world summary writing is often passive and ineffective [15, 16, 41, 121, 140], and thus may not improve recall in comparison to simply re-reading the text [124].”
Factors That Influence Skill Decay and Retention: A Quantitative Review and Analysis
Arthur Jr., W., Bennett Jr., W., Stanush, P. L., & McNelly, T. L. (1998) · Human Performance · doi:10.1207/s15327043hup1101_3 · Cited by 664 · cited 1×
“Without regular practice in common and/or low-stakes scenarios, cognitive abilities can deteriorate over time [5], and thus create risks if high-stakes scenarios are the only opportunities available for exercising such abilities.”
Facione, N. C., Facione, P. A., & Sanchez, C. A. (1994) · Journal of Nursing Education · doi:10.3928/0148-4834-19941001-05 · Cited by 626 · cited 1×
“Critical thinking can be measured through self, peer-, or expert evaluation [66], us-ing a range of questionnaires [35, 65, 73, 145, 146], justified multiple choice questions, structured essays, protocols for whole-portfolio assessment, task observation, and peer interaction [34, 105].”
A Confessional Account of an Ethnography About Knowledge Work1
Schultze, U. (2000) · MIS Quarterly · doi:10.2307/3250978 · Cited by 568 · cited 1×
“GenAI tools like ChatGPT and Copilot can mitigate these drawbacks, especially for less experienced learners, by providing high-quality summaries upon which collaborative, self-monitored writing tasks can be conducted [120, 125].”
Abbas, M., Jam, F. A., & Khan, T. I. (2024) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-024-00444-7 · Cited by 531
The Metacognitive Demands and Opportunities of Generative AI
Tankelevitch, L., Kewenig, V., Simkute, A., Scott, A. E., Sarkar, A., Sellen, A., & Rintel, S. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642902 · Cited by 493
Self-citationA four‐category scheme for coding and assessing the level of reflection in written work
Kember, D., McKay, J., Sinclair, K., & Wong, F. K. Y. (2008) · Assessment & Evaluation in Higher Education · doi:10.1080/02602930701293355 · Cited by 444 · cited 1×
“Critical thinking can be measured through self, peer-, or expert evaluation [66], us-ing a range of questionnaires [35, 65, 73, 145, 146], justified multiple choice questions, structured essays, protocols for whole-portfolio assessment, task observation, and peer interaction [34, 105].”
On the cognitive process of human problem solving
Wang, Y., & Chiew, V. (2010) · Cognitive Systems Research · doi:10.1016/j.cogsys.2008.08.003 · Cited by 378 · cited 1×
“Our analysis is based primarily on workflow characterisations from previous work [29, 46, 130], though more general frameworks for human cognitive problem solving [137] and problem solving with AI [60, 89, 108] are also related.”
Johnston, H., Wells, R. F., Shanks, E. M., Boey, T., & Parsons, B. N. (2024) · International Journal for Educational Integrity · doi:10.1007/s40979-024-00149-4 · Cited by 363
Thinking Critically about Critical Thinking
MULNIX, J. W. (2012) · Educational Philosophy and Theory · doi:10.1111/j.1469-5812.2010.00673.x · Cited by 333
The brain in your pocket: Evidence that Smartphones are used to supplant thinking
Barr, N., Pennycook, G., Stolz, J. A., & Fugelsang, J. A. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2015.02.029 · Cited by 327 · cited 2×
“This reliance on AI can be seen as a form of cognitive offloading [8], where users depend on AI to perform tasks they feel less confident in handling themselves.”
The marks are on the knowledge worker
Kidd, A. (1994) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/191666.191740 · Cited by 325 · cited 1×
“Moreover, we focus on critical thinking for knowledge work (as conceptualised by Drucker [30] and Kidd [67]).”
Bainbridge, L. (1982) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)62897-0 · Cited by 321
Nguyen, Q. D., Fernandez, N., Karsenti, T., & Charlin, B. (2014) · Medical Education · doi:10.1111/medu.12583 · Cited by 305 · cited 1×
“Critical thinking skills can be developed in sequential stages [70, 98, 104].”
Strategic Difficulties in Summarizing Texts
Winograd, P. N. (1984) · Reading Research Quarterly · doi:10.2307/747913 · Cited by 296 · cited 1×
“…material and follow-up writing practice enhance memory by integrating new knowledge with existing knowledge [62, 93, 134], but real-world summary writing is often passive and ineffective [15, 16, 41, 121, 140], and thus may not improve recall in comparison to simply re-reading the text [124].”
Bredemeier, H. C., & Drucker, P. F. (1959) · American Sociological Review · doi:10.2307/2088600 · Cited by 274
Improving the writing skills of college students
Kellogg, R. T., & Raulerson, B. A. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194058 · Cited by 270 · cited 1×
“However, there are concerns that novice writers may become overly reliant on these tools, potentially impairing their long-term skill development by bypassing critical writing processes such as constructing logical arguments and understanding subject matter [14, 53, 63, 64].”
Chong, L., Zhang, G., Goucher-Lambert, K., Kotovsky, K., & Cagan, J. (2022) · Computers in Human Behavior · doi:10.1016/j.chb.2021.107018 · Cited by 262
The Development of Plans for Summarizing Texts
Brown, A. L., Day, J. D., & Jones, R. S. (1983) · Child Development · doi:10.2307/1129901 · Cited by 240 · cited 1×
“…material and follow-up writing practice enhance memory by integrating new knowledge with existing knowledge [62, 93, 134], but real-world summary writing is often passive and ineffective [15, 16, 41, 121, 140], and thus may not improve recall in comparison to simply re-reading the text [124].”
Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with Explanations
Chen, V., Liao, Q. V., Wortman Vaughan, J., & Bansal, G. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3610219 · Cited by 220
Bainbridge, L. (1983) · Analysis, Design and Evaluation of Man–Machine Systems · doi:10.1016/b978-0-08-029348-6.50026-9 · Cited by 219
Summary Street: Interactive Computer Support for Writing
Wade-Stein, D., & Kintsch, E. (2004) · Cognition and Instruction · doi:10.1207/s1532690xci2203_3 · Cited by 203 · cited 1×
“Research shows that summarising material and follow-up writing practice enhance memory by integrating new knowledge with existing knowledge [62, 93, 134], but real-world summary writing is often passive and ineffective [15, 16, 41, 121, 140], and thus may not improve recall in comparison to simply…”
The Widening Gap: The Benefits and Harms of Generative AI for Novice Programmers
Prather, J., Reeves, B. N., Leinonen, J., MacNeil, S., Randrianasolo, A. S., Becker, B. A., Kimmel, B., Wright, J., & Briggs, B. (2024) · Proceedings of the 2024 ACM Conference on International Computing Education Research - Volume 1 · doi:10.1145/3632620.3671116 · Cited by 196
The Widening Gap: The Benefits and Harms of Generative AI for Novice Programmers
Prather, J., Reeves, B., Leinonen, J., MacNeil, S., Randrianasolo, A. S., Becker, B., Kimmel, B., Wright, J., & Briggs, B. (2024) · arXiv · Cited by 196
AI makes you smarter but none the wiser: The disconnect between performance and metacognition
Fernandes, D., Villa, S., Nicholls, S., Haavisto, O., Buschek, D., Schmidt, A., Kosch, T., Shen, C., & Welsch, R. (2025) · Computers in Human Behavior · doi:10.1016/j.chb.2025.108779 · Cited by 185 · cited 1×
“Still, one’s subjective self-confidence may not always be well-calibrated with respect to objective expertise on tasks [39, 130].”
It’s a Trap! Instructional Manipulation Checks Prompt Systematic Thinking on “Tricky” Tasks
Hauser, D. J., & Schwarz, N. (2015) · Sage Open · doi:10.1177/2158244015584617 · Cited by 168 · cited 1×
“…rather than statements improves logical discernment [24], questions also improve critical reading [110, 142], attention checks promote systematic thinking [49], conflict-filled discussion induces critical thinking [78], and in general increased engagement results in behavioural changes [82, 92].”
Joksimovic, S., Ifenthaler, D., Marrone, R., De Laat, M., & Siemens, G. (2023) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2023.100138 · Cited by 152 · cited 1×
“Our analysis is based primarily on workflow characterisations from previous work [29, 46, 130], though more general frameworks for human cognitive problem solving [137] and problem solving with AI [60, 89, 108] are also related.”
ArgueTutor: An Adaptive Dialog-Based Learning System for Argumentation Skills
Wambsganss, T., Kueng, T., Soellner, M., & Leimeister, J. M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445781 · Cited by 138 · cited 3×
“Generative AI tools like Copilot and Chat-GPT can boost writing productivity by assisting with tasks such as content generation, idea creation, and stylistic editing, helping both expert and novice writers [18, 84, 112, 135].”
Human Reliance on Machine Learning Models When Performance Feedback is Limited: Heuristics and Risks
Lu, Z., & Yin, M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445562 · Cited by 131
Automated Writing Evaluation Tools in the Improvement of the Writing Skill
Assoc. Prof. Faculty of Education, L. D., Parra G., L., Calero S., X., & Assoc. Prof. Faculty of Education, L. D. (2019) · International Journal of Instruction · doi:10.29333/iji.2019.12214a · Cited by 123
Human-Centered Explainable AI (HCXAI): Beyond Opening the Black-Box of AI
Ehsan, U., Wintersberger, P., Liao, Q. V., Watkins, E. A., Manger, C., Daumé III, H., Riener, A., & Riedl, M. O. (2022) · CHI Conference on Human Factors in Computing Systems Extended Abstracts · doi:10.1145/3491101.3503727 · Cited by 117 · cited 1×
“This aligns with the goals of explainable AI [33].”
Danry, V., Pataranutaporn, P., Mao, Y., & Maes, P. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580672 · Cited by 110
Who/What Is My Teammate? Team Composition Considerations in Human–AI Teaming
McNeese, N. J., Schelble, B. G., Canonico, L. B., & Demir, M. (2021) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2021.3086018 · Cited by 101 · cited 1×
“(select all that apply) (i) Informally, at school or university (e.g., learnt from peers, or picked it up over time) (ii) Through formal training at school or university (e.g., took a course) (iii) Informally, at my workplace (e.g., learnt from colleagues, or picked it up over time)”
Nepal, S. K., Pillai, A., Campbell, W., Massachi, T., Choi, E. S., Xu, X., Kuc, J., Huckins, J. F., Holden, J. L., Depp, C. A., et al. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3650767 · Cited by 97
Pellas, N. (2023) · Education Sciences · doi:10.3390/educsci13111155 · Cited by 95 · cited 1×
“Some work has focused, for instance, on studying the effects of GenAI use on memory (e.g., [1, 106]) and on creativity (e.g., [28, 100]).”
Student self-assessment in a programming course using bloom's revised taxonomy
Alaoutinen, S., & Smolander, K. (2010) · Proceedings of the fifteenth annual conference on Innovation and technology in computer science education · doi:10.1145/1822090.1822135 · Cited by 93 · cited 1×
“In our study, we apply a one-item five-point scale assessment for each of the six cognitive activities associated with critical thinking (six items in total, see Section 3.1.3), similar to previous work (e.g., Alaoutinen and Smolander [3]).”
InfluentialThe Measurement of the Propensity to Trust Automation
Jessup, S. A., Schneider, T. R., Alarcon, G. M., Ryan, T. J., & Capiola, A. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-21565-1_32 · Cited by 90 · cited 1×
“), as well as the challenges, if any, they faced while doing so (i.e., When applying this critical thinking tactic during your use of GenAI tool, have you ever encountered any challenges and obstacles?”
Satisficing: Integrating Two Traditions
Artinger, F. M., Gigerenzer, G., & Jacobs, P. (2022) · Journal of Economic Literature · doi:10.1257/jel.20201396 · Cited by 90
Ironies of Generative AI: Understanding and Mitigating Productivity Loss in Human-AI Interaction
Simkute, A., Tankelevitch, L., Kewenig, V., Scott, A. E., Sellen, A., & Rintel, S. (2024) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2024.2405782 · Cited by 89 · cited 1×
“This phenomenon is well-documented, as in Bainbridge’s “Ironies of Automation” [7], and has been recently revisited in the context of GenAI by Simkute et al. [122] as the “Ironies of Generative AI”.”
Self-citationArakawa, R., & Yakura, H. (2024) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3640794.3665549 · Cited by 72 · cited 1×
“…e.g., to support cognitive reappraisal [71], reduce compulsive smartphone use [80, 81], improve time management [55], create journaling prompts [97], encourage reflection on book highlights [61], support prayer [75], coaching for leadership growth [4], and reflection on cherished objects [57].”
Assessment of critical thinking: A Delphi study
Paul, S. A. (2014) · Nurse Education Today · doi:10.1016/j.nedt.2014.03.008 · Cited by 71 · cited 1×
“Critical thinking can be measured through self, peer-, or expert evaluation [66], us-ing a range of questionnaires [35, 65, 73, 145, 146], justified multiple choice questions, structured essays, protocols for whole-portfolio assessment, task observation, and peer interaction [34, 105].”
Performance and Metacognition Disconnect when Reasoning in Human-AI Interaction
Fernandes, D., Villa, S., Nicholls, S., Haavisto, O., Buschek, D., Schmidt, A., Kosch, T., Shen, C., & Welsch, R. (2024) · arXiv · doi:10.48550/arxiv.2409.16708 · Cited by 71 · cited 1×
“Still, one’s subjective self-confidence may not always be well-calibrated with respect to objective expertise on tasks [39, 130].”
Lacroux, A., & Martin-Lacroux, C. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.895997 · Cited by 67
Handbook of Automated Scoring: Theory into Practice
Yan, D., Rupp, A. A., & Foltz, P. W. (2020) · Chapman & Hall/CRC eBooks · doi:10.1201/9781351264808 · Cited by 64
Prerequisites for the utilization of knowledge in the recall of prose passages.
Morris, C., Stein, B. S., & Bransford, J. D. (1979) · Journal of Experimental Psychology Human Learning & Memory · doi:10.1037//0278-7393.5.3.253 · Cited by 60 · cited 1×
“Research shows that summarising material and follow-up writing practice enhance memory by integrating new knowledge with existing knowledge [62, 93, 134], but real-world summary writing is often passive and ineffective [15, 16, 41, 121, 140], and thus may not improve recall in comparison to simply…”
Ma, S., Wang, X., Lei, Y., Shi, C., Yin, M., & Ma, X. (2024) · arXiv · doi:10.48550/arxiv.2403.09552 · Cited by 56
Yeo, S., Lim, G., Gao, J., Zhang, W., & Perrault, S. T. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642530 · Cited by 54
Complex Problem Solving through Human-AI Collaboration: Literature Review on Research Contexts
Memmert, L., & Bittner, E. A. C. (2022) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2022.046 · Cited by 53 · cited 1×
“For example, when P188 used ChatGPT to help her summarise her past work as an auditor for her resume: “some of the information provided did not particularly relate to my role and even to the country I was working in.”
Think Fast, Think Slow, Think Critical: Designing an Automated Propaganda Detection Tool
Zavolokina, L., Sprenkamp, K., Katashinskaya, Z., Jones, D. G., & Schwabe, G. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642805 · Cited by 52
Tanprasert, T., Fels, S. S., Sinnamon, L., & Yoon, D. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642513 · Cited by 51
Sarkar, A. (2023) · Proceedings of the 2nd Annual Meeting of the Symposium on Human-Computer Interaction for Work · doi:10.1145/3596671.3597650 · Cited by 50 · cited 4×
“It is motivated primarily by the observation of the tendency of AI-assisted knowledge work-flows to be subject to “mechanised convergence” [114], i.e., that users with access to GenAI tools produce a less diverse set of outcomes for the same task, compared to those without.”
InfluentialSelf-citationDoes Writing Summaries Improve Memory for Text?
Spirgel, A. S., & Delaney, P. F. (2014) · Educational Psychology Review · doi:10.1007/s10648-014-9290-2 · Cited by 47 · cited 1×
“…material and follow-up writing practice enhance memory by integrating new knowledge with existing knowledge [62, 93, 134], but real-world summary writing is often passive and ineffective [15, 16, 41, 121, 140], and thus may not improve recall in comparison to simply re-reading the text [124].”
Enough With “Human-AI Collaboration”
Sarkar, A. (2023) · Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544549.3582735 · Cited by 47 · cited 1×
“Task confidence significantly influences how users engage with AI tools, particularly in the context of human-AI “collaboration” (notwithstanding objections to that term [113]).”
Self-citationTajik, E., & Tajik, F. (2023) · doi:10.36227/techrxiv.22589497.v1 · Cited by 47
Academic Writing with GPT-3.5 (ChatGPT): Reflections on Practices, Efficacy and Transparency
Buruk, O. '. (2023) · 26th International Academic Mindtrek Conference · doi:10.1145/3616961.3616992 · Cited by 46
Extending Chatbots to Probe Users: Enhancing Complex Decision-Making Through Probing Conversations
Reicherts, L., Park, G. W., & Rogers, Y. (2022) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3543829.3543832 · Cited by 46
A Design Framework for Reflective Play
Miller, J. A., Gandhi, K., Whitby, M. A., Kosa, M., Cooper, S., Mekler, E. D., & Iacovides, I. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642455 · Cited by 45
Effects of text manipulations on quality of written summaries
Garner, R., & McCaleb, J. L. (1985) · Contemporary Educational Psychology · doi:10.1016/0361-476x(85)90014-1 · Cited by 44 · cited 1×
“…material and follow-up writing practice enhance memory by integrating new knowledge with existing knowledge [62, 93, 134], but real-world summary writing is often passive and ineffective [15, 16, 41, 121, 140], and thus may not improve recall in comparison to simply re-reading the text [124].”
The marks are on the knowledge worker
Kidd, A. L. (1994) · doi:10.1145/259963.260346 · Cited by 44
Sarkar, A. (2024) · Communications of the ACM · doi:10.1145/3649404 · Cited by 40 · cited 2×
“Recent work has motivated the need for critical thinking support in AI-assisted knowledge work [116, 119].”
Self-citationZuriguel‐Pérez, E., Falcó‐Pegueroles, A., Roldán‐Merino, J., Agustino‐Rodriguez, S., Gómez‐Martín, M. D. C., & Lluch‐Canut, M. T. (2017) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.12220 · Cited by 38 · cited 1×
“Critical thinking can be measured through self, peer-, or expert evaluation [66], us-ing a range of questionnaires [35, 65, 73, 145, 146], justified multiple choice questions, structured essays, protocols for whole-portfolio assessment, task observation, and peer interaction [34, 105].”
Critical Thinking Questionnaire (CThQ) – construction and application of critical thinking test tool
Kobylarek, A., Błaszczyński, K., Ślósarz, L., & Madej, M. (2022) · Andragogy Adult Education and Social Marketing · doi:10.15503/andr2022.1 · Cited by 38
The effect of online argumentation upon students' pseudoscientific beliefs
Tsai, C., Lin, C.-N., Shih, W.-L., & Wu, P. (2014) · Computers & Education · doi:10.1016/j.compedu.2014.08.018 · Cited by 38 · cited 2×
“Or in writing, ideation and argumentation tools, such as through visualising argument structure [126, 133], reflecting on future scenarios [132], ideation and evaluation support [45], assessing risks in research impact statements [94].”
Extending a Human-AI Collaboration Framework with Dynamism and Sociality
Muller, M., & Weisz, J. (2022) · 2022 Symposium on Human-Computer Interaction for Work · doi:10.1145/3533406.3533407 · Cited by 37 · cited 1×
“Previous frameworks have categorised human-AI collaborations by how often the user or the AI initiates an action [95], and which entity takes on a “supervisory” role [88].”
Fostering Youth’s Critical Thinking Competency About AI through Exhibition
Lee, S., Choi, D., Lee, M., Choi, J., & Lee, S. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581159 · Cited by 37
How Knowledge Workers Use and Want to Use LLMs in an Enterprise Context
Brachman, M., El-Ashry, A., Dugan, C., & Geyer, W. (2024) · Extended Abstracts of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613905.3650841 · Cited by 37 · cited 7×
“Using this information, we classified each example as creation, information, or advice, per the Brachman et al. [13] taxonomy.”
InfluentialLi, Z., Liang, M., Lc, R., & Luo, Y. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642479 · Cited by 37
CriTrainer: An Adaptive Training Tool for Critical Paper Reading
Yuan, K., Lin, H., Cao, S., Peng, Z., Guo, Q., & Ma, X. (2023) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3586183.3606816 · Cited by 36
Intelligent Support Engages Writers Through Relevant Cognitive Processes
Göldi, A., Wambsganß, T., Neshaei, S. P., & Rietsche, R. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642549 · Cited by 36 · cited 1×
“Or in writing, ideation and argumentation tools, such as through visualising argument structure [126, 133], reflecting on future scenarios [132], ideation and evaluation support [45], assessing risks in research impact statements [94].”
Writing for Study Purposes: A Teacher's Guide to Developing Individual Writing Skills
Brookes, A., & Grundy, P. (1991) · Medical Entomology and Zoology · Cited by 32
Drosos, I., Sarkar, A., Xu, X., Negreanu, C., Rintel, S., & Tankelevitch, L. (2024) · Proceedings of the 3rd Annual Meeting of the Symposium on Human-Computer Interaction for Work · doi:10.1145/3663384.3663389 · Cited by 30
Self-citationThe Long-Term Effect of Automated Writing Evaluation Feedback on Writing Development
Lee, Y.-J. (2020) · English Teaching · doi:10.15858/engtea.75.1.202003.67 · Cited by 30
Li, Z., Liang, M., Le, H. T., Lc, R., & Luo, Y. (2023) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3571884.3604305 · Cited by 29
Glinka, K., & Müller-Birn, C. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3610054 · Cited by 26 · cited 1×
“Critical thinking interventions have also been explored in data analysis [44, 48].”
Kitson, A., Slovák, P., & Antle, A. N. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642488 · Cited by 26
CareerSim: Gamification Design Leveraging LLMs For Career Development Reflection
Du, W., Zhu, Z., Xu, X., Che, H., & Chen, S. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3650928 · Cited by 24
Will Code Remain a Relevant User Interface for End-User Programming with Generative AI Models?
Sarkar, A. (2023) · Proceedings of the 2023 ACM SIGPLAN International Symposium on New Ideas, New Paradigms, and Reflections on Programming and Software · doi:10.1145/3622758.3622882 · Cited by 23
Self-citationDigital amnesia and the future tourist
Greenwood, C., & Quinn, M. (2017) · Journal of Tourism Futures · doi:10.1108/jtf-11-2016-0037 · Cited by 23 · cited 1×
“…conversational search engines can streamline tasks like literature reviews, some fear that out-sourcing this work could harm our ability to learn and remember, in what is sometimes referred to as “digital amnesia” [47, 111], though evidence for this effect is largely inconclusive [19, 21, 27, 127].”
Unlocking Memories with AI: Exploring the Role of AI-Generated Cues in Personal Reminiscing
Jeung, J. L., & Huang, Y. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3650979 · Cited by 23
Sherrard, C. (1986) · Written Communication · doi:10.1177/0741088386003003003 · Cited by 21
Designing personalised, automated feedback to develop students’ research writing skills
Abel, S., Kitto, K., Knight, S., & Shum, S. B. (2018) · ASCILITE Publications · doi:10.14742/apubs.2018.1932 · Cited by 20
Tang, H., & Singha, M. F. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3648110 · Cited by 19
Students’ engagement with a collaborative wiki tool predicts enhanced written exam performance
Stafford, T., Elgueta, H., & Cameron, H. (2014) · Research in Learning Technology · doi:10.3402/rlt.v22.22797 · Cited by 17 · cited 1×
“GenAI tools like ChatGPT and Copilot can mitigate these drawbacks, especially for less experienced learners, by providing high-quality summaries upon which collaborative, self-monitored writing tasks can be conducted [120, 125].”
KOALA Hero Toolkit: A New Approach to Inform Families of Mobile Datafication Risks
Wang, G., Zhao, J., Kollnig, K., Zier, A., Duron, B., Zhang, Z., Kleek, M. G. V., & Shadbolt, N. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642283 · Cited by 17
Tost, J., Gohsen, M., Schulte, B. F., Thomet, F., Kuhn, M., Kiesel, J., Stein, B., & Hornecker, E. (2024) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3640794.3665904 · Cited by 15
Conversations with the News: Co-speculation into Conversational Interactions with News Content
Nordberg, O. E., & Guribye, F. (2023) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3571884.3597123 · Cited by 14
The development and validation of digital amnesia scale
Robert, S., Kadhiravan, S., & Mckay, D. (2024) · Current Psychology · doi:10.1007/s12144-024-05757-4 · Cited by 14
Kang, S., & Odom, W. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3650909 · Cited by 12
Ten Quick Tips for Harnessing the Power of ChatGPT/GPT-4 in Computational BiologyPreprint
Lubiana, T., Lopes, R., Medeiros, P., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2303.16429 · Cited by 12 · cited 1×
“Generative AI tools like Copilot and Chat-GPT can boost writing productivity by assisting with tasks such as content generation, idea creation, and stylistic editing, helping both expert and novice writers [18, 84, 112, 135].”
Spiritual AI: Exploring the Possibilities of a Human-AI Interaction Beyond Productive Goals
Kwon, S., Yoo, D. W., & Kang, Y. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3650743 · Cited by 12 · cited 1×
“…e.g., to support cognitive reappraisal [71], reduce compulsive smartphone use [80, 81], improve time management [55], create journaling prompts [97], encourage reflection on book highlights [61], support prayer [75], coaching for leadership growth [4], and reflection on cherished objects [57].”
Kim, M., Lee, J., Koh, Y., Lee, C., Lee, U., & Kim, A. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642778 · Cited by 11 · cited 1×
“For instance, whether the system should be proactive, i.e., introduce critical thinking prompts without an explicit user request [69, 109].”
Teaching Argument: An Introduction to the Toulmin Model
Kneupper, C. W. (1978) · College Composition and Communication · doi:10.58680/ccc197816301 · Cited by 11
Harrison, G., Bryson, K., Bamba, A. E. B., Dovichi, L., Binion, A. H., Borem, A., & Ur, B. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642755 · Cited by 11
Digitally Scaffolding Debate in the Classroom
Holzer, A., Tintarev, N., Bendahan, S., Kocher, B., Greenup, S., & Gillet, D. (2018) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3170427.3188499 · Cited by 10 · cited 1×
“For example, design for critical thinking can aid in the prevention and verification of misinfor-mation, e.g., through structured thinking aids [50, 51], analytical thinking nudges [143], worksheets and group discussion [136], and gamification [129].”
Mukherjee, A., de Santana, V. F., & Baria, A. T. (2023) · Extended Abstracts of the CHI Conference on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3544549.3573844 · Cited by 10
Jeromela, J., & Conlan, O. (2023) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3571884.3604317 · Cited by 10 · cited 1×
“…is in mental health and wellbeing, e.g., to support cognitive reappraisal [71], reduce compulsive smartphone use [80, 81], improve time management [55], create journaling prompts [97], encourage reflection on book highlights [61], support prayer [75], coaching for leadership growth [4], and…”
Intention Is All You NeedPreprint
Sarkar, A. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2410.18851 · Cited by 10
Self-citationZuriguel-Pérez, E., Lluch-Canut, M.-T., Puig-Llobet, M., Basco-Prado, L., Almazor-Sirvent, A., Biurrun-Garrido, A., Aguayo-González, M. P., Mestres-Soler, O., & Roldán-Merino, J. (2022) · Nurse Education in Practice · doi:10.1016/j.nepr.2022.103498 · Cited by 9 · cited 1×
“Critical thinking can be measured through self, peer-, or expert evaluation [66], us-ing a range of questionnaires [35, 65, 73, 145, 146], justified multiple choice questions, structured essays, protocols for whole-portfolio assessment, task observation, and peer interaction [34, 105].”
Maldonado, L. R., Abouzied, A., & Gleason, N. W. (2023) · doi:10.1145/3584931.3607494 · Cited by 9 · cited 1×
“…e.g., presenting AI explanations as questions rather than statements improves logical discernment [24], questions also improve critical reading [110, 142], attention checks promote systematic thinking [49], conflict-filled discussion induces critical thinking [78], and in general increased…”
Digital Amnesia: The Smart Phone and the Modern Indian Student
Swaminathan, S. (2020) · International Journal of Psychosocial Rehabilitation · doi:10.37200/ijpr/v24i4/pr2020393 · Cited by 9
Generative artificial intelligence enhances creativity but reduces the diversity of novel contentPreprint
Doshi, A. R., & Hauser, O. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2312.00506 · Cited by 7
Ironies of Generative AI: Understanding and mitigating productivity loss in human-AI interactions
Simkute, A., Tankelevitch, L., Kewenig, V., Scott, A. E., Sellen, A., & Rintel, S. (2024) · arXiv · doi:10.48550/arxiv.2402.11364 · Cited by 7
Self-citationTowards Mobile Blended Interaction Fostering Critical Thinking
Holzer, A., Govaerts, S., Bendahan, S., & Gillet, D. (2015) · International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI Adjunct) · doi:10.1145/2786567.2793695 · Cited by 6 · cited 1×
“For example, design for critical thinking can aid in the prevention and verification of misinfor-mation, e.g., through structured thinking aids [50, 51], analytical thinking nudges [143], worksheets and group discussion [136], and gamification [129].”
Critical Thinking in Collaboration
Sun, N., Yuan, C. W., Rosson, M. B., Wu, Y., & Carroll, J. M. (2017) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3027063.3053250 · Cited by 6 · cited 1×
“Or in writing, ideation and argumentation tools, such as through visualising argument structure [126, 133], reflecting on future scenarios [132], ideation and evaluation support [45], assessing risks in research impact statements [94].”
Sarkar, A., Xiaotong, Xu, Toronto, N., Drosos, I., & Poelitz, C. (2024) · arXiv · doi:10.48550/arxiv.2412.15030 · Cited by 5 · cited 3×
“Recent work has motivated the need for critical thinking support in AI-assisted knowledge work [116, 119].”
Self-citationCo-audit: tools to help humans double-check AI-generated content
Gordon, A. D., Negreanu, C., Cambronero, J., Chakravarthy, R., Drosos, I., Fang, H., Mitra, B., Richardson, H., Sarkar, A., Simmons, S., et al. (2023) · arXiv · doi:10.48550/arxiv.2310.01297 · Cited by 4
Self-citationDeepThinkingMap: Collaborative Video Reflection System with Graph-based Summarizing and Commenting
Liao, J., Singh, M., & Wang, H. (2023) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3584931.3607501 · Cited by 3
Robert, J., Kadhiravan, S., & McKay, D. (2024) · PsycTESTS Dataset · doi:10.1037/t94178-000 · Cited by 2
Academic Writing with GPT-3.5: Reflections on Practices, Efficacy and Transparency
Buruk, O. '. (2023) · arXiv · doi:10.48550/arxiv.2304.11079
Research works printed but not linked: 12
- Benjamin S Bloom, Max D Engelhart, Edward J Furst, Walquer H Hill, David R Krathwohl, et al. 1956. Taxonomy of educational objetives: the classification of educational goals: handbook I: cognitive domain. Technical Report. New York, US: D. Mckay.
- Ooi Yan Chiew An Qi Lai and Wen Xin Liew. 2020. Digital technology overuse as a predictor of digital amnesia and productivity. Ph. D. Dissertation. UTAR.
- Amir Dirin Ari Alamäki and Jyrki Suomala. 2019. Digital amnesia and personal dependency in smart devices: A challenge for AI. Proceedings of Fake Intelligence Online Summit 2019 (2019).
- Peter A Facione Carol A Sanchez Noreen C Facione and Joanne Gainen. 1995. The disposition toward critical thinking. The Journal of General Education 44 1 (1995) 1–25.
- Hong Jiao and Robert W Lissitz. 2020. Application of Artificial Intelligence to Assessment. IAP.
- Deanna Kuhn. 1993. Connecting scientific and informal reasoning. Merrill-Palmer Quarterly (1982-) (1993) 74–103.
- George Lakoff and Mark Johnson. 2008. Metaphors we live by. University of Chicago press.
- Jill Burstein McCaffrey, Brian Riordan, and Daniel. 2020. Expanding Automated Writing Evaluation. In Handbook of Automated Scoring. Chapman and Hall/CRC.
- Samir Passi and Mihaela Vorvoreanu. 2022. Overreliance on AI literature review. Microsoft Research (2022).
- Richard Paul and Linda Elder. 2020. The miniature guide to critical thinking concepts and tools (8th edition ed.). Rowman & Littlefield, Lanham, Md. OCLC: on1132213785.
- Advait Sarkar. 2024. Large Language Models Cannot Explain Themselves. In ACM CHI 2024 Workshop on Human-Centered Explainable AI (HCXAI).
- Donna Wilson and Marcus Conyers. 2016. Teaching students to drive their brains: Metacognitive strategies, activities, and lesson ideas. Ascd.
Cited by
Tian, J., & Zhang, R. (2025) · Acta Psychologica · doi:10.1016/j.actpsy.2025.105725 · Cited by 232
Liu, X., & Zhong, B. (2025) · Educational Research Review · doi:10.1016/j.edurev.2025.100741 · Cited by 78
Rodger, D., Mann, S. P., Earp, B., Savulescu, J., Bobier, C., & Blackshaw, B. P. (2025) · Nurse Education in Practice · doi:10.1016/j.nepr.2025.104461 · Cited by 64
“Furthermore, there is evidence from other domains showing that the use of GenAI can diminish critical thinking and independent problem-solving skills over time (Lee et al., 2025).”
Mei, P., Brewis, D. N., Nwaiwu, F., Sumanathilaka, D., Alva-Manchego, F., & Demaree-Cotton, J. (2025) · Computers in Human Behavior: Artificial Humans · doi:10.1016/j.chbah.2025.100140 · Cited by 50
AI deskilling is a structural problem
Ferdman, A. (2025) · AI & Society · doi:10.1007/s00146-025-02686-z · Cited by 108
Metadata
- Authors
- Lee, H.-P. (., Sarkar, A., Tankelevitch, L., Drosos, I., Rintel, S., Banks, R., & Wilson, N.
- Affiliations
- Carnegie Mellon University (US)
- Microsoft Research (United Kingdom) (GB)
- ORCID
- Venue
- Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2025-04-25
- Pages
- 1-22
- OpenAlex
- W4409885395
- Cited by
- 490
- References
- 118
- Citations by year
- 2026: 328 · 2025: 166
- FWCI
- 573.88
- Type
- conference paper
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Social Sciences › Education › Education and Critical Thinking Development
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Keywords
- generative AI, critical thinking, knowledge workers, self-confidence, cognitive effort, fact-checking, response integration, AI tool design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-28, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-28 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

