Placebo or Assistant? Generative AI Between Externalization and Anthropomorphization
Open accessThe DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Abstract
Generative AIs have been embraced by learners wishing to offload (parts of) complex tasks. However, recent research suggests that AI users are at risk of failing to correctly monitor the extent of their own contribution when being assisted by an AI. This difficulty in keeping track of the division of labor has been shown to result in placebo and ghostwriter effects. In case of the AI-based placebo effect, users overestimate their ability while or after being assisted by an AI. The ghostwriter effect occurs when AI users do not disclose their AI use despite being aware of the contribution made by an AI. These two troubling effects are discussed in the context of the conflict between cognitive externalization and anthropomorphization. While people tend to offload cognitive load into their environment, they also often perceive technology as human-like. However, despite the natural conversations that can be had with current AIs, the desire to attribute human-like qualities that would require the acknowledgment of AI contributions appears to be lacking. Implications and suggestions on how to improve AI use, for example, by employing embodied AI agents, are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Becoming a Self-Regulated Learner: An Overview
Zimmerman, B. J. (2002) · Theory Into Practice · doi:10.1207/s15430421tip4102_2 · Cited by 10,197 · cited 2×
“An important prerequisite for self-regulated learning is that learners need to be able to accurately monitor their progress in order to estimate how much more time and effort is necessary for them to achieve their goals (Seufert, 2018; Wolters & Brady, 2021; Zimmerman, 2002).”
ChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education
Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · doi:10.35542/osf.io/5er8f · Cited by 7,552
ChatGPT for good? On opportunities and challenges of large language models for education
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · Learning and Individual Differences · doi:10.1016/j.lindif.2023.102274 · Cited by 7,326 · cited 2×
“The current debate surrounding generative AIs in education revolves around how to train students for using these new tools (e.g., Kasneci et al., 2023).”
Cognitive Architecture and Instructional Design
Sweller, J., van Merrienboer, J. J. G., & Paas, F. G. W. C. (1998) · Educational Psychology Review · doi:10.1023/a:1022193728205 · Cited by 6,023
Students' voices on generative ai: perceptions, benefits, and challenges in higher education
Chan, C. K. Y., & Hu, W. (2023) · arXiv · doi:10.48550/arxiv.2305.00290 · Cited by 2,504 · cited 1×
“One of the first studies in this area was published by Chan and Hu (2023) using a sample of 399 university students.”
Cognitive Architecture and Instructional Design: 20 Years Later
Sweller, J., van Merriënboer, J. J. G., & Paas, F. (2019) · Educational Psychology Review · doi:10.1007/s10648-019-09465-5 · Cited by 2,337
Students’ voices on generative AI: perceptions, benefits, and challenges in higher education
Chan, C. K. Y., & Hu, W. (2023) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-023-00411-8 · Cited by 2,301 · cited 1×
“One of the first studies in this area was published by Chan and Hu (2023) using a sample of 399 university students.”
What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education
Tlili, A., Shehata, B., Adarkwah, M. A., Bozkurt, A., Hickey, D. T., Huang, R., & Agyemang, B. (2023) · Smart Learning Environments · doi:10.1186/s40561-023-00237-x · Cited by 2,003 · cited 1×
“However, incorporating writing or ideas generated using an AI application without acknowledgment is likely to be considered as a form of plagiarism by most (see Mogavi et al., 2024; Tlili et al., 2023).”
Google Effects on Memory: Cognitive Consequences of Having Information at Our Fingertips
Sparrow, B., Liu, J., & Wegner, D. M. (2011) · Science · doi:10.1126/science.1207745 · Cited by 1,762 · cited 1×
“Decades ago, the Internet made a wealth of information accessible in an instantaneous manner, leading to the emergence of the “Google effect” in which people memorize where to find information instead of the information itself (Sparrow et al., 2011).”
Artificial hallucinations in ChatGPT: implications in scientific writing
Alkaissi, H., & McFarlane, S. I. (2023) · Cureus · doi:10.7759/cureus.35179 · Cited by 1,540 · cited 1×
“However, training academic writing using generative AIs can involve several obstacles, as their output has been found to contain inaccurate or false information (Alkaissi & McFarlane, 2023).”
Risko, E. F., & Gilbert, S. J. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.07.002 · Cited by 1,502 · cited 1×
“The consequential change in how memory is offloaded (e.g., Fisher et al., 2022; for an overview, see Risko & Gilbert, 2016) is likely to be followed by a normalization of the externalization of entire tasks to generative AIs (Skulmowski, 2023).”
ChatGPT is fun, but not an author
Thorp, H. H. (2023) · Science · doi:10.1126/science.adg7879 · Cited by 1,437
A SWOT analysis of ChatGPT: Implications for educational practice and research
Farrokhnia, M., Banihashem, S. K., Noroozi, O., & Wals, A. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2023.2195846 · Cited by 1,384 · cited 1×
“…an unprecedented potential for the automatization of highly complex tasks, the literature contains various hypotheses concerning the effects of AI use in educational contexts (e.g., Bai et al., 2023; Farrokhnia et al., 2023; Gill & Kaur, 2023; Kasneci et al., 2023; Lee, 2023; Skulmowski, 2023).”
Who Sees Human?: The Stability and Importance of Individual Differences in Anthropomorphism
Waytz, A., Cacioppo, J., & Epley, N. (2010) · Perspectives on Psychological Science · doi:10.1177/1745691610369336 · Cited by 1,228 · cited 1×
“Differential aspects behind the tendency to anthropomorphize have been investigated for years (e.g., Waytz et al., 2010), potentially complicating the design of generative AIs.”
Blut, M., Wang, C., Wünderlich, N. V., & Brock, C. (2021) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-020-00762-y · Cited by 1,194
Gao, C. A., Howard, F. M., Markov, N. S., Dyer, E. C., Ramesh, S., Luo, Y., & Pearson, A. T. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00819-6 · Cited by 1,099
Lund, B. D., Wang, T., Mannuru, N. R., Nie, B., Shimray, S., & Wang, Z. (2023) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24750 · Cited by 919
Pelau, C., Dabija, D.-C., & Ene, I. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.106855 · Cited by 889 · cited 1×
“As a result, it may be worthwhile to consider how triggers for anthropomorphization could affect interactions with (generative) AIs (Jacobs et al., 2023; Laban, 2021; Lee et al., 2020; Pelau et al., 2021; Rajaobelina et al., 2021).”
Prompt Engineering with ChatGPT: A Guide for Academic Writers
Giray, L. (2023) · Annals of Biomedical Engineering · doi:10.1007/s10439-023-03272-4 · Cited by 776 · cited 1×
“These not overly long “replies” could easily be combined into an essay or even a thesis in many academic environments, in particular given that the chat can be continued with additional questions until sufficient material has been generated (Giray, 2023).”
Yilmaz, R., & Karaoglan Yilmaz, F. G. (2023) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2023.100147 · Cited by 745
Skulmowski, A., & Xu, K. M. (2022) · Educational Psychology Review · doi:10.1007/s10648-021-09624-7 · Cited by 678
Self-citationThe phenomenology of action: a conceptual framework
Pacherie, E. (2008) · Cognition · doi:10.1016/j.cognition.2007.09.003 · Cited by 618
The rise of ChatGPT : Exploring its potential in medical education
Lee, H. (2024) · Anatomical Sciences Education · doi:10.1002/ase.2270 · Cited by 596 · cited 1×
“…an unprecedented potential for the automatization of highly complex tasks, the literature contains various hypotheses concerning the effects of AI use in educational contexts (e.g., Bai et al., 2023; Farrokhnia et al., 2023; Gill & Kaur, 2023; Kasneci et al., 2023; Lee, 2023; Skulmowski, 2023).”
Generative AI tools and assessment: Guidelines of the world's top-ranking universities
Moorhouse, B. L., Yeo, M. A., & Wan, Y. (2023) · Computers and Education Open · doi:10.1016/j.caeo.2023.100151 · Cited by 461
ChatGPT improves creative problem-solving performance in university students: An experimental study
Urban, M., Děchtěrenko, F., Lukavský, J., Hrabalová, V., Svacha, F., Brom, C., & Urban, K. (2024) · Computers & Education · doi:10.1016/j.compedu.2024.105031 · Cited by 396
Barrett, A., & Pack, A. (2023) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-023-00427-0 · Cited by 391
Hadi Mogavi, R., Deng, C., Juho Kim, J., Zhou, P., D. Kwon, Y., Hosny Saleh Metwally, A., Tlili, A., Bassanelli, S., Bucchiarone, A., Gujar, S., et al. (2024) · Computers in Human Behavior: Artificial Humans · doi:10.1016/j.chbah.2023.100027 · Cited by 369
How does generative artificial intelligence impact student creativity?
Habib, S., Vogel, T., Anli, X., & Thorne, E. (2024) · Journal of Creativity · doi:10.1016/j.yjoc.2023.100072 · Cited by 364 · cited 1×
“Another recent study found that chatbot use can increase the quality of new ideas in a task in which alternative uses for a paperclip were to be found (Habib et al., 2024).”
Hyun Baek, T., & Kim, M. (2023) · Telematics and Informatics · doi:10.1016/j.tele.2023.102030 · Cited by 319
College Students’ Time Management: a Self-Regulated Learning Perspective
Wolters, C. A., & Brady, A. C. (2021) · Educational Psychology Review · doi:10.1007/s10648-020-09519-z · Cited by 317 · cited 1×
“An important prerequisite for self-regulated learning is that learners need to be able to accurately monitor their progress in order to estimate how much more time and effort is necessary for them to achieve their goals (Seufert, 2018; Wolters & Brady, 2021; Zimmerman, 2002).”
Draxler, F., Werner, A., Lehmann, F., Hoppe, M., Schmidt, A., Buschek, D., & Welsch, R. (2023) · arXiv · doi:10.48550/arxiv.2303.03283 · Cited by 284
Creepiness: Its antecedents and impact on loyalty when interacting with a chatbot
Rajaobelina, L., Prom Tep, S., Arcand, M., & Ricard, L. (2021) · Psychology & Marketing · doi:10.1002/mar.21548 · Cited by 252
Artificial muses: Generative artificial intelligence chatbots have risen to human-level creativity
Haase, J., & Hanel, P. H. P. (2023) · Journal of Creativity · doi:10.1016/j.yjoc.2023.100066 · Cited by 233 · cited 1×
“Since the creative output of generative AIs has been found to match the level of human creativity (Haase & Hanel, 2023), there is a widespread hope that generative AIs will support humans in various creative tasks, such as creative writing.”
The interplay between self-regulation in learning and cognitive load
Seufert, T. (2018) · Educational Research Review · doi:10.1016/j.edurev.2018.03.004 · Cited by 227 · cited 3×
“Furthermore, self-regulated learning has been linked to Sweller et al.’s (1998, 2019) cognitive load theory by Seufert (2018, 2020).”
Lee, S., Lee, N., & Sah, Y. J. (2020) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2019.1699748 · Cited by 204
Is Chatgpt a menace for creative writing ability? An experiment
Niloy, A. C., Akter, S., Sultana, N., Sultana, J., & Rahman, S. I. U. (2024) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12929 · Cited by 198 · cited 1×
“First results indicate that the ability for creative writing can be weakened through generative AI use (Niloy et al., 2023).”
Eaton, S. E. (2023) · International Journal for Educational Integrity · doi:10.1007/s40979-023-00144-1 · Cited by 190
Janson, A. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2023.107954 · Cited by 187 · cited 1×
“Research from this field indicates that elements that trigger the humanization of chatbots increase their social presence, which, in turn, amplifies trust, empathy, and satisfaction (Janson, 2023).”
Draxler, F., Werner, A., Lehmann, F., Hoppe, M., Schmidt, A., Buschek, D., & Welsch, R. (2024) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3637875 · Cited by 186 · cited 4×
“These novel capabilities strongly resembling human creative efforts have raised the question of AI authorship (e.g., Draxler et al., 2024; Thorp, 2023) and the ethical use of AI-generated output (e.g., Eaton, 2023; Lund et al., 2023).”
InfluentialBouteraa, M., Bin-Nashwan, S. A., Al-Daihani, M., Dirie, K. A., Benlahcene, A., Sadallah, M., Zaki, H. O., Lada, S., Ansar, R., Fook, L. M., et al. (2024) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2024.100402 · Cited by 162
The Placebo Effect of Artificial Intelligence in Human–Computer Interaction
Kosch, T., Welsch, R., Chuang, L., & Schmidt, A. (2022) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3529225 · Cited by 137 · cited 2×
“…effect include a study in which participants estimated their task performance in a word puzzle task as higher when told to be receiving AI support (Kosch et al., 2023) and an experiment in which more riskier decisions were made in a card game by participants wearing a brain-computer interface…”
Smiling AI agents: How anthropomorphism and broad smiles increase charitable giving
Baek, T. H., Bakpayev, M., Yoon, S., & Kim, S. (2022) · International Journal of Advertising · doi:10.1080/02650487.2021.2011654 · Cited by 125 · cited 1×
“For instance, the smiles of AI-based agents can be an important determinant of behavior, such as in the case of charity donations (Baek et al., 2022).”
Roe, J., & Perkins, M. (2022) · International Journal for Educational Integrity · doi:10.1007/s40979-022-00109-w · Cited by 83 · cited 1×
“Although technology-based solutions such as automated checking software are used by many educational institutions and publishers, idea plagiarism and other forms of plagiarism remain difficult to detect (Roe & Perkins, 2022).”
People mistake the internet’s knowledge for their own
Ward, A. F. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2105061118 · Cited by 82 · cited 1×
“Crucially, technology use can lead to overconfidence regarding abilities and knowledge (Eliseev & Marsh, 2023; Fisher & Oppenheimer, 2021; Ward, 2021) and distorting source memory (Siler et al., 2022).”
The Cognitive Architecture of Digital Externalization
Skulmowski, A. (2023) · Educational Psychology Review · doi:10.1007/s10648-023-09818-1 · Cited by 76 · cited 6×
“While the aspect of whether users perceive AIs as human-like partners will be discussed in a later section, a cognitive explanation for not giving credit to AIs could be that humans perceive generative AIs merely as a tool to offload parts of their work (Skulmowski, 2023).”
InfluentialSelf-citationLeón-Domínguez, U. (2024) · Neuropsychology · doi:10.1037/neu0000948 · Cited by 65
Wahn, B., Schmitz, L., Gerster, F. N., & Weiss, M. (2023) · PLOS ONE · doi:10.1371/journal.pone.0286102 · Cited by 49 · cited 1×
“…of studies suggest that humans prefer to share their workload with technological aids under certain circumstances (e.g., Wahn & Kingstone, 2021; Wahn et al., 2023), while there are factors determining whether an AI is found to be trust-worthy and acceptable or whether users feel uneasy because…”
Harder Than You Think: How Outside Assistance Leads to Overconfidence
Fisher, M., & Oppenheimer, D. M. (2021) · Psychological Science · doi:10.1177/0956797620975779 · Cited by 31 · cited 1×
“Crucially, technology use can lead to overconfidence regarding abilities and knowledge (Eliseev & Marsh, 2023; Fisher & Oppenheimer, 2021; Ward, 2021) and distorting source memory (Siler et al., 2022).”
Understanding why searching the internet inflates confidence in explanatory ability
Eliseev, E. D., & Marsh, E. J. (2023) · Applied Cognitive Psychology · doi:10.1002/acp.4058 · Cited by 20 · cited 1×
“Crucially, technology use can lead to overconfidence regarding abilities and knowledge (Eliseev & Marsh, 2023; Fisher & Oppenheimer, 2021; Ward, 2021) and distorting source memory (Siler et al., 2022).”
Cited by
The Use of Generative AI Tools in Higher Education: Ethical and Pedagogical Principles
Nguyen, K. V. (2025) · Journal of Academic Ethics · doi:10.1007/s10805-025-09607-1 · Cited by 163
“Furthermore, empirical research on the long-term impact of AI literacy remains scarce (Ardito, 2024; Skulmowski, 2024).”
Chen, A., Xiang, M., Zhou, J., Jia, J., Shang, J., Li, X., Gašević, D., & Fan, Y. (2025) · Computers & Education · doi:10.1016/j.compedu.2024.105198 · Cited by 115
Qu, Y., & Wang, J. (2025) · Journal of Academic Ethics · doi:10.1007/s10805-025-09643-x · Cited by 29
“This distinction manifests in different behavioural patterns: anxiety leads to technology avoidance, while AI guilt produces what Skulmowski (2024) terms the “AI ghostwriter effect,” where users engage with technology while concealing their dependency on it.”
Metadata
- Authors
- Skulmowski, A.
- Venue
- Educational Psychology Review
- Published
- 2024-06
- Volume
- 36
- Issue
- 2
- ISSN
- 1040-726X (ISSN-L)
- 1573-336X
- OpenAlex
- W4399352239
- Cited by
- 43
- References
- 49
- FWCI
- 16.46
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.