"I'm Not Sure, But...": Examining the Impact of Large Language Models' Uncertainty Expression on User Reliance and Trust
Open accessThe DOI matches its Crossref record; 126 of the 127 references it cites were found in a registry or an index; 54 of the 92 sources its claims cite were checked for support.
Abstract
Widely deployed large language models (LLMs) can produce convincing yet incorrect outputs, potentially misleading users who may rely on them as if they were correct. To reduce such overreliance, there have been calls for LLMs to communicate their uncertainty to end users. However, there has been little empirical work examining how users perceive and act upon LLMs’ expressions of uncertainty. We explore this question through a large-scale, pre-registered, human-subject experiment (N=404) in which participants answer medical questions with or without access to responses from a fictional LLM-infused search engine. Using both behavioral and self-reported measures, we examine how different natural language expressions of uncertainty impact participants’ reliance, trust, and overall task performance. We find that first-person expressions (e.g., “I’m not sure, but...”) decrease participants’ confidence in the system and tendency to agree with the system’s answers, while increasing participants’ accuracy. An exploratory analysis suggests that this increase can be attributed to reduced (but not fully eliminated) overreliance on incorrect answers. While we observe similar effects for uncertainty expressed from a general perspective (e.g., “It’s not clear, but...”), these effects are weaker and not statistically significant. Our findings suggest that using natural language expressions of uncertainty may be an effective approach for reducing overreliance on LLMs, but that the precise language used matters. This highlights the importance of user testing before deploying LLMs at scale.
Overview
CoChat Summary
TL;DR
In a pre-registered experiment (N=404), first-person LLM uncertainty expressions such as “I’m not sure, but...” reduced participants’ agreement with and confidence in an LLM-infused search system while increasing their accuracy on medical yes/no questions. General-perspective uncertainty expressions showed similar but weaker, non-significant effects.
Key findings
- First-person uncertainty expressions decreased agreement with the AI system (74.8% vs. 80.9% Control), decreased confidence in the AI’s answer (3.66 vs. 3.95 on a 5-point scale), and increased accuracy (72.8% vs. 63.9% Control). General-perspective expressions showed weaker, non-significant effects (Agree 77.6%, ConfidenceAI 3.80, Correct 67.9%).
- Within-condition, uncertain vs. not-uncertain AI responses lowered agreement (UncertainGeneral: 70.9% vs. 84.7%; Uncertain1st: 73.4% vs. 79.5%, not significant), lowered confidence in the AI answer (Uncertain1st: 3.44 vs. 3.88; UncertainGeneral: 3.65 vs. 3.95), lowered self-reported use of the AI answer (Uncertain1st: 57.4% vs. 73.2%; UncertainGeneral: 62.9% vs. 79.7%), and increased task time in the general condition (2.23 vs. 1.84 min).
- Trust intentions were lower in Uncertain1st (2.91) than Control (3.25) and UncertainGeneral (3.36); there were no significant differences in TrustBelief, Anthropomorphism, or Transparency.
- Exploratory analysis suggested reduced but not eliminated overreliance: uncertainty improved accuracy when the AI was incorrect (Uncertain1st: 43.6% to 52.0%; UncertainGeneral: 32.8% to 48.0%) while slightly reducing accuracy when the AI was correct (Uncertain1st: 92.2% to 89.2%; UncertainGeneral: 94.8% to 83.1%); No-AI participants still had higher accuracy (74.2%) than Control (63.9%).
Methods
- Pre-registered between-subjects experiment with within-subjects comparisons; final sample N=404 U.S.-based MTurk participants (104 Control, 92 Uncertain1st, 94 UncertainGeneral, 114 No-AI). Participants answered eight challenging yes/no medical questions with or without responses from a fictional LLM-infused search engine, “AI system A.”
- AI answers were correct for four of eight questions; in uncertainty conditions, half of responses included uncertainty expressed in first person or general perspective. Dependent variables included Agree, Correct, Time, LinkClick, UseAI, UseLink, UseInternet, ConfidenceAI, ConfidenceAnswer, TrustBelief, TrustIntention, Anthropomorphism, and Transparency.
- Analyses used mixed models with participant and question random effects, ANOVA with Tukey post-hoc tests, within-condition models, exploratory over/underreliance analyses, and thematic analysis of free-form responses. AI responses were based on Copilot in Bing responses from July 2023, with minor modifications and uncertainty phrases inserted.
Limitations
- The paper states that simple yes/no tasks limit generalizability to complex tasks; time and source-usage measures are less reliable than in a lab study; medical questions were predefined rather than personal symptoms; behavior may differ with repeated system interaction; the AI system had low accuracy and expressed uncertainty often in a poorly calibrated manner; and results may not generalize across cultures and languages because the study was in English with U.S.-based participants.
- The paper also cautions against overgeneralizing and notes tradeoffs between experimental controllability and real-world generalizability, plus possible tradeoffs between reducing overreliance and decreasing trust.
- Evident from the text: the Transparency scale had low internal consistency (Cronbach’s alpha = 0.21), and the discrepancy between LinkClick and UseLink suggests measurement or self-report issues; the sample was younger, more educated, and overrepresented white respondents compared with U.S. Census data.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
26 Valid · 4 Not valid · 10 Not checked · 107 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“in AI-assisted decision-making settings, communicating (un)certainty has been shown to support trust calibration [118], increase vigilance [85], and improve task performance [7].”
What the sources say
- Supportedcites [118] [118] Yunfeng Zhang, Q Vera Liao, and Rachel KE Bellamy. 2020. Effect of confidence and explanation on accuracy and trust calibration in AI-assisted decision making. In Proceedings of the 2020 conference on fairness, accountability, and transparency . 295-305. - source
Section 3.2 (Results) reports that displaying a confidence score improved trust calibration in AI-assisted decision-making scenarios, including when participants delegated decisions without seeing the AI's recommendation. The claim attributes only trust calibration to this source, not the sentence's separate claims about vigilance or task performance. (LLM, conf=0.94)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“First, LLM-infused search engines already include hedging language [56, 62, 73].”
What the sources say
- Could not verifycites [56] [56] Q. Vera Liao and Jennifer Wortman Vaughan. 2024. AI Transparency in the Age of LLMs: A Human-Centered Research Roadmap. Harvard Data Science Review (Feb 29 2024). https://hdsr.mitpress.mit.edu/pub/aelql9qy. - sourceExperimental — accuracy not yet measured
The available copy’s Abstract (p. 2) discusses communicating uncertainty but does not say that LLM-infused search engines already use hedging language. Searches for “hedging” and for search engines communicating uncertainty found no passage addressing that specific claim. (LLM, conf=0.70)
- Could not verifycites [62] [62] Nelson Liu, Tianyi Zhang, and Percy Liang. 2023. Evaluating Verifiability in Generative Search Engines. In Findings of the Association for Computational Linguistics: EMNLP 2023 , Houda Bouamor, Juan Pino, and Kalika Bali (Eds.). Association for Computational Linguistics, Singapore, 7001-7025. https://doi. org/10.18653/v1/2023.findings-emnlp.467 - sourceExperimental — accuracy not yet measured
Section 3.1 (p. 4) identifies the LLM-backed search engines studied, and the Limitations (p. 10) says their responses often sound confident. Neither passage establishes whether their responses include hedging language; searches for hedging and expressions of uncertainty found no passage addressing that point. (LLM, conf=0.73)
- Partly supportedcites [73] [73] Sabrina J. Mielke, Arthur Szlam, Emily Dinan, and Y-Lan Boureau. 2022. Reducing Conversational Agents' Overconfidence Through Linguistic Calibration. Transactions of the Association for Computational Linguistics 10 (2022), 857-872. https://doi.org/10.1162/tacl\_a\_00494 - sourceExperimental — accuracy not yet measured
Section 2.13, “Overreliance” (p. 60), says GPT-4 tends to hedge in its responses and that OpenAI’s mitigations include hedging language within the model. It does not establish that LLM-infused search engines already include such language, so the claim extends the report’s observation to a different type of system. (LLM, conf=0.84)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“This can lead to disastrous outcomes through overreliance [19, 25, 83, 102], when people take actions based on incorrect outputs.”
What the sources say
- Partly supportedcites [19] [19] Zana Buçinca, Maja Barbara Malaya, and Krzysztof Z. Gajos. 2021. To Trust or to Think: Cognitive Forcing Functions Can Reduce Overreliance on AI in AI-Assisted Decision-Making. Proc. ACM Hum.-Comput. Interact. 5, CSCW1, Article 188 (apr 2021), 21 pages. https://doi.org/10.1145/3449287 - sourceExperimental — accuracy not yet measured
The Discussion (p. 16) reports that participants followed incorrect AI suggestions and consequently made worse decisions. But the study used a single non-critical task (Discussion, p. 17); it does not establish disastrous outcomes from reliance on incorrect LLM outputs. (LLM, conf=0.87)
- Partly supportedcites [25] [25] Valerie Chen, Q. Vera Liao, Jennifer Wortman Vaughan, and Gagan Bansal. 2023. Understanding the Role of Human Intuition on Reliance in Human-AI DecisionMaking with Explanations. Proc. ACM Hum.-Comput. Interact. 7, CSCW2, Article 370 (oct 2023). https://doi.org/10.1145/3610219 - sourceExperimental — accuracy not yet measured
Section 4.2.1 reports that, when AI predictions were incorrect, feature-based explanations increased overreliance and reduced participants’ decision accuracy. The study examined income prediction and biography classification, not LLM outputs, and does not establish disastrous outcomes from people acting on incorrect outputs. (LLM, conf=0.86)
- Not matchedcites [83] [83] Samir Passi and Mihaela Vorvoreanu. 2022. Overreliance on AI: Literature Review . Technical Report MSR-TR-2022-12. Microsoft. https://www.microsoft.com/enus/research/publication/overreliance-on-ai-literature-review/ -
We searched by its title and found no matching paper.
- Partly supportedcites [102] [102] Helena Vasconcelos, Matthew Jörke, Madeleine Grunde-McLaughlin, Tobias Gerstenberg, Michael S. Bernstein, and Ranjay Krishna. 2023. Explanations Can Reduce Overreliance on AI Systems During Decision-Making. Proc. ACM Hum.-Comput. Interact. 7, CSCW1, Article 129 (apr 2023), 38 pages. https: //doi.org/10.1145/3579605 - sourceExperimental — accuracy not yet measured
The Introduction defines overreliance as accepting an incorrect AI prediction and says it is concerning in high-stakes domains. The Limitations and Future Work section says the study used a low-stakes maze task and that consequences of wrong decisions could be much higher in high-stakes settings. The paper does not establish disastrous outcomes from people acting on incorrect LLM outputs specifically. (LLM, conf=0.85)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“However, overreliance is notoriously difficult to mitigate, as many mitigations, such as explanations, are found to be ineffective or even can backfire to increase overreliance [7, 83, 84, 107, 118].”
What the sources say
- Supportedcites [7] [7] Gagan Bansal, Tongshuang Wu, Joyce Zhou, Raymond Fok, Besmira Nushi, Ece Kamar, Marco Tulio Ribeiro, and Daniel Weld. 2021. Does the Whole Exceed Its Parts? The Effect of AI Explanations on Complementary Team Performance. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI '21) . Association for Computing Machinery, New York, NY, USA, Article 81, 16 pages. https://doi.org/10.1145/3411764.3445717 - source
Section 6.2 (p. 12) says explanations increased blind trust rather than appropriate reliance on AI. The Introduction (p. 2) also reports that an adaptive explanation intended to reduce blind reliance did not significantly improve team performance. These findings support this paper’s role as evidence for explanations being ineffective or backfiring; the sentence’s broader reference to many mitigations is supported collectively by its citations, not established by this paper alone. (LLM, conf=0.91)
- Not matchedcites [83] [83] Samir Passi and Mihaela Vorvoreanu. 2022. Overreliance on AI: Literature Review . Technical Report MSR-TR-2022-12. Microsoft. https://www.microsoft.com/enus/research/publication/overreliance-on-ai-literature-review/ -
We searched by its title and found no matching paper.
- Could not verifycites [84] [84] Forough Poursabzi-Sangdeh, Daniel G Goldstein, Jake M Hofman, Jennifer Wortman Wortman Vaughan, and Hanna Wallach. 2021. Manipulating and Measuring Model Interpretability. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI '21) . Association for Computing Machinery, New York, NY, USA, Article 237, 52 pages. https://doi.org/10.1145/3411764.3445315 - sourceExperimental — accuracy not yet measured
Our copy of Spatharioti et al. (2023) contains no statement that mitigations of overreliance are ineffective or backfire, and it never examines explanations as a mitigation; searches for 'explanations', 'transparency', 'backfire', 'ineffective', and 'difficult to mitigate' returned only its own mitigation results and related-work framing. On the contrary, Experiment 2 (Sec. 5.1) and the Discussion (Sec. 6) report that color-coded confidence cues more than doubled accuracy on the unreliable task (26% -> 58%/53%) and conclude that 'conveying such signals to users can effectively reduce overreliance'. Related Work (Sec. 2) only notes that algorithmic error-identification efforts have focused on straightforward scenarios (Kadavath et al. 2022; Lin et al. 2022; Yin et al. 2023), which does not carry the claim's point about explanations. The claim, if supported at all, rests on the other citations in the cluster [7, 83, 84, 107, 118], not on this paper. (LLM, conf=0.65)
- Not checked — no full text of the sourcecites [107] [107] Xinru Wang and Ming Yin. 2021. Are explanations helpful? A comparative study of the effects of explanations in AI-assisted decision-making. In 26th International Conference on Intelligent User Interfaces . 318-328. - source
- Partly supportedcites [118] [118] Yunfeng Zhang, Q Vera Liao, and Rachel KE Bellamy. 2020. Effect of confidence and explanation on accuracy and trust calibration in AI-assisted decision making. In Proceedings of the 2020 conference on fairness, accountability, and transparency . 295-305. - sourceExperimental — accuracy not yet measured
In §5.3, the authors report that their local explanations had no perceptible effect on trust calibration. In §4.2, they also describe another study in which explanations increased acceptance of both correct and incorrect AI predictions. These passages support the concern about explanations, but not the broader claim that many mitigations are ineffective or backfire; this paper reports that confidence information improved trust calibration (§3.2). (LLM, conf=0.84)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Third, this allows uncertainty to be expressed seamlessly within the natural language interactions of LLM-infused applications, rather than on the side or in onboarding materials [21, 74, 79] that users might overlook.”
What the sources say
- Not checked — no full text of the sourcecites [21] [21] Carrie J. Cai, Samantha Winter, David Steiner, Lauren Wilcox, and Michael Terry. 2019. "Hello AI": Uncovering the Onboarding Needs of Medical Practitioners for Human-AI Collaborative Decision-Making. Proc. ACM Hum.-Comput. Interact. 3, CSCW, Article 104 (nov 2019), 24 pages. https://doi.org/10.1145/3359206 - source
- Supportedcites [74] [74] Margaret Mitchell, Simone Wu, Andrew Zaldivar, Parker Barnes, Lucy Vasserman, Ben Hutchinson, Elena Spitzer, Inioluwa Deborah Raji, and Timnit Gebru. 2019. Model Cards for Model Reporting. In Proceedings of the Conference on Fairness, Accountability, and Transparency (Atlanta, GA, USA) (FAT* '19) . Association for Computing Machinery, New York, NY, USA, 220-229. https://doi.org/10.1145/3287560.3287596 - source
The Introduction (p. 1) proposes short records that accompany released models and document their performance and intended uses. This supports citing model cards as an example of information supplied alongside an application; the preference for expressing uncertainty within an interaction is the citing authors’ own argument. (LLM, conf=0.85)
- Partly supportedcites [79] [79] OpenAI. 2023. GPT-4 Technical Report. arXiv:2303.08774 [cs.CL] - sourceExperimental — accuracy not yet measured
Section 2.13, p. 60, says GPT-4 uses hedging language within the model, supporting the point that uncertainty can be expressed in its responses. It does not say that users overlook side notices or onboarding materials; instead, it warns that users might become less attentive to hedging and refusal cues over time. (LLM, conf=0.84)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
36 more claims · 3 with their cited sources checked
Create a free account to see all 147 claims and to verify the 8 references still open.
- Probably not a substantial claim. 76
- It may state two separate claims as one. 58
- The quote only partly states this claim. 3
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Lack of metacognition and common sense in LLMs can lead to adverse outcomes if they are overrelied upon in clinical contexts44.”
From Limitations of large language models in clinical problem-solving arising from inflexible reasoning (2025) · cites this paper as [44]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In effort-regulation domains-coding assistants, writing tools, office automation-affective cues such as confident completion and apologetic repair lower the perceived cost of acting on suggestions, reducing verification [8, 58, 87].”
From Caring Without Feeling: Affective Dynamics as the Control Layer of Human-AI Agent Collaboration (2026) · cites this paper as [58]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, current VLMs struggle to communicate their internal uncertainty through natural language [69, 117].”
From "It's trained by non-disabled people": Evaluating How Image Quality Affects Product Captioning with Vision-Language Models (2026) · cites this paper as [69]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Similar patterns are evidenced by prior research using AI-generated content [38], where users tend to overestimate their capabilities and those of AI [28, 36].”
From How University Disability Services Professionals Write Image Descriptions for HCI Figures Using Generative AI (2026) · cites this paper as [38]
The cited source says what the claim attributes to it.
In the citing paper
“Mitigating indirect action and language by outputting confident advice can backfire if the recommendations are wrong, echoing concerns on overconfidence and miscalibration (Kim et al., 2024;Zhou et al., 2023).”
From Sycophantic AI decreases prosocial intentions and promotes dependence (2026) · cites this paper as Kim et al., 2024
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Task 3 / 8 · p. 2
“No, an adult who has not had chickenpox cannot get shingles without having had chickenpox before. Both chickenpox and shingles are caused by the varicella-zoster virus [1]. When a person is exposed to the virus, they develop chickenpox and may develop shingles later in life [1].”
§ AI responses used · p. 25
“- Not uncertain : No, an adult who has not had chickenpox cannot get shingles. Shingles is caused by the varicella-zoster virus which is the same virus that causes chickenpox. If you have never had chickenpox, you cannot get shingles. However, if you have not had chickenpox and you come into contact with someone who has shingles, you can get chickenpox [1] [2].”
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007) · Behavior Research Methods · doi:10.3758/bf03193146 · Cited by 65,971
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931
Statistical power analyses using G∗Power 3.1: tests for correlation and regression analyses
Faul, F., Erdfelder, E., Buchner, A., & Lang, A.-G. (2009) · Behavior Research Methods · doi:10.3758/brm.41.4.1149 · Cited by 37,615
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
An integrative model of organizational trust
Mayer, R. C., Davis, J. H., & Schoorman, F. D. (1995) · The Academy of Management Review · doi:10.2307/258792 · Cited by 10,736
Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393980 · Cited by 9,996
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988
Survey of Hallucination in Natural Language Generation
Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y. J., Madotto, A., & Fung, P. (2023) · ACM Computing Surveys · doi:10.1145/3571730 · Cited by 5,025
Survey of Hallucination in Natural Language Generation
Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y., Chen, D., Dai, W., et al. (2022) · arXiv · doi:10.48550/arxiv.2202.03629 · Cited by 4,981
Research works printed but not linked: 3
- [63] Jennifer M. Logg. 2017. Theory of Machine: When Do People Rely on Algorithms? (2017). Harvard Business School NOM Unit Working Paper No. 17-086. -
- [83] Samir Passi and Mihaela Vorvoreanu. 2022. Overreliance on AI: Literature Review . Technical Report MSR-TR-2022-12. Microsoft. https://www.microsoft.com/enus/research/publication/overreliance-on-ai-literature-review/ -
- [110] Benjamin Weiser and Nate Schweber. 2023. The ChatGPT Lawyer Explains Himself. New York Times (June 2023). -
Cited by
Sycophantic AI decreases prosocial intentions and promotes dependence
Cheng, M., Lee, C., Khadpe, P., Yu, S., Han, D., & Jurafsky, D. (2026) · Science · doi:10.1126/science.aec8352 · Cited by 185
Limitations of large language models in clinical problem-solving arising from inflexible reasoning
Kim, J., Podlasek, A., Shidara, K., Liu, F., Alaa, A., & Bernardo, D. (2025) · Scientific Reports · doi:10.1038/s41598-025-22940-0 · Cited by 78
“The best course of action in this scenario, considering the patient’s condition and the fact that they are on both warfarin and aspirin, which increases the risk of bleeding, would be:”
Hou, C., Zhu, G., Sudarshan, V., Lim, F. S., & Ong, Y. S. (2025) · Computers & Education · doi:10.1016/j.compedu.2025.105329 · Cited by 70
Kim, S. S. Y., Vaughan, J. W., Liao, Q. V., Lombrozo, T., & Russakovsky, O. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714020 · Cited by 58
Self-citationJavaid, S., Khalil, R. A., Saeed, N., He, B., & Alouini, M. (2024) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2024.3522103 · Cited by 93
“This includes developing frameworks for continuous monitoring and auditing of LLM outputs, implementing robust security measures to protect against adversarial attacks, and establishing protocols for the human oversight of automated decisions [32], [227], [228].”
Fact-checking information from large language models can decrease headline discernment
DeVerna, M., Yan, H. Y., Yang, K.-C., & Menczer, F. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2322823121 · Cited by 146
Peykani, P., Ramezanlou, F., Tănăsescu, C. R., & Ghanidel, S. (2025) · Applied Sciences · doi:10.3390/app15148103 · Cited by 84
To Rely or Not to Rely? Evaluating Interventions for Appropriate Reliance on Large Language Models
Bo, J. Y., Wan, S., & Anderson, A. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714097 · Cited by 36
Which Contributions Deserve Credit? Perceptions of Attribution in Human-AI Co-Creation
He, J., Houde, S., & Weisz, J. D. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713522 · Cited by 36
“…yet plausible-sounding text [35], has led researchers to explore techniques for mitigating overreliance on generated texts: attributing sources of information [23], identifying and drawing attention to model uncertainties [42, 89], and predicting the likelihood of requiring human ed-its [82].”
Know Your Limits: A Survey of Abstention in Large Language Models
Wen, B., Yao, J., Feng, S., Xu, C., Tsvetkov, Y., Howe, B., & Wang, L. L. (2025) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00754 · Cited by 56
Buçinca, Z., Swaroop, S., Paluch, A. E., Doshi‐Velez, F., & Gajos, K. Z. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713229 · Cited by 76
“…individuals develop a mental model of the AI [19, 20, 52, 73, 74, 78], providing meta-information about the AI’s uncertainty and limitations [16, 55, 73], helping individuals calibrate their own self-confidence about the task [40, 66], or enhance user agency by giving them control over input…”
Effects of LLM-based Search on Decision Making: Speed, Accuracy, and Overreliance
Spatharioti, S. E., Rothschild, D., Goldstein, D. G., & Hofman, J. M. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714082 · Cited by 36
“More recent work has explored using natural language to communicate uncertainty (e.g., “I’m not sure, but...”), finding that such approaches reduce overre-liance, although the exact wording impacts effectiveness [21].”
A Taxonomy of Linguistic Expressions That Contribute To Anthropomorphism of Language Technologies
DeVrio, A., Cheng, M., Egede, L., Olteanu, A., & Blodgett, S. L. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714038 · Cited by 85
“While this trust can be beneficial in some contexts [130], it can also be misplaced, leading users to rely on technology when it does not merit such confidence and overestimate its capabilities [1, 14, 54, 63, 75].”
Everyday Uncertainty: How Blind People Use GenAI Tools for Information Access
Tang, X., Abdolrahmani, A., Gergle, D., & Piper, A. M. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713433 · Cited by 30
He, G., Demartini, G., & Gadiraju, U. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713218 · Cited by 23
Xu, Z., Song, T., & Lee, Y.-C. (2025) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2025.103455 · Cited by 18
Building Appropriate Mental Models: What Users Know and Want to Know about an Agentic AI Chatbot
Brachman, M., Kunde, S., Miller, S., Fucs, A., Dempsey, S., Jabbour, J., & Geyer, W. (2025) · Proceedings of the 30th International Conference on Intelligent User Interfaces · doi:10.1145/3708359.3712071 · Cited by 18
Show Me the Work: Fact-Checkers' Requirements for Explainable Automated Fact-Checking
Warren, G., Shklovski, I., & Augenstein, I. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713277 · Cited by 67
From Text to Trust: Empowering AI-assisted Decision Making with Adaptive LLM-powered Analysis
Li, Z., Zhu, H., Lu, Z., Xiao, Z., & Yin, M. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713133 · Cited by 38
“However, it was found that the overcon-fident and seemingly convincing LLM outputs can mislead people to believe them to be correct [87] and result in people’s overre-liance on LLM [14, 36].”
Freiberger, V., Fleig, A., & Buchmann, E. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3719816 · Cited by 32
Bentegeac, R., Guellec, B. L., Kuchcinski, G., Amouyel, P., & Hamroun, A. (2025) · Journal of Medical Internet Research · doi:10.2196/64348 · Cited by 40
A vision of human–AI collaboration for enhanced biological collection curation and research
Stenhouse, A., Fisher, N., Lepschi, B. J., Schmidt‐Lebuhn, A. N., Rodríguez, J., Turco, F., Reeson, A. F., Paris, C. L., & Thrall, P. H. (2025) · BioScience · doi:10.1093/biosci/biaf021 · Cited by 15
Mathis, F., & Schöning, J. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713486 · Cited by 23
Exploring Trust and Transparency in Retrieval-Augmented Generation for Domain Experts
Ravi, D., & Sindhgatta, R. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3719985 · Cited by 11
Authorship Drift: How Self-Efficacy and Trust Evolve During LLM-Assisted Writing
Park, Y. S., Arvi, N. A. P., Kim, S., & Kim, J. (2026) · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790276 · Cited by 8
Self-citationGalindez-Acosta, J. S., & Giraldo-Huertas, J. J. (2026) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2026.101024 · Cited by 19
Basoah, J., Chechelnitsky, D., Long, T., Reinecke, K., Zerva, C., Zhou, K., Díaz, M., & Sap, M. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732045 · Cited by 30
Passi, S., Dhanorkar, S., & Vorvoreanu, M. (2025) · Springer eBooks · doi:10.1007/978-981-95-3658-0_98 · Cited by 15
Self-citationRaees, M., Khan, V.-J., Lykourentzou, I., & Papangelis, K. (2026) · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791467 · Cited by 5
Yen, R., Xie, Y., Sultanum, N., & Zhao, J. (2025) · Designing Interactive Systems Conference · doi:10.1145/3715336.3735752 · Cited by 10
Chen, A., Kim, S. S. Y., Dharmasiri, A., Russakovsky, O., & Fan, J. E. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3719710 · Cited by 14
Self-citationChen, R., Wang, R., Sadeh, N., & Fang, F. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732050 · Cited by 13
Koçyiğit, E., Rossi, A., Sergeeva, A., Negri-Ribalta, C., Farjami, A., & Lenzini, G. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732129 · Cited by 9
Li, T. W., Song, Y., Sundaram, H., & Karahalios, K. G. (2025) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/3698205.3729550 · Cited by 7
“For instance, users perform worse when relying on AI-infused search engines that provide incorrect medical answers [40], overtrust mis-leading product comparisons from LLM-based tools [84], and often fail to detect inaccuracies from imperfect assistants in productivity tasks [38].”
Characterizing the spiral: potential mechanisms in AI-associated delusions
Augustin, M., Pollak, T. A., & Morrin, H. (2026) · NPP—Digital Psychiatry and Neuroscience · doi:10.1038/s44277-026-00065-0 · Cited by 17
“A suitable method to counter overreliance on AI may be for LLMs to transparently express uncertainty [67].”
ELMI: Interactive and Intelligent Sign Language Translation of Lyrics for Song Signing
Yoo, S., Truong, K. N., & Kim, Y. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713973 · Cited by 9
“Therefore, it is important to consider the user’s proficiency level and fine-tune feedback accordingly.”
From Trust to Appropriate Reliance: Measurement Constructs in Human-AI Decision-Making
Raees, M., & Papangelis, K. (2026) · arXiv · doi:10.48550/arxiv.2604.23896 · Cited by 5
Zhang, C., Zhu, S., Yang, X., Tseng, Y.-C., Jiang, S., & Rzeszotarski, J. M. (2025) · Proceedings of the 7th ACM Conference on Conversational User Interfaces · doi:10.1145/3719160.3736618 · Cited by 4
Impact of Agent-Generated Rationales on Online Social Conformity
de Jong, S., Jacobsen, R. M., Wester, J., Wijenayake, S., Gonçalves, J., & van Berkel, N. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732217 · Cited by 13
Liu, M., Okuhara, T., Shirabe, R., Nishiie, Y., Xu, Y., Okada, H., & Kiuchi, T. (2025) · JMIR AI · doi:10.2196/78436 · Cited by 6
Risk and liability in the deployment of AI systems for surgery: a SAGES white paper
Hashimoto, D. A., Marwaha, J. S., Lee, S. A., Schwaitzberg, S. D., & Duffourc, M. (2026) · Surgical Endoscopy · doi:10.1007/s00464-026-12881-8 · Cited by 12
Prajod, P., Cools, H., Röggla, T., Venkatraj, K. P., Kusters, A., ElKattan, A., Cesar, P. S., & Ali, A. E. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812386 · Cited by 15
“Through this approach, we assess both explicit and implicit responses to AI disclosures in news content.”
Mapping the Trust Terrain: LLMs in Software Engineering—Insights and Perspectives
Khati, D., Liu, Y., Palacio, D. N., Zhang, Y., & Poshyvanyk, D. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3771282 · Cited by 29
Lee, D., Todorova, C., & Dehghani, A. (2024) · Conference on Human Centred Artificial Intelligence - Education and Practice (HCAIep) · doi:10.1145/3701268.3701272 · Cited by 13
Jo, J., Zhang, H., Cai, J., & Goyal, N. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732077 · Cited by 17
Carrasco, A., Escarzaga, A. M., Gamez, A. A., Rodriguez, E. A., Xiong, S., & Carrasco, K. (2025) · Contemporary School Psychology · doi:10.1007/s40688-025-00554-7 · Cited by 3
“Specifically, the integration of LLMs into school psychology settings has raised concerns about data privacy, content accuracy, and the potential for misuse or overreliance on automated processes (Kim et al., 2024; Yan et al., 2024; Yao et al., 2023 ).”
Understanding the Effects of Explaining Predictive but Unintuitive Features in Human-XAI Interaction
Qu, J., Arguello, J., & Wang, Y. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732021 · Cited by 7
Boie, S. D., Reis, F., Frey, N., Grünewald, E., & Balzer, F. (2026) · Journal of Medical Systems · doi:10.1007/s10916-026-02430-0 · Cited by 13
Exploring human-swarm interaction dynamics in cyber-physical systems: A physiological approach
Distefano, J. P., Chowdhury, S., & Esfahani, E. T. (2023) · Journal of Integrated Design and Process Science · doi:10.1177/10920617241292155 · Cited by 4
“There are also some recent studies on developing explainable AI to adjust the human reliance on AI advice via explanations (Schemmer et al., 2023) and Uncertainty Expression (Kim et al., 2024) that can be compared or combined with our cognitive approach in future work.”
Examining Age-Bias and Stereotypes of Aging in LLMs
Dewan, S., Shaikh, I., Shaw, C., Sahoo, A. K., Jha, A., & Pradhan, A. (2025) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3663547.3746464 · Cited by 6
Pang, R. Y., Feng, K. J. K., Feng, S., Li, C., Shi, W., Tsvetkov, Y., Heer, J., & Reinecke, K. (2026) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3742413.3789091 · Cited by 40
Liu, Y., Shah, A., Ackerman, J., & Saha, M. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714262 · Cited by 15
Garg, K., Tang, X., Heo, J., Morgan, D. R., Gergle, D., Sudderth, E. B., & Piper, A. M. (2026) · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791309 · Cited by 3
“However, current VLMs struggle to communicate their internal uncertainty through natural language [69, 117].”
What Lies Beneath? Exploring the Impact of Underlying AI Model Updates in AI-Infused Systems
Mohanty, V., Lim, J., & Luther, K. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713751 · Cited by 13
Un-trusting the Chat: Designing for Calibrated Trust in Retrieval-Augmented Conversations
von Reeken, T., Salous, M., & Abdenebaoui, L. (2025) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3719160.3737620 · Cited by 5
The Enterprising and Elusive Prospects of Human-AI Collaboration
Gadiraju, U., & Balayn, A. (2025) · Springer eBooks · doi:10.1007/978-3-032-01940-0_7 · Cited by 5
Pal, O., Duddu, V., Goyal, A., Goel, D., & Saha, K. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3799386 · Cited by 6
Gao, Z., & Thebault-Spieker, J. (2026) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3788058 · Cited by 3
Are You Sure About That: Eliciting Natural Language Confidence Indicators from Chatbots
Toney, A., & Singh, L. (2024) · International Conference on Human-Agent Interaction (HAI) · doi:10.1145/3687272.3688318 · Cited by 4
Lodoen, S., & Orchard, A. (2025) · IEEE International Symposium on Ethics in Engineering, Science, and Technology (ETHICS) · doi:10.1109/ethics65148.2025.11098367 · Cited by 6
“The study also found, however, that “AI’s uncertainty expression decreases agreement with the AI system” [59, p. 827]—so, that trust and reliance in AI systems are to a large extent a matter of the chatbot’s modality of certainty in its delivery of information.”
InfluentialWhen Help Hurts: Verification Load and Fatigue with AI Coding Assistants
Fan, G. F., Liu, D., Pan, L., & Zhang, R. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791176 · Cited by 11
Kim, S., Jo, Y., Na, S., Lim, H., Lee, E., Choi, Y. M., Cho, S., & Hong, H. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790820 · Cited by 3
Self-citationLi, T. W., Song, Y., Sundaram, H., & Karahalios, K. G. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791940 · Cited by 3
“In the two UNCERTAIN conditions, the chatbot added hedges from both general (e.g., “It seems like” ) and first-person perspectives (e.g., “I am not entirely sure, but” ) [40] to each response.”
InfluentialAre We Automating the Joy Out of Work? Designing AI to Augment Work, Not Meaning
Ranjit, J., Zhou, K., Swayamdipta, S., & Quercia, D. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791845 · Cited by 9
“Prior work has identified which tasks are exposed to AI and has explored design choices that promote trust and reliability [47].”
Characterizing User-Reported Risks across LLM Chatbots
Li, L., Ma, R., Xue, Z., & Xiong, J. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791505 · Cited by 3
“For example, Kim et al. find that first-person phrases like “I’m not sure, but...” can reduce overreliance on LLM-generated answers [62].”
Mathur, N., Rahman, H., & Desai, S. (2026) · Proceedings of the Extended Abstracts of the 2026 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772363.3798685 · Cited by 1
Human at the Center: A Framework for Human‐Driven AI Development
Hu, D., Acosta-Navas, D., Gaube, S., Mozannar, H., Taylor, M. E., Dvijotham, K., & Bondi, E. (2025) · AI Magazine · doi:10.1002/aaai.70043 · Cited by 4
If It’s Safe, Don’t Ask: Decreasing Frustration through User Involvement for Risky Robot Behaviors
Leusmann, J., Schömbs, S., Diedrich, M., & Müller, F. (2026) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3757279.3785545 · Cited by 2
Lee, J. (2026) · Psychoactives · doi:10.3390/psychoactives5010006 · Cited by 1
Reinhard, P., Li, M. M., Peters, C., & Leimeister, J. M. (2026) · Information Systems Frontiers · doi:10.1007/s10796-026-10716-4 · Cited by 13
“Confidence A less studied but growing field involves the user’s confidence in their decision-making (e.g., Lee & Ram, 2023; Kim et al., 2024).”
Inaccuracies, omissions, and bullshit: 2024 U.S. elections through the eyes of ChatGPT
Jang, H., McGregor, S. C., & Neill, L. (2026) · Information Communication & Society · doi:10.1080/1369118x.2026.2685121 · Cited by 3
Tu, X., Biondani, F., Amin, D., Fabillar, A., Xuan, T. T. T., Adeel, H. B., Tervola, S. M. H., Berlingeri, C., Fummi, F., Salminen, J. O., et al. (2026) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3742413.3789084
CURE2026: Communicating Uncertainty to foster Realistic Expectations via Human-Centered Design
Gajcin, J., Jeromela, J., Wester, J., Schömbs, S., Kleanthous, S., Ramamurthy, K. N., Hauptmann, H., & Amin, R. M. (2026) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3742414.3794961 · Cited by 2
“…representation on mobile screens through quantile dot-plots [18], to a text-based frequency [5] or frst person uncertainty communication via LLMs [19], to an embodied uncertainty communication through an agent’s hesitation gestures [26], interfaces play a central role in enabling personalized,…”
Sensemaking in Multi-Agent LLM Interfaces: How Users Interpret Transparency and Trustworthiness Cues
Pareek, S., Govers, J., Kollerup, N. K., Wong, E., Velloso, E., & Gonçalves, J. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791157 · Cited by 6
Zheng, Z., Yu, C., Chen, W., Song, M., Liu, B., Liu, J., Wang, S., Wang, X. Q., Cai, J., & Shi, Y. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790318 · Cited by 2
More Isn't Always Better: Balancing Decision Accuracy and Conformity Pressures in Multi-AI Advice
Tsuchiya, Y., & Baba, Y. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791648 · Cited by 4
Interface Support for Evaluating Disability Bias in AI-Generated Images
Mack, K., Jiang, L., Zhang, L., & Findlater, L. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791922
Xu, Y., Zhu, Y., Wang, H., Wu, Y. G., Ouyang, Y., Li, H., Zhou, W., Liu, X., Jiang, C., & Li, Q. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790835 · Cited by 5
Song, J., Cho, A., Lee, S., Choe, K., & Seo, J. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791657 · Cited by 3
Forage: Understanding LLM-facilitated sensemaking of conversation data
Schroeder, H., Beeferman, D., Detwiller, M. E., Dimitrakopoulou, D., & Roy, D. K. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791640
Raees, M., Iwamoto, Y., Papangelis, K., Heard, J., & Tigwell, G. W. (2026) · arXiv · doi:10.48550/arxiv.2602.08937 · Cited by 2
Over-Relying on Reliance: Towards Realistic Evaluations of AI-Based Clinical Decision Support
Sivaraman, V., Morrison, K., Epperson, W., & Perer, A. (2025) · arXiv · doi:10.48550/arxiv.2504.07423 · Cited by 1
The impact of generative AI search result design on user perceptions and information adoption
Li, A. (2026) · Proceedings of the 2026 Conference on Human Information Interaction and Retrieval · doi:10.1145/3786304.3787937
Analyzing Patterns of Conversational Breakdown in Human-Chatbot Customer Service Conversations
Braggaar, A., Kunneman, F., & van Miltenburg, E. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-88045-2_1 · Cited by 1
Ties of Trust: a bowtie model to uncover trustor-trustee relationships in LLMs
Paraschou, E., Michali, M., Yfantidou, S., Karamanidis, S., Kalogeros, S. R., & Vakali, A. I. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732115 · Cited by 9
“Application-specific features like LLMs’ “uncertainty” [33] and “regret” expressions [45] influence trust levels, though anthropomorphism decreases trust in ChatGPT [17, 30].”
InfluentialDeterminants of Verification Behavior in Generative Search: Evidence from a Conjoint ExperimentPreprint
Knor, E. L., Reiss, M. V., Möller, J. E., & Merten, L. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5364791
Enhance Trust-worthiness of LLM-Based Social agent through Self-calibration
Shen, S., Kraus, M., & André, E. (2025) · ACM International Conference on Intelligent Virtual Agents (IVA) · doi:10.1145/3742886.3756745 · Cited by 1
The AI Trust Paradox: Designing Interpretable and Reliable ChatbotsPreprint
Jaidka, K., & Cai, M. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5632850 · Cited by 1
Para, R. K., & Krishnamoorthy, D. (2025) · International Conference on Intelligent Communication Networks and Computational Techniques (ICICNCT) · doi:10.1109/icicnct66124.2025.11232864
“Behavioral economics research further shows that how uncertainty is communicated directly shapes decision-making outcomes, with explicit acknowledgment of doubt helping users calibrate trust and avoid over-reliance even if it slightly lowers confidence perceptions [2].”
Huang, Y., Guo, J., Zeng, J., Gao, C., Han, P., & Liu, C. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-3346-6_22
HiLDE: Intentional Code Generation via Human-in-the-Loop Decoding
Gonzalez, E. A., Rothkopf, R., Lerner, S., & Polikarpova, N. (2025) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vl-hcc65237.2025.00032 · Cited by 5
“Kim et al. [40] show that natural language expressions of uncertainty are effective in reducing overreliance on LLM responses, and that assertive has a significant impact.”
Between Privacy and Transparency: Exploring the Ways of Communicating Credibility Assessment
Tang, H., Rohles, B., Chuai, Y., Lenzini, G., & Sergeeva, A. (2025) · European Symposium on Usable Security (EuroUSEC) · doi:10.1109/eurousec69254.2025.00018 · Cited by 2
“The study procedure was closely aligned with similar research on the influence of hypothetical AI systems on user behavior and perception, including the effects of presentation modes [38], [88]–[90].”
Ku, W. L., Liu, Y., Zhang, W., & An, P. (2025) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3714394.3754374 · Cited by 1
“While efforts to improve content transparency and reliability continue [11, 23], the role of framing in news presentation remains underexplored [6, 10].”
Overreliance on AI in Oil and Gas Cybersecurity: A Review of Risks and Mitigation Strategies
Alkhalaf, D., Shareef, R., Almousa, S., & Alshamrani, S. (2026) · IPTC Summit on AI for the Energy Industry · doi:10.2523/iptc-25174-ms · Cited by 1
The Ability of Artificial Intelligence to Create Mind Maps with the Effect of Insight
Ivanova, S., Dimitrov, L. V., Ivanov, V., & Volkova, M. (2026) · Lecture notes in mechanical engineering · doi:10.1007/978-3-032-14926-8_48
Critical thinking in human-AI collaborationsPreprint
Bilen, E., & Hervé, J. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6304755 · Cited by 1
McCallion, B. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6242458
Evaluating the Performance of Large Language Models in Vascular Surgery Cases: Cross-Sectional Study
Wijetunga, A., Wang, Y., Yaghi, C., & Vicaretti, M. (2026) · JMIR Perioperative Medicine · doi:10.2196/91973
Mirabelli, G., Padovano, A., Rocca, G., Sammarco, C., Solina, V., & Savigne, J. E. S. (2026) · Procedia Computer Science · doi:10.1016/j.procs.2026.02.427
Luo, M. M., Zhang, P. M., Xu, W., Su, H., Zhou, X., Yan, H., & Cummings, J. J. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6464746
Metadata
- Authors
- Kim, S. S. Y., Liao, Q. V., Vorvoreanu, M., Ballard, S., & Vaughan, J. W.
- Affiliations
- Princeton University (US)
- Microsoft (Canada) (CA)
- Microsoft (United States) (US)
- Venue
- The 2024 ACM Conference on Fairness Accountability and Transparency
- Publisher
- ACM
- Published
- 2024-06-03
- Pages
- 822-835
- OpenAlex
- W4396802056
- Cited by
- 147
- References
- 82
- Citations by year
- 2026: 83 · 2025: 58 · 2024: 5
- FWCI
- 97.62
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion, cc-by-nd)
- arXiv (Cornell University) (submittedVersion, cc-by-nc-nd)
- arXiv (Cornell University)
- Funders
- Princeton SEAS
- Microsoft Research
- NSF
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Keywords
- large language models, uncertainty expression, overreliance, trust in AI, medical question answering, self-reported confidence, task performance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.