Improving Human-AI Collaboration With Descriptions of AI Behavior
Open accessThe DOI matches its Crossref record; 73 of the 76 references it cites were found in a registry or an index; 23 of the 38 sources its claims cite were checked for support.
Abstract
People work with AI systems to improve their decision making, but often under- or over-rely on AI predictions and perform worse than they would have unassisted. To help people appropriately rely on AI aids, we propose showing them behavior descriptions, details of how AI systems perform on subgroups of instances. We tested the efficacy of behavior descriptions through user studies with 225 participants in three distinct domains: fake review detection, satellite image classification, and bird classification. We found that behavior descriptions can increase human-AI accuracy through two mechanisms: helping people identify AI failures and increasing people's reliance on the AI when it is more accurate. These findings highlight the importance of people's mental models in human-AI collaboration and show that informing people of high-level AI behaviors can significantly improve AI-assisted decision making.
Overview
CoChat Summary
TL;DR
This paper tests whether showing people short, subgroup-level descriptions of an AI’s behavior helps them collaborate better with the AI. In three Amazon Mechanical Turk classification studies with 225 participants, behavior descriptions improved performance in two tasks, but did not change participants’ reported trust, helpfulness, or willingness to reuse the AI.
Key findings
- Across the three tasks, behavior descriptions significantly improved overall accuracy in 2 of 3 domains: reviews and birds; the satellite task showed no significant overall improvement.
- In the reviews task, accuracy differed across conditions with F(2,64) = 9.18, p < 0.001; the only significant pairwise difference was between No AI and AI + BD (p < 0.001, 95% CI [0.06, 0.22]).
- In the birds task, accuracy differed across conditions with F(2,65) = 3.98, p = 0.023; the only significant pairwise difference was between No AI and AI + BD (p = 0.048, 95% CI [0.00, 0.16]), and this produced complementary human-AI accuracy.
- The proposed mechanism in H2 was only partially supported: in reviews, there were no accuracy differences for the behavior-description groups, while in birds, group 2 showed a significant difference (F(2,65) = 6.81, p = 0.002) and supported H2; overall, increased accuracy also came from greater reliance on the AI in the main group.
Methods
- Three between-subjects human-subject experiments were run on Amazon Mechanical Turk with 225 U.S. participants total, across fake review detection, satellite image classification, and bird classification.
- Each participant labeled 30 instances: 20 from the main group and 5 each from two behavior-description groups; in the AI + BD condition, participants saw a behavior description for those subgroup instances.
- Main analyses used ANOVA with Tukey post-hoc tests for accuracy, Mann-Whitney U tests with Bonferroni corrections for Likert items, and linear models to test learning effects.
Limitations
- The paper states that participants were Amazon Mechanical Turk workers with limited domain expertise, so results may differ for domain experts/professionals; the authors explicitly say future studies should test that.
- The study was a controlled simulated setting, so effects may differ in real-world consequential settings such as radiology; the paper explicitly notes this.
- The paper says it tested one specific type of behavior description—subgroup accuracy—so the generality to other behavior-description formats is not established; the text makes evident this is a design-scope limitation.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
![Fig. 1 Don Norman's mental model framework [43] describes how designers use their mental models to implement systems. End-users then interact with the systems and develop their own mental models of how they believe the systems work. While this process is similar for AI models, a key difference is that an AI is not a direct representation of a developer's intent, but a stochastic model learned from data. This means that (1) AI developers themselves have to make sense of what an AI system has learned through testing and iteration. Subsequently, they can encode these insights as (2) behavior descriptions , details of how an AI performs on subgroups of instances, that can be shown to end-users to improve human-AI collaboration.](https://figures.cochat.ai/paper-figures/8a25e79489564f9f8cbc1e6321036c0b/improving-human-ai-collaboration-with-descriptions-of-ai-behavior-figure-1.png)









Verification
Claims the paper makes
14 Valid · 3 Not valid · 12 Not checked · 84 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“First, modern AI systems are often black-box models for which humans cannot see how or why the model made a prediction [54].”
What the sources say
- Supportedcites [54] [54] Cynthia Rudin. 2019. Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nature Machine Intelligence 1, 5 (May 2019), 206-215. https://doi.org/10.1038/s42256-019-0048-x - source
The Introduction says that many machine-learning models used for high-stakes predictions are black boxes that do not explain their predictions in a way humans can understand. This supports the citing sentence’s paraphrase. (LLM, conf=0.94)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Despite the insights post-hoc model explanations can provide end-users, they have been found to have a small or even detrimental effect on the performance of AI-assisted decision making [17, 34].”
What the sources say
- Partly supportedcites [17] [17] Eric Chu, Deb Roy, and Jacob Andreas. 2020. Are Visual Explanations Useful? A Case Study in Model-in-the-Loop Prediction. arXiv:2007.12248 [cs, stat] (July 2020). http://arxiv.org/abs/2007.12248 arXiv: 2007.12248. - sourceExperimental — accuracy not yet measured
Chu et al. (2020) support the 'small effect' half of the claim: Section 3.1 (p. 5) states 'The addition of explanations did not improve accuracy' and that explanation-without-prediction treatments 'resulted in small and non statistically significant effects', and the Conclusion (p. 8) reports that showing explanations 'did not have a significant effect on accuracy, trust, or understanding'. However, our copy contains no finding that explanations were detrimental to performance in their own trial — the ordering explain-strong < explain-spurious < explain-random is explicitly called small and non-significant (p. 5), and even faulty explanations 'did not significantly decrease human trust'. The detrimental/hindering results the claim bundles in appear only as reports of other work in Related Work (p. 8), e.g. accuracy decreases in [49] and transparency hindering error detection in [34]. (LLM, conf=0.72)
- Partly supportedcites [34] [34] Vivian Lai and Chenhao Tan. 2019. On Human Predictions with Explanations and Predictions of Machine Learning Models: A Case Study on Deception Detection. In Proceedings of the Conference on Fairness, Accountability, and Transparency. ACM, Atlanta GA USA, 29-38. https://doi.org/10.1145/3287560.3287590 - sourceExperimental — accuracy not yet measured
Section 4.1 (p. 6) reports that explanations alone slightly improved human accuracy in the paper’s deception-detection task, supporting the ‘small effect’ part. It does not report a detrimental effect on decision-making performance; the Concluding Discussion (p. 9) raises a separate concern that irrelevant explanations can increase trust in machine predictions. (LLM, conf=0.88)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“In another empirical study, Hopkins and Booth [23] found that practitioners would avoid or limit model updates due to concerns about breaking their models and introducing more failures.”
What the sources say
- Supportedcites Hopkins and Booth [23] [23] Aspen Hopkins and Serena Booth. 2021. Machine Learning Practices Outside Big Tech: How Resource Constraints Challenge Responsible Development. In AIES 2021 - Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society. Association for Computing Machinery, Inc, 134-145. https://doi.org/10.1145/3461702.3462527 - source
Section 4.2.1 (Bias Mitigation Through Diversity or Personalization) states that teams delayed introducing new, diverse data 'until user requirements deemed it strictly necessary,' and that 'By doing so, they minimized how frequently they updated-and potentially broke-their models,' describing this slow, cautious strategy as 'common in production' — directly supporting avoidance/limitation of updates for fear of breaking models. Section 4.1.3 corroborates the failure concern: R13's retraining on each new data iteration produced 'unpredictable performance drops' and they weighed decomposing the model to scale 'without the risk of compromising past performance.' Section 4.5.4 adds that less experienced organizations 'might not afford retraining and replacing models,' with R3 calling ML development 'notably slow and defensive.' (LLM, conf=0.88)
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“We chose this task since it has been used in previous studies of human-AI collaboration to test the effect of explanations [34] and tutorials [33].”
What the sources say
- Supportedcites [34] [34] Vivian Lai and Chenhao Tan. 2019. On Human Predictions with Explanations and Predictions of Machine Learning Models: A Case Study on Deception Detection. In Proceedings of the Conference on Fairness, Accountability, and Transparency. ACM, Atlanta GA USA, 29-38. https://doi.org/10.1145/3287560.3287590 - source
The paper describes using deceptive-review detection to study human decisions assisted by machine-learning models (Related Work, p. 3). It tests explanations of machine predictions as a form of assistance (ACM Reference Format, p. 2). The tutorials portion of the citing sentence has a separate citation and is not attributed to this source. (LLM, conf=0.93)
- Supportedcites [33] [33] Vivian Lai, Han Liu, and Chenhao Tan. 2020. "Why is 'Chicago' Deceptive?" Towards Building Model-Driven Tutorials for Humans. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1-13. https://doi.org/10.1145/3313831.3376873 - source
The citation to this paper is attached to “tutorials,” not “explanations.” The Introduction (p. 2) says the authors used deceptive review detection as a testbed for experiments on whether tutorials improve human performance, and the Abstract (p. 1) reports that the tutorials did improve it. (LLM, conf=0.94)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“ML practitioners interviewed by Holstein et al. [22] would often try to fix one problem that would cause the model to start failing in other unrelated ways.”
What the sources say
- Partly supportedcites Holstein et al. [22] [22] Kenneth Holstein, Jennifer Wortman Vaughan, Hal Daumé, Miro Dudik, and Hanna Wallach. 2019. Improving Fairness in Machine Learning Systems: What Do Industry Practitioners Need?. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, Glasgow Scotland Uk, 1-16. https://doi.org/10.1145/3290605.3300830 - sourceExperimental — accuracy not yet measured
In “Addressing Detected Issues” (p. 11), interviewees describe fairness fixes that sometimes produced unexpected harms or other forms of unfairness. This supports the idea that fixing one issue could create another, but not the claim that practitioners often caused models to fail in unrelated ways. (LLM, conf=0.85)
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
54 more claims · 3 with their cited sources checked
Create a free account to see all 113 claims and to verify the 6 references still open.
- It may state two separate claims as one. 34
- Probably not a substantial claim. 24
Citations
Cites
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555 · cited 1×
“LIME [50] is one such method, which fits linear models to a neighborhood of instances to highlight which features most influenced a model’s prediction.”
MethodAdvances in neural information processing systems 7
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90463-0 · Cited by 14,281
Kaugeranna, R., Kaugeranna, E., & Aion, (. S. 4. 6. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.giscience.2023.43 · Cited by 13,690
Rudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561 · cited 2×
“Glass-box models can be easier to debug and trace, improving people’s ability to understand AI predictions [54].”
BackgroundTrust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 4×
“A detailed and accurate mental model allows a person to effectively complement an AI system by appropriately relying [37] on its output, while an overly simple or wrong mental model can lead to blind spots and systematic failures [3, 8].”
BackgroundInfluentialKuznetsova, A., Rom, H., Alldrin, N., Uijlings, J., Krasin, I., Pont-Tuset, J., Kamali, S., Popov, S., Malloci, M., Kolesnikov, A., et al. (2018) · arXiv · doi:10.48550/arxiv.1811.00982 · Cited by 3,653
Remote Sensing Image Scene Classification: Benchmark and State of the Art
Cheng, G., Han, J., & Lu, X. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2675998 · Cited by 2,926 · cited 2×
“The satellite images come from the NWPU-RESISC45 dataset [16], which has 31,500 satellite images across 45 classes.”
MethodHuman trust in artificial intelligence: Review of empirical research
Glikson, E., & Woolley, A. W. (2020) · Academy of Management Annals · doi:10.5465/annals.2018.0057 · Cited by 2,921 · cited 1×
“Although unexpected, the effect is corroborated by studies on trust in AI systems that found that low reliability, AI output that violates people’s over time, decreases trust and reliance in an AI [20].”
ResultSemantics derived automatically from language corpora contain human-like biases
Caliskan, A., Bryson, J. J., & Narayanan, A. (2017) · Science · doi:10.1126/science.aal4230 · Cited by 2,887 · cited 1×
“Despite the growing capability of NLP models, many state-of-the-art systems still encode serious biases and harms [13] and fail basic logical tests [52] that developers have been aware of for years, but have not been able to fix.”
Background
Research works printed but not linked: 5
- Ruogu Kang, Laura Dabbish, Nathaniel Fruchter, and Sara Kiesler. 2015. My Data Just Goes Everywhere: User Mental Models of the Internet and Implications for Privacy and Security. In Eleventh Symposium On Usable Privacy and Security (SOUPS 2015). USENIX Association, Ottawa, 39--52. https://www.usenix.org/conference/soups2015/proceedings/presentation/kang
- 10.1038/s41586-019--1138-y · doi:10.1038/s41586-019--1138-y
- 10.18653/v1 · doi:10.18653/v1
- 10.1007/s10648-010--9128--5 · doi:10.1007/s10648-010--9128--5
- P. Welinder, S. Branson, T. Mita, C. Wah, F. Schroff, S. Belongie, and P. Perona. 2010. Caltech-UCSD Birds 200. Technical Report CNS-TR-2010-001. California Institute of Technology.
Cited by
When combinations of humans and AI are useful: A systematic review and meta-analysis
Vaccaro, M., Almaatouq, A., & Malone, T. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-02024-1 · Cited by 570
“The studies in our dataset, though, come from different samples of people—some look at doctors 37–39 , others at crowdworkers 4,6,34 and still others at students 13,40,41 —and this variation can limit the comparability of the effect sizes to a degree 36 .”
Gomez, C., Cho, S. M., Ke, S., Huang, C.-M., & Unberath, M. (2025) · Frontiers in Computer Science · doi:10.3389/fcomp.2024.1521066 · Cited by 209
Williamson, S. M., & Prybutok, V. (2024) · Information · doi:10.3390/info15060299 · Cited by 146
The Impact of Imperfect XAI on Human-AI Decision-Making
Morrison, K., Spitzer, P., Turri, V., Feng, M., Kühl, N., & Perer, A. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3641022 · Cited by 60
Self-citationMa, S., Wang, X., Lei, Y., Shi, C., Yin, M., & Ma, X. (2024) · arXiv · doi:10.48550/arxiv.2403.09552 · Cited by 56
Ma, S., Wang, X., Lei, Y., Shi, C., Yin, M., & Ma, X. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642671 · Cited by 54
Effect of Explanation Conceptualisations on Trust in AI-assisted Credibility Assessment
Pareek, S., van Berkel, N., Velloso, E., & Goncalves, J. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3686922 · Cited by 42
A cognitive approach to human–AI complementarity in dynamic decision-making
González, C., & Heidari, H. (2025) · Nature Reviews Psychology · doi:10.1038/s44159-025-00499-x · Cited by 93
Sun, C., Zhao, X., Guo, B., & Chen, N. (2025) · Behavioral Sciences · doi:10.3390/bs15050648 · Cited by 55
“These partnerships support improvements in operational efficiency, facilitate the handling of complex tasks, and stimulate innovation across various sectors (Cabrera et al., 2023).”
Buçinca, Z., Swaroop, S., Paluch, A. E., Doshi‐Velez, F., & Gajos, K. Z. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713229 · Cited by 75
“…individuals develop a mental model of the AI [19, 20, 52, 73, 74, 78], providing meta-information about the AI’s uncertainty and limitations [16, 55, 73], helping individuals calibrate their own self-confidence about the task [40, 66], or enhance user agency by giving them control over…”
Göndöcs, D., Horváth, S., & Dörfler, V. (2025) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2025.103622 · Cited by 52
Anthis, J. R., Pauketat, J. V. T., Ladak, A., & Manoli, A. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713329 · Cited by 24
“For example, In every 2023 category, over a quarter said that sentient AI already existed or would exist in one year.”
Anthis, J. R., Pauketat, J. V. T., Ladak, A., & Manoli, A. (2024) · arXiv · doi:10.48550/arxiv.2407.08867 · Cited by 24
Fernando, S., Ndukwe, C., Virdee, B. S., & Djemai, R. (2024) · ACM Transactions on Accessible Computing · doi:10.1145/3702208 · Cited by 32
“For instance, very high accuracy results from a deep learning model may call for very expensive computations and hence unaffordable and unresponsive for runtime execution [14].”
Generative Artificial Intelligence in Medicine
Shanmugam, D., Agrawal, M., Movva, R., Chen, I. Y., Ghassemi, M., Jacobs, M. L., & Pierson, E. (2025) · Annual Review of Biomedical Data Science · doi:10.1146/annurev-biodatasci-103123-095332 · Cited by 41
He, Z., Song, Y., Zhou, S., & Cai, Z. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580983 · Cited by 34
“conditions or scenarios that make sense to human from their perspective [5, 6].”
BackgroundWhen Are Combinations of Humans and AI Useful?Preprint
Vaccaro, M. A., Almaatouq, A., & Malone, T. W. (2024) · doi:10.31234/osf.io/mk46p · Cited by 16
On the Interdependence of Reliance Behavior and Accuracy in AI-Assisted Decision-Making
Schoeffer, J., Jakubik, J., Voessing, M., Kuehl, N., & Satzger, G. (2023) · Frontiers in Artificial Intelligence and Applications · doi:10.3233/faia230074 · Cited by 15
When Should I Lead or Follow: Understanding Initiative Levels in Human-AI Collaborative Gameplay
Lobo, I., Koch, J., Renoux, J., Batina, I., & Prada, R. (2024) · Designing Interactive Systems Conference · doi:10.1145/3643834.3661583 · Cited by 25
“While research shows that explicit communication or complete behaviour descriptions helps achieve better team performance and understanding [9, 34], games like Geometry Friends may be ideal to explore various types of communication in human-AI teams and the contexts in which they are necessary.”
BackgroundEckhardt, S., Kühl, N., Dolata, M., & Schwabe, G. (2025) · ACM Computing Surveys · doi:10.1145/3776528 · Cited by 45
The AI Review Lottery: Widespread AI-Assisted Peer Reviews Boost Paper Scores and Acceptance Rates
Russo, G., Horta Ribeiro, M., Davidson, T. R., Veselovsky, V., & West, R. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757667 · Cited by 12
Chen, Y., Wang, Y., Chan, A. B., Li, J., & Lc, R. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-92823-9_7 · Cited by 14
Turri, V., Morrison, K., Robinson, K.-M., Abidi, C., Perer, A., Forlizzi, J., & Dzombak, R. (2024) · The 2024 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3630106.3658985 · Cited by 10
Self-citationBreckner, K., Neumayr, T., Mara, M., Streit, M., & Augstein, M. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2482742 · Cited by 16
Ma, S., Chen, Q., Wang, X., Zheng, C., Peng, Z., Yin, M., & Ma, X. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4772689 · Cited by 8
Human-AI Teamwork Interface Design Using Patterns of Interactions
Momose, K., Mehta, R., Moukpe, J., Weekes, T. R., & Eskridge, T. C. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2389350 · Cited by 13
“…contribution (Bansal et al., 2021), example-based (Yang et al., 2020), counterfactual (Wang & Yin, 2021) explanations, describing AI behaviors (Cabrera et al., 2023), tailoring AI recommendations based on human expertise levels (Calisto et al., 2023), and employing cognitive forcing functions…”
Swinger, N., Baseman, C. M., Ryu, M., Abdullah, S., Wiese, C. W., Sherrill, A. M., & Arriaga, R. I. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3710917 · Cited by 15
WorkAI: A Toolkit for the Design of AI-driven Future of Work
Sadeghian, S., Bareikytė, M., Burkhardt, M., & Hassenzahl, M. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757525 · Cited by 10
“Inrecentyears, several researchers in CSCW have studied human-AI interaction [11, 86, 93].”
Schäfer, U., Sipos, L., & Müller-Birn, C. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757451 · Cited by 13
Raees, M., Khan, V.-J., Lykourentzou, I., & Papangelis, K. (2026) · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791467 · Cited by 5
“…33, 43, 60, 76, 88, 94, 96, 112, 156, 164, 167], Confidence Rating [15, 17, 23, 24, 27, 29, 32, 40, 55, 76, 93, 94, 96–98, 112, 114, 117, 132, 167], Usefulness/helpfulness [5, 9, 15, 17, 18, 22, 33, 62, 63, 88, 96, 97, 108, 112, 144, 164], Mental Demand (and/or Task Load) [9, 10, 29, 61, 88, 96–98,”
InfluentialA risk-based model for human-artificial intelligence conflict resolution in process systems
Wen, H., & Khan, F. I. (2024) · Digital Chemical Engineering · doi:10.1016/j.dche.2024.100194 · Cited by 12
Bouzar, A., Idrissi, K. E., & Ghourdou, T. (2024) · American Journal of Education and Technology · doi:10.54536/ajet.v3i2.2704 · Cited by 8
“Yet, alongside these advancements, AI’s role in academia is double-edged, offering benefits in educational performance and workload management while promoting a dependency that could impede academic achievement (Cabrera, 2023).”
BackgroundIntrospectus AI: Long-term AI-Driven Dialogue Training To Promote Self-Reflection
Li, S., Zhu, G., Peng, D., Shen, X., Tu, C., Meng, X., Pai, Y. S., Barbareschi, G., & Minamizawa, K. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757616 · Cited by 12
Faas, C., Uth, R., Sterz, S., Langer, M., & Feit, A. M. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3812265 · Cited by 26
Huang, E. J., Easterday, M. W., & Gerber, E. M. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757549 · Cited by 12
The Algorithm and the Org Chart: How Algorithms Can Conflict with Organizational Structures
Valentine, M., Pratt, A. L., Hinds, R., & Bernstein, M. S. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3686903 · Cited by 10
Erlei, A., Cau, F. M., Georgiev, R., Kumar, S. C., Bizer, K., & Gadiraju, U. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791420 · Cited by 7
“Consumers observe the quality after usage, but operate in a large market, such that their experiences do not meaningfully affect their search set, and hence do not reduce uncertainty for future purchases.”
Yim, S. H., Yoo, D. W., Polymerou, A., Liu, Y., & Saha, K. (2025) · International Journal of Eating Disorders · doi:10.1002/eat.24604 · Cited by 11
Alharbi, R., Cheong, A. D., Herskovitz, J., Brewer, R. N., & Schoenebeck, S. (2025) · Proceedings of the 27th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3663547.3746376 · Cited by 3
“Generally, there is a wealth of HCI and AI scholarship dedicated to understanding how sighted users recognize and resolve errors (e.g., [32, 44, 61, 67, 75]).”
Users’ mental models within human–AI interaction: a systematic scoping review
Bodamer, W. G., Schoenmakers, S., Castellar, E. N., & IJsselsteijn, W. A. (2026) · AI & Society · doi:10.1007/s00146-026-03038-1 · Cited by 5
“They explored dimensions, such as accuracy (e.g., Cabrera et al. 2023), speed (e.g., Levy et al. 2021), collaboration (e.g., He et al. 2023), learning outcomes (e.g., Roganović 2024), and mental effort (e.g., Schadd et al. 2022).”
Brodeur, A., Valenta, D., Marcoci, A., Aparicio, J. P., Mikola, D., Barbarioli, B., Alexander, R., Deer, L., Stafford, T., Vilhuber, L., et al. (2026) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2524747123 · Cited by 16
AI Reliance and Decision Quality: Fundamentals, Interdependence, and the Effects of InterventionsPreprint
Schoeffer, J., Jakubik, J., Vössing, M., Kühl, N., & Satzger, G. (2024) · doi:10.31219/osf.io/cekm9 · Cited by 2
Organizational Readiness for Artificial Intelligence (AI) in Network Security
Greene, B. A., & Burton, S. L. (2024) · Advances in human resources management and organizational development book series · doi:10.4018/979-8-3693-8562-3.ch007 · Cited by 4
Attitudes, Imagined Roles, and Governance Boundaries for AI in Decentralized Social Media
Zhang, Z., Zhao, J., Wang, G., Viswanathan, S., Ross, T., Johnston, S., Liu, D., Noh, H., Kleek, M. G. V., & Shadbolt, N. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790295 · Cited by 2
The Enterprising and Elusive Prospects of Human-AI Collaboration
Gadiraju, U., & Balayn, A. (2025) · Springer eBooks · doi:10.1007/978-3-032-01940-0_7 · Cited by 5
Mascareño, J., Wörtler, B., Przegalińska, A., & Ciechanowski, L. (2026) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2026.101054 · Cited by 5
Wan, A., Guo, J., Khanh, L. P., & Jin, Y. (2025) · ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry (VRCAI) · doi:10.1145/3779232.3779465
“At the same time, the explainable AI (XAI) literature highlights that explanations are crucial for users’ ability to form accurate mental models of AI systems, which in turn affects predictability, trust, and appropriate reliance [Cabrera et al. 2023].”
Lu, Q., & Peng, X. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-57867-0_16 · Cited by 2
Glebova, E., Book, R. T., Abdolmaleki, H., & Chinakidzwa, M. (2026) · Frontiers in Human Dynamics · doi:10.3389/fhumd.2026.1793537 · Cited by 1
Zhang, X., & Chen, N. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2598670 · Cited by 2
“XAI provides interpretable outputs and transparent decision-making pathways, enabling human collaborators to better anticipate AI behavior and align cognitive frameworks during collaboration (Cabrera et al., 2023; Shin, 2021).”
InfluentialTanprasert, T., Kim, Y., Fels, S., & Yoon, D. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790796 · Cited by 1
“However, they perceived the regulated agent to be significantly better than the unregulated one at comparing different perspectives (t(65.2934) = 3.504, 𝑝 .”
InfluentialHuman-AI Collaboration in Generating Graphical Museum Descriptions
Kim, J., Han, M., Kim, S., & Hong, J.-H. (2025) · Journal on Computing and Cultural Heritage · doi:10.1145/3786327 · Cited by 3
Self-citationFrom Prompts to Context: An Ontology-Driven Framework for Human-Generative AI Collaboration
Lê, N. L., Abel, M., & Laforge, B. (2026) · Information Systems Frontiers · doi:10.1007/s10796-026-10754-y · Cited by 2
Jung, S., & Nah, K. (2026) · Information · doi:10.3390/info17030243 · Cited by 2
AI-in-the-human-loop: an operational model for mature human-AI collaboration
Casadei, R., Delnevo, G., Bassi, B., Ceccarini, C., & Mirri, S. (2026) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-026-05135-x
When Do Users (Not) Want Explanations? Understanding Explanation Demand in Human-AI Interaction
Ingesson, E., & Riveiro, M. (2026) · Designing Interactive Systems Conference · doi:10.1145/3800645.3812974
“Improvements have also been observed with other explanation types, including feature-based explanations in text classification [35], explanations in human-robot interaction [63], and descriptions of AI behavior [11].”
Research Agenda for Sociotechnical Approaches to AI SafetyPreprint
Curtis, S., Iyer, R., Kirk‐Giannini, C. D., Krakovna, V., Krueger, D., Lambert, N., Marnette, B., McKenzie, C., Michael, J., Miyazono, E., et al. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5097286 · Cited by 4
User Interaction for Human–AI Interaction and Collaboration
Dan, W., & Guo, Q. (2025) · Cambridge University Press eBooks · doi:10.1017/9781009587877.003
Zheng, H., Zhao, H., & Li, Z. (2026) · doi:10.1145/3786174.3788353 · Cited by 1
Ling, T.-W., Peng, W., Meng, J., & Liu, J. (2026) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3772363.3798608
Popowski, L., Vasconcelos, H., Heinsen, I. J. F., Mgbahurike, C., Herbrich, R., Hancock, J. T., & Bernstein, M. S. (2026) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3788067 · Cited by 1
Offline Reinforcement Learning for Adaptive Support in AI-Assisted Decision-Making
Buçinca, Z., Swaroop, S., Paluch, A. E., Murphy, S. A., & Gajos, K. Z. (2026) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3815418 · Cited by 54
“…often involve training or onboarding sessions designed to help individuals construct a mental model of AI [54, 83, 84, 92], develop a self-mental model related to the task [47], or increase human agency by granting them control over input feature selection and algorithmic assistance [25, 62].”
Lin, Q.-J., & He, L. (2026) · Journal of Innovation & Knowledge · doi:10.1016/j.jik.2026.101167
Trust in the Loop: Building and Maintaining Human Trust in AI Collaborative Systems
Ara, A. (2026) · BENTHAM SCIENCE PUBLISHERS eBooks · doi:10.2174/9798898813871126010010 · Cited by 1
Boostani, H., & Altan, H. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5995947
Building the AI-Enhanced Strategic Organization—A Roadmap for Implementation
Hakimpour, H. (2026) · Springer eBooks · doi:10.1007/978-3-032-19387-2_9
Raju, V. R. (2024) · Journal of Education Technology in Health Sciences · doi:10.18231/j.jeths.2024.012 · Cited by 1
Li, Z., Ma, Z., He, S., Lu, Z., Xiao, Z., & Yin, M. (2026) · ACM Conference on Human-AI Complementarity and Alignment · doi:10.1145/3834580.3838738
Improving Human-AI Collaboration in Medical Diagnosis with Combination Advice
Zhao, X., Liu, J., Yu, Z., & Guo, B. (2025) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme59968.2025.11209356
“2) AI-Assisted Decision Making: The concurrent paradigm involves providing AI advice to humans immediately and is typically used for low-risk tasks, such as face annotation [18] and fake review detection [19].”
Matejić, T., Mihailović, Đ., & Dukić, A. (2025) · Limes plus. · doi:10.69899/limes-plus25222046m
Explanation Demand as a Trait, Not a State: Implications for User Modeling in Adaptive Systems
Ingesson, E., & Riveiro, M. (2026) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3774935.3806160
“…evidence assessing the effects of explanations has been mixed: while some studies demonstrate that explanations can enhance human-AI collaboration [8, 24, 38, 40, 41, 59, 71] others report limited or even negative outcomes [1, 5, 19, 32, 70], highlighting ongoing debates about the effectiveness…”
Human-AI Proximity: Unveiling the Detrimental Effects on Idea Selection and ImplementationPreprint
Mascareño, J., Wortler, B., Przegalinska, A., & Ciechanowskie, L. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5885745
Tuo, B., Wang, B. T., Miller, T., & Demartini, G. (2026) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3848504
“These studies typically use debate to expose AI reasoning patterns or enhance explainability [13, 44], with the goal of mitigating overreliance or underreliance on AI recommendations.”
How to design the interplay between humans and AI-based surface inspection systems
Nauth, K., Ünal, E., Meske, C., & Pöppelbuß, J. (2026) · Procedia CIRP · doi:10.1016/j.procir.2026.01.184
Oh, J., Montag, C., Kohne, J., & Schulz, P. J. (2026) · Scientific Reports · doi:10.1038/s41598-026-43698-z
“Moreover, emphasizing transparency and domain-specific credentials may foster appropriate trust calibration and prevent overreliance on AI outputs 5,41 .”
Tong, M., Cui, L., Zhu, S., Zhang, X., & Liu, H. (2026) · Surgical Endoscopy · doi:10.1007/s00464-026-13155-z
Liu, Q. (2026) · International Journal of Digital Law and Governance · doi:10.1515/ijdlg-2025-0021
“Simultaneously, numerous scholars have proposed design frameworks and evaluation standards for human-AI collaboration in general arti fi cial intelligence (Fragiadakis et al. 2025; Xu et al. 2023; Cabrera et al. 2023).”
InfluentialKivaste, C. K., Värno, P., & Sousa, S. C. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-30836-8_40
Designing Human‐AI Architectural Robustness to Inherently Brittle AI
Singh, A., & Szajnfarber, Z. (2026) · Insight · doi:10.1002/inst.70058
The Consensus Trap: Dissecting Subjectivity and the “Ground Truth” Illusion in Data Annotation
Munir, S., Mah, B., Kalsi, K., Kapania, S., Posada, J., Law, E., Wang, D., & Ahmed, S. I. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3806510 · Cited by 5
“This maintains a veneer of human oversight while effectively automating the human out of the loop, using machine-generated rationales as the primary scaffold for human judgment [43, 88].”
Human-AI Proximity: Unveiling the Detrimental Effects on Idea Selection and ImplementationPreprint
Mascareño, J., Wortler, B., Przegalinska, A., & Ciechanowskie, L. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5893131
Human-AI Proximity: Unveiling the Detrimental Effects on Idea Selection and ImplementationPreprint
Mascareño, J., Wortler, B., Przegalinska, A., & Ciechanowskie, L. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5885744
Blanchard, S. J., Garvey, A. M., & O'Laughlin, L. (2026) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2026.102427
Mayer, S., Knierim, P., Villa, S., & Schmidt, A. (2026) · Springer eBooks · doi:10.1007/978-3-319-27648-9_119-1
When Your Reviewer is an LLM: Biases, Divergence, and Prompt Injection Risks in Peer ReviewPreprint
Zhu, C., Xiong, J., Ma, R., Lu, Z., Lu, Z., Liu, Y., & Li, L. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6067034
Metadata
- Authors
- Cabrera, Á. A., Perer, A., & Hong, J. I.
- Affiliations
- Carnegie Mellon University (US)
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2023-04-14
- Volume
- 7
- Issue
- CSCW1
- Pages
- 1-21
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W4317464833
- Cited by
- 87
- References
- 76
- Citations by year
- 2026: 37 · 2025: 30 · 2024: 18 · 2023: 2
- FWCI
- 25.67
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Proceedings of the ACM on Human-Computer Interaction (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- National Science Foundation (IIS-2040942)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- human-AI collaboration, behavioral description, AI-assisted decision-making, trust in AI, mental models, fake review detection, satellite image classification, bird classification, explainable AI
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.