Should I Follow AI-based Advice? Measuring Appropriate Reliance in Human-AI Decision-Making
Open accessAbstract
Many important decisions in daily life are made with the help of advisors, e.g., decisions about medical treatments or financial investments. Whereas in the past, advice has often been received from human experts, friends, or family, advisors based on artificial intelligence (AI) have become more and more present nowadays. Typically, the advice generated by AI is judged by a human and either deemed reliable or rejected. However, recent work has shown that AI advice is not always beneficial, as humans have shown to be unable to ignore incorrect AI advice, essentially representing an over-reliance on AI. Therefore, the aspired goal should be to enable humans not to rely on AI advice blindly but rather to distinguish its quality and act upon it to make better decisions. Specifically, that means that humans should rely on the AI in the presence of correct advice and self-rely when confronted with incorrect advice, i.e., establish appropriate reliance (AR) on AI advice on a case-by-case basis. Current research lacks a metric for AR. This prevents a rigorous evaluation of factors impacting AR and hinders further development of human-AI decision-making. Therefore, based on the literature, we derive a measurement concept of AR. We propose to view AR as a two-dimensional construct that measures the ability to discriminate advice quality and behave accordingly. In this article, we derive the measurement concept, illustrate its application and outline potential future research.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Trust functioned as a significant mediator through which expertise was related to reliance, enabling or inhibiting adjustments based on AI advice.
“Our findings suggest trust functioned as a significant mediator through which expertise was related to reliance, enabling or inhibiting adjustments based on AI advice and confirming previous research (Kim et al., 2021;Schemmer et al., 2022).”
From Investigating appropriate reliance on AI-Based decision support systems: the role of expertise, trust, and self-confidence (2025) · cites this paper as Schemmer et al., 2022
Section 3 (p. 3) says that trust generally increases reliance on advice, supporting the trust–reliance connection that the citing authors say their findings confirm. The paper does not report that trust significantly mediates a relationship between expertise and reliance; Section 5 (p. 8) instead identifies trust as a factor for future investigation. (LLM, conf=0.84)
Experimental — accuracy not yet measuredThe objective metrics used are commonly adapted in literature to capture the level of reliance within the human-AI interaction context.
“These parameters are commonly adapted in literature to capture the level of reliance within the human-AI interaction context.”
From Dealing with Uncertainty: Understanding the Impact of Prognostic Versus Diagnostic Tasks on Trust and Reliance in Human-AI Decision Making (2024) · cites this paper as [112]
Users often struggle to balance trust, either overtrusting and overrelying on AI recommendations or undertrusting and disregarding helpful advice.
“Research indicates that users often struggle to find the right balance, either overtrusting and overly relying on AI recommendations or undertrusting and disregarding helpful advice [ 8 , 9 ].”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 7× · see citing works
“Defining reliance as behavior also clarifies the role of trust, which is defined as “the attitude that an agent will help achieve an individual’s goals in a situation characterized by uncertainty and vulnerability” [16, p. 51].”
BackgroundMethodInfluentialInternational evaluation of an AI system for breast cancer screening
McKinney, S. M., Sieniek, M., Godbole, V., Godwin, J., Antropova, N., Ashrafian, H., Back, T., Chesus, M., Corrado, G. S., Darzi, A., et al. (2020) · Nature · doi:10.1038/s41586-019-1799-6 · Cited by 3,287 · cited 1× · see citing works
“For example, AI now advises medical professionals with regard to breast cancer screening [19], or in detecting COVID-19 pneumonia [5].”
BackgroundWhat is AI Literacy? Competencies and Design Considerations
Long, D., & Magerko, B. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376727 · Cited by 3,241 · cited 1× · see citing works
“Among others, important constructs that have been evaluated in the judge-advisor literature concerning advice utilization are human confidence [17], perception [26] and trust [30].”
BackgroundAlgorithm aversion: People erroneously avoid algorithms after seeing them err.
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000033 · Cited by 3,232 · cited 1× · see citing works
“Our experiment thereby highlights the general tendency of humans to ignore AI advice that is in literature usually discussed as algorithm aversion [6].”
BackgroundCan AI help in screening viral and COVID-19 pneumonia?
Chowdhury, M. E. H., Rahman, T., Khandakar, A., Mazhar, R., Kadir, M. A., Mahbub, Z. B., Islam, K. R., Khan, M. S., Iqbal, A., Emadi, N. A., et al. (2020) · IEEE Access · doi:10.1109/access.2020.3010287 · Cited by 1,913 · cited 1× · see citing works
“For example, AI now advises medical professionals with regard to breast cancer screening [19], or in detecting COVID-19 pneumonia [5].”
BackgroundThe role of trust in automation reliance
Dzindolet, M. T., Peterson, S. A., Pomranky, R. A., Pierce, L. G., & Beck, H. P. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00038-7 · Cited by 1,276 · cited 1× · see citing works
“Reliance itself is defined as a behavior [7, 16].”
BackgroundFinding Deceptive Opinion Spam by Any Stretch of the Imagination
Ott, M., Choi, Y., Cardie, C., & Hancock, J. T. (2011) · arXiv · doi:10.48550/arxiv.1107.4557 · Cited by 1,008 · cited 1× · see citing works
“Ott et al. [20, 21] provide the research community with a data set of 400 deceptive and 400 genuine hotel reviews.”
BackgroundZhang, Y., Liao, Q. V., & Bellamy, R. K. E. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372852 · Cited by 895 · cited 3× · see citing works
“For this reason, researchers argue that in order to benefit the most from AI advice, humans need to be able to appropriately rely on it [1, 2, 38].”
BackgroundDoes the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
Bansal, G., Wu, T., Zhou, J., Fok, R., Nushi, B., Kamar, E., Ribeiro, M. T., & Weld, D. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445717 · Cited by 757 · cited 7× · see citing works
“XAI is intensively discussed in research with regards to its impact on human-AI decision-making in general and AR in specific [1, 2, 14, 29].”
BackgroundInfluentialManipulating and Measuring Model Interpretability
Poursabzi-Sangdeh, F., Goldstein, D. G., Hofman, J. M., Wortman Vaughan, J. W., & Wallach, H. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445315 · Cited by 728 · cited 1× · see citing works
“Similarly, Poursabzi-Sangdeh et al. [23, p. 1] point out the idea of AR in the form of “making people more closely follow a model’s predictions when it is beneficial for them to do so or enabling them to detect when a model has made a mistake”.”
BackgroundAdvice taking in decision making: egocentric discounting and reputation formation
Yaniv, I., & Kleinberger, E. (2000) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.2000.2909 · Cited by 701 · cited 1× · see citing works
“For example, so-called egocentric discounting—humans systematically overweighting their own decisions—increases under-reliance on AI [36].”
BackgroundModel-Agnostic Interpretability of Machine Learning
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · arXiv · doi:10.48550/arxiv.1606.05386 · Cited by 699 · cited 1× · see citing works
“For the XAI condition, we use a state-of-the-art explanation technique, namely LIME feature importance explanations [24].”
MethodDoes automation bias decision-making?
SKITKA, L. J., MOSIER, K. L., & BURDICK, M. (1999) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1999.0252 · Cited by 694 · cited 1× · see citing works
“Research in automation has shown that humans tend always to follow the path of least cognitive effort [28].”
BackgroundExplanation, imagination, and confidence in judgment.
Koehler, D. J. (1991) · Psychological Bulletin · doi:10.1037//0033-2909.110.3.499 · Cited by 561 · cited 1× · see citing works
“This is supported by psychology literature which has shown that human explanations cause humans to agree even when the explanation is wrong [12].”
BackgroundMetrics for explainable AI: challenges and prospects
Hoffman, R. R., Mueller, S. T., Klein, G., & Litman, J. (2018) · arXiv · doi:10.48550/arxiv.1812.04608 · Cited by 518 · cited 2× · see citing works
“The emerging research stream of XAI [10] aims to equip human users with such insight into AI advice.”
BackgroundTrust, Confidence, and Expertise in a Judge-Advisor System
Sniezek, J. A., & Van Swol, L. M. (2001) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.2000.2926 · Cited by 469 · cited 7× · see citing works
“Past research has often focused on maximizing the utilization of advice [13, 27, 30], i.e., increasing the amount of accepted advice leading to increased compliance.”
BackgroundMethodInfluentialThe Role of Explanations on Trust and Reliance in Clinical Decision Support Systems
Bussone, A., Stumpf, S., & O'Sullivan, D. (2015) · 2015 International Conference on Healthcare Informatics · doi:10.1109/ichi.2015.26 · Cited by 441 · cited 2× · see citing works
“Research shows that explanations are sometimes interpreted more as a general sign of competence [2] and have a persuasive character [3].”
BackgroundWang, X., & Yin, M. (2021) · 26th International Conference on Intelligent User Interfaces · doi:10.1145/3397481.3450650 · Cited by 320 · cited 1× · see citing works
“In this context, additional work uses the term “appropriate trust” with a similar interpretation as the behavior to follow “the fraction of tasks where participants used the model’s prediction when the model was correct and did not use the model’s prediction when the model was wrong” [34, p. 323].”
MethodHow do visual explanations foster end users' appropriate trust in machine learning?
Yang, F., Huang, Z., Scholtz, J., & Arendt, D. L. (2020) · Proceedings of the 25th International Conference on Intelligent User Interfaces · doi:10.1145/3377325.3377480 · Cited by 200 · cited 1× · see citing works
“Finally, also Yang et al. [35, p. 190] define “appropriate trust is to [not] follow an [in]correct recommendation”.”
BackgroundJung, D., Dorner, V., Glaser, F., et al. (2018) · Business & Information Systems Engineering · doi:10.1007/s12599-018-0521-9 · Cited by 175 · cited 1× · see citing works
“While in the past, advice was typically obtained from human experts, nowadays, advisors based on artificial intelligence (AI) are becoming more and more present in research and practice [11].”
BackgroundHuman Reliance on Machine Learning Models When Performance Feedback is Limited: Heuristics and Risks
Lu, Z., & Yin, M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445562 · Cited by 131 · cited 2× · see citing works
“Other researchers go one step further and define inappropriate reliance as under-or over-reliance [18, 32, 37].”
Background"Why is 'Chicago' deceptive?" Towards Building Model-Driven Tutorials for Humans
Lai, V., Liu, H., & Tan, C. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376873 · Cited by 123 · cited 3× · see citing works
“The implemented AI is based on a Support Vector Machine with an accuracy of 86%, which is a performance that is similar to the performance in related literature [15].”
MethodInfluentialSmith-Renner, A., Fan, R., Birchfield, M., Wu, T., Boyd-Graber, J., Weld, D. S., & Findlater, L. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376624 · Cited by 112 · cited 1× · see citing works
“XAI is intensively discussed in research with regards to its impact on human-AI decision-making in general and AR in specific [1, 2, 14, 29].”
Background(2018) · doi:10.1201/9781315137957-2 · Cited by 108 · cited 1× · see citing works
“The final reliance is beyond trust and is also influenced by other attitudes such as perceived risk or self-confidence [25].”
BackgroundEffects of distance between initial estimates and advice on advice utilization
Schultze, T., Rakotoarisoa, A.-F., & Schulz‐Hardt, S. (2015) · Judgment and Decision Making · doi:10.1017/s1930297500003922 · Cited by 76 · cited 1× · see citing works
“Past research has often focused on maximizing the utilization of advice [13, 27, 30], i.e., increasing the amount of accepted advice leading to increased compliance.”
BackgroundTowards a Science of Human-AI Decision Making: A Survey of Empirical Studies
Lai, V., Chen, C., Liao, Q. V., Smith-Renner, A., & Tan, C. (2021) · arXiv · doi:10.48550/arxiv.2112.11471 · Cited by 75 · cited 2× · see citing works
“Lai et al. [14] gives an overview of empirical studies that analyze AI advice considering AR.”
BackgroundDo explanations make VQA models more predictable to a human?
Chandrasekaran, A., Prabhu, V., Yadav, D., Chattopadhyay, P., & Parikh, D. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1128 · Cited by 59 · cited 1× · see citing works
“For example, Chandrasekaran et al. [4] analyze whether humans can learn to predict the model behavior.”
BackgroundEffect of Descriptive Information and Experience on Automation Reliance
Yuviler-Gavish, N., & Gopher, D. (2011) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720811406725 · Cited by 30 · cited 1× · see citing works
“Other researchers go one step further and define inappropriate reliance as under-or over-reliance [18, 32, 37].”
BackgroundKühl, N., Lobana, J., & Meske, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.08777 · Cited by 16 · cited 1× · see citing works
“Past research has often focused on maximizing the utilization of advice [13, 27, 30], i.e., increasing the amount of accepted advice leading to increased compliance.”
Self-citationSchoeffer, J., Machowski, Y., & Kühl, N. (2022) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2022.134 · Cited by 16 · cited 1× · see citing works
“Among others, important constructs that have been evaluated in the judge-advisor literature concerning advice utilization are human confidence [17], perception [26] and trust [30].”
BackgroundSelf-citationSelecting Methods for the Analysis of Reliance on Automation
Wang, L., Jamieson, G. A., & Hollands, J. G. (2008) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120805200419 · Cited by 15 · cited 2× · see citing works
“Wang et al. [33] define appropriate reliance as the impact of reliance on performance.”
BackgroundMethodHuman Evaluation of Spoken vs. Visual Explanations for Open-Domain QA
Gonzalez, A. V., Bansal, G., Fan, A., Jia, R., Mehdad, Y., & Iyer, S. (2020) · arXiv · doi:10.48550/arxiv.2012.15075 · Cited by 7 · cited 1× · see citing works
“Moreover, Gonzalez et al. [8] evaluate the impact of explainable AI (XAI) on the discrimination of incorrect and correct AI advice.”
Background
Flagged first, then by citations
7 of the 39 references couldn’t be matched to a known paper.
Research works printed but not linked: 5
- [2][2] Zana Buçinca, Maja Barbara Malaya, and Krzysztof Z Gajos. 2021. To trust or to think: cognitive forcing functions can reduce overreliance on AI in AI-assisted decision-making. Proceedings of the ACM on Human-Computer Interaction 5, CSCW1 (2021), 1-21. -
- [9][9] Patrick Hemmer, Max Schemmer, Michael Vössing, and Niklas Kühl. 2021. Human-AI Complementarity in Hybrid Intelligence Systems: A Structured Literature Review. PACIS 2021 Proceedings (2021). -
- [20][20] Myle Ott, Claire Cardie, and Jeffrey T Hancock. 2013. Negative deceptive opinion spam. In Proceedings of the 2013 conference of the north american chapter of the association for computational linguistics: human language technologies . 497-501. -
- [22][22] Fotios Petropoulos, Robert Fildes, and Paul Goodwin. 2016. Do 'big losses' in judgmental adjustments to statistical forecasts affect experts' behaviour? European Journal of Operational Research 249, 3 (2016), 842-852. -
- [32][32] Peter-Paul Van Maanen, Tomas Klos, and Kees Van Dongen. 2007. Aiding human reliance decision making using computational models of trust. In 2007 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology-Workshops . 372-376. -
Cited by
Sorted by citations
Appropriate Reliance on AI Advice: Conceptualization and the Effect of Explanations
Schemmer, M., Kuehl, N., Benz, C., Bartos, A., & Satzger, G. (2023) · Proceedings of the 28th International Conference on Intelligent User Interfaces · doi:10.1145/3581641.3584066 · Cited by 208 · see citing works
Self-citationChatGPT: The cognitive effects on learning and memory
Bai, L., Liu, X., & Su, J. (2023) · Brain‐X · doi:10.1002/brx2.30 · Cited by 182 · see citing works
Rams, hounds and white boxes: investigating human–AI collaboration protocols in medical diagnosis
Cabitza, F., Campagner, A., Ronzio, L., Cameli, M., Mandoli, G. E., Pastore, M. C., Sconfienza, L. M., Folgado, D., Barandas, M., & Gamboa, H. (2023) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2023.102506 · Cited by 117 · see citing works
Knowing About Knowing: An Illusion of Human Competence Can Hinder Appropriate Reliance on AI Systems
He, G., Kuiper, L., & Gadiraju, U. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581025 · Cited by 107 · see citing works
“[66] presented four conditions of appropriate reliance patterns (see Table 1) when the disagreement exists and correct answer exists in human initial decision or AI advice.”
BackgroundHuman-AI Collaboration: The Effect of AI Delegation on Human Task Performance and Task Satisfaction
Hemmer, P., Westphal, M., Schemmer, M., Vetter, S., Vössing, M., & Satzger, G. (2023) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3581641.3584052 · Cited by 111 · see citing works
“Establishing an appropriate level of reliance on the AI model becomes one of the central challenges [60].”
BackgroundSelf-citationAI-enhanced collective intelligence
Cui, H., & Yasseri, T. (2024) · Patterns · doi:10.1016/j.patter.2024.101074 · Cited by 103 · see citing works
Hou, C., Zhu, G., Sudarshan, V., Lim, F. S., & Ong, Y. S. (2025) · Computers & Education · doi:10.1016/j.compedu.2025.105329 · Cited by 70 · see citing works
Medical artificial intelligence for clinicians: the lost cognitive perspective
Tikhomirov, L., Semmler, C., McCradden, M. D., Searston, R. A., Ghassemi, M., & Oakden‐Rayner, L. (2024) · The Lancet Digital Health · doi:10.1016/s2589-7500(24)00095-5 · Cited by 68 · see citing works
Psychological Traits and Appropriate Reliance: Factors Shaping Trust in AI
Küper, A., & Krämer, N. (2024) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2024.2348216 · Cited by 49 · see citing works
“Thus, calibrated trust and appropriate reliance are interconnected and sometimes argued to be conceptually equal (Schemmer et al., 2022).”
InfluentialSalimzadeh, S., He, G., & Gadiraju, U. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641905 · Cited by 41 · see citing works
Al-Zahrani, A. M. (2024) · IgMin Research · doi:10.61927/igmin158 · Cited by 41 · see citing works
Küper, A., Lodde, G. C., Livingstone, E., Schadendorf, D., & Krämer, N. (2025) · Journal of Medical Internet Research · doi:10.2196/58660 · Cited by 31 · see citing works
“Research ranges from system acceptance and adoption [39,40] to specific investigations of trust in systems [41-44] to the calibration of trust and the appropriateness of reliance [8,9,45-49].”
InfluentialYou, Me, and the AI: The Role of Third‐Party Human Teammates for Trust Formation Toward AI Teammates
Erengin, T., Briker, R., & de Jong, S. B. (2025) · Journal of Organizational Behavior · doi:10.1002/job.2857 · Cited by 27 · see citing works
The Trust Recovery Journey. The Effect of Timing of Errors on the Willingness to Follow AI Advice.
Kahr, P. K., Rooks, G., Snijders, C., & Willemsen, M. C. (2024) · Proceedings of the 29th International Conference on Intelligent User Interfaces · doi:10.1145/3640543.3645167 · Cited by 21 · see citing works
Dogru, E. Ö., & Krämer, N. C. (2025) · Journal of Decision Systems · doi:10.1080/12460125.2025.2593251 · Cited by 15 · see citing works
“…DSS and the system’s actual performance capabilities (Merritt et al., 2015), whereas appropriate reliance refers to a user’s ability to appropriately act on AI advice, specifically, to accept correct advice and reject incorrect advice (Poursabzi-Sangdeh et al., 2021; Schemmer et al., 2022).”
InfluentialAlhusban, M. I., Khatatbeh, I. N., & Alshurafat, H. (2025) · Competitiveness Review An International Business Journal incorporating Journal of Global Competitiveness · doi:10.1108/cr-06-2024-0121 · Cited by 17 · see citing works
On the Interdependence of Reliance Behavior and Accuracy in AI-Assisted Decision-Making
Schoeffer, J., Jakubik, J., Voessing, M., Kuehl, N., & Satzger, G. (2023) · Frontiers in Artificial Intelligence and Applications · doi:10.3233/faia230074 · Cited by 15 · see citing works
Self-citationBuijsman, S., Klenk, M., & van den Hoven, J. (2025) · Cambridge University Press eBooks · doi:10.1017/9781009367783.005 · Cited by 11 · see citing works
A short-form AI literacy intervention can reduce over-reliance on AIPreprint
Morrill, J., & Noetel, M. (2023) · doi:10.31234/osf.io/hv9qc · Cited by 6 · see citing works
Bruijnes, M., Grimmelikhuijsen, S., & Robeer, M. (2025) · Springer eBooks · doi:10.1007/978-3-031-84748-6_4 · Cited by 5 · see citing works
Measuring Citizen's Perceptions of AI Adoption for Instrumental and Value‐Added Tasks
Park, M. S., Bak, H., Park, H., & Kim, H. (2023) · Proceedings of the Association for Information Science and Technology · doi:10.1002/pra2.957 · Cited by 3 · see citing works
“Despite intense debates regarding algorithmic fairness and possible overreliance on AI for decision makings (Buçinca et al., 2021; Schemmer et al., 2022), there is growing anticipation that AI could replace humans in simple repetitive tasks and even assist in making complex decisions.”
BackgroundHow informative is your XAI? Assessing the quality of explanations through information power
Matarese, M., Rea, F., Rohlfing, K. J., & Sciutti, A. (2025) · Frontiers in Computer Science · doi:10.3389/fcomp.2024.1412341 · Cited by 3 · see citing works
Augmented Algorithms, Adaptive Humans? Evidence from a Natural ExperimentPreprint
Lu, T., Lu, X., Huang, Y., & Wang, H. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4298793 · Cited by 2 · see citing works
Smuha, N. A. (2025) · Cambridge University Press eBooks · doi:10.1017/9781009367783.002 · Cited by 1 · see citing works
Human-AI Collaboration in Healthcare: A Review of User Perspectives and Challenges
Hussain, Z., & Khalid, M. S. (2024) · INTERANTIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT · doi:10.55041/ijsrem27973 · Cited by 1 · see citing works
Similarity and Consistency in Algorithm-Guided ExplorationPreprint
Bao, Y., Danwitz, L., Dvorak, F., et al. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4324211 · Cited by 1 · see citing works
The Trust Recovery Journey. The Effect of Timing of Errors on the Willingness to Follow AI Advice.Preprint
Kahr, P. K., Rooks, G., Snijders, C. C. P., et al. (2024) · doi:10.31219/osf.io/5awrs · Cited by 1 · see citing works
Changes Accompanied by Artificial Intelligence (AI) and How Organizations Respond to These Changes
Farhan, A. F., & Hatem, G. (2024) · IntechOpen eBooks · doi:10.5772/intechopen.1007615 · Cited by 3 · see citing works
Rheu, M., Peng, W., Molina, M. D., & Zhan, E. S. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5340807
Taylor, A., & Junck, L. D. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5338803
Hyperchat and Hypervideo: Enabling Real-time Groupwise Conversations at Unlimited Scale
Rosenberg, L. B., Willcox, G., Schumann, H., & Bader, M. (2025) · IEEE World AI IoT Congress (AIIoT) · doi:10.1109/aiiot65859.2025.11105240
The potential of AI-driven truth technologies: opportunities, risks and governance
Béjar, B. P., Schweser, L., Hagelsteen, M., & Becker, P. (2025) · AI and Ethics · doi:10.1007/s43681-025-00901-7
“This demonstrates the high importance of education and training in critical thinking, pointed out in the results, which align with the importance of nurturing an appropriate and critical reliance on AI systems suggested elsewhere [77].”
When AI is wrong: the limits of human oversight in AI-assisted diagnostic decision-making
Xiao, F., Diao, K., Li, C., Gong, Y., Li, B., Chen, J., Xiu-Qiong, F. U., & Xie, J. Y. (2026) · Behaviour and Information Technology · doi:10.1080/0144929x.2026.2666286
- Authors
- Schemmer, M., Hemmer, P., Kühl, N., Benz, C., & Satzger, G.
- Affiliations
- Karlsruhe Institute of Technology (DE)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2022
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2204.06916
- OpenAlex
- W6894262466
- Cited by
- 33
- References
- 39
- Citations by year
- 2026: 2 · 2025: 13 · 2024: 7 · 2023: 10 · 2022: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- Repository KITopen (Karlsruhe Institute of Technology) (submittedVersion, cc-by-nc-nd)
- arXiv (Cornell University)
- KITopen
- Topics
- Social Sciences › Psychology › Social Psychology › Human-Automation Interaction and Safety
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Social Sciences › Safety Research › Ethics and Social Impacts of AI
- Keywords
- AI advice, human-AI decision-making, overreliance on AI, measurement concepts, trust in AI, human-AI collaboration
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
