The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
A Case for Humans-in-the-Loop: Decisions in the Presence of Erroneous Algorithmic Scores
Open accessAbstract
The increased use of algorithmic predictions in sensitive domains has been accompanied by both enthusiasm and concern. To understand the opportunities and risks of these technologies, it is key to study how experts alter their decisions when using such tools. In this paper, we study the adoption of an algorithmic tool used to assist child maltreatment hotline screening decisions. We focus on the question: Are humans capable of identifying cases in which the machine is wrong, and of overriding those recommendations? We first show that humans do alter their behavior when the tool is deployed. Then, we show that humans are less likely to adhere to the machine's recommendation when the score displayed is an incorrect estimate of risk, even when overriding the recommendation requires supervisory approval. These results highlight the risks of full automation and the importance of designing decision pipelines that provide humans with autonomy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“In some real-world applications of HAIC1,21, an ML model is trained to perform the same classification task as the human expert.”
From A benchmarking framework and dataset for learning to defer in human-AI decision-making (2025) · cites this paper as [1]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Prior research has also established that an irreducible degree of uncertainty exists with respect to the outcomes in the public sector [21,34,57] with both humans and algorithms likely to make mistakes.”
From A Framework of High-Stakes Algorithmic Decision-Making for the Public Sector Developed through a Case Study of Child-Welfare (2021) · cites this paper as [34]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Diagnostic tasks entail circumstances where participants are given access to well-defned and comprehensive information about the current task, allowing them to make precise judgments [29].”
From Dealing with Uncertainty: Understanding the Impact of Prognostic Versus Diagnostic Tasks on Trust and Reliance in Human-AI Decision Making (2024) · cites this paper as [29]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Prognostic tasks, on the other hand, involve scenarios in which participants are presented with restricted or unclear data and need to generate predictions regarding future outcomes [29].”
From Dealing with Uncertainty: Understanding the Impact of Prognostic Versus Diagnostic Tasks on Trust and Reliance in Human-AI Decision Making (2024) · cites this paper as [29]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“With the presence of uncertainty in a task, individuals may lack sufcient capability to verify the correctness of AI advice and therefore rely more heavily on the AI systems [29], leading to reduced appropriate reliance on AI systems.”
From Dealing with Uncertainty: Understanding the Impact of Prognostic Versus Diagnostic Tasks on Trust and Reliance in Human-AI Decision Making (2024) · cites this paper as [29]
Experimental — accuracy not yet measured
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The AFST is a risk assessment that predicts the likelihood that children will be removed from their home due to child neglect and abuse in the next two years.”
From The flaws of policies requiring human oversight of government algorithms (2022) · cites this paper as De-Arteaga et al., 2020
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“By calling teachers' attention to discrepancies between their own judgments and those of an AIEd system, the system may promote productive teacher reflection and learning”
From Equity and Artificial Intelligence in Education: Will "AIEd" Amplify or Alleviate Inequities in Education? (2021) · cites this paper as De-Arteaga et al., 2020
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“It has been shown that the expert’s performance is significantly impacted by seeing the ML model’s score along with the rest of the information pertaining to each instance1,21,22.”
From A benchmarking framework and dataset for learning to defer in human-AI decision-making (2025) · cites this paper as [1]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This creates a realistic dataset of expert predictions resulting from collecting a single prediction per instance, as is often the case in real-world systems1,19.”
From A benchmarking framework and dataset for learning to defer in human-AI decision-making (2025) · cites this paper as [1]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Finally, we observe that current L2D research overlooks the limitations of human work capacity, despite these being a challenge in real-world systems1,19, where typically only one expert makes a decision per instance.”
From A benchmarking framework and dataset for learning to defer in human-AI decision-making (2025) · cites this paper as [1]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Finally, we observe that current L2D research overlooks the limitations of human work capacity, despite these being a challenge in real-world systems1,19, where typically only one expert makes a decision per instance.”
From A benchmarking framework and dataset for learning to defer in human-AI decision-making (2025) · cites this paper as [1]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“As such, algorithmic decision-making tools are now being used in high-stakes CWS situations, including making risk assessments of child abuse [34] and determining placement stability [86].”
From A Framework of High-Stakes Algorithmic Decision-Making for the Public Sector Developed through a Case Study of Child-Welfare (2021) · cites this paper as [34]
The cited source says what the claim attributes to it.
In the citing paper
“These predictions are presented to child welfare workers to inform their decisions about which cases to investigate( De-Arteaga et al., 2020 ;Eubanks, 2018 ).”
From The flaws of policies requiring human oversight of government algorithms (2022) · cites this paper as De-Arteaga et al., 2020
The cited source says what the claim attributes to it.
In the citing paper
“The negative impact of hallucinations on data quality is well-documented [33] —incorrect AI recommendations have been shown to harm users in decision-making contexts [13].”
From Emerging Reliance Behaviors in Human-AI Content Grounded Data Generation: The Role of Cognitive Forcing Functions and Hallucinations (2025) · cites this paper as [13]
The cited source says what the claim attributes to it.
In the citing paper
“There are relevant examples where human operators successfully identified errors made by automated systems [14, 54].”
From On the Quest for Effectiveness in Human Oversight: Interdisciplinary Perspectives (2024) · cites this paper as [14]
The cited source says what the claim attributes to it.
In the citing paper
“Recently, a growing body of research has focused on human-AI collaboration (HAIC), with several authors arguing that humans and AI have complementary strengths and weaknesses1,2.”
From A benchmarking framework and dataset for learning to defer in human-AI decision-making (2025) · cites this paper as [1]
The cited source says what the claim attributes to it.
In the citing paper
“Collaborative systems have shown that humans can correct model predictions in specific instances1, and that humans, in collaboration with a Machine Learning (ML) model, can achieve higher performance than either the expert or the model alone3.”
From A benchmarking framework and dataset for learning to defer in human-AI decision-making (2025) · cites this paper as [1]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Prior work has argued that algorithms in the public sector is a domain in its own right [34,62,107,109,121] and must be characterized differently as compared to algorithms in the private sector where the decision outcomes are well-defined.”
From A Framework of High-Stakes Algorithmic Decision-Making for the Public Sector Developed through a Case Study of Child-Welfare (2021) · cites this paper as [34]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Algorithm aversion: People erroneously avoid algorithms after seeing them err.
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000033 · Cited by 3,232
Clinical versus statistical prediction: A theoretical analysis and a review of the evidence.
Meehl, P. E. (1954) · University of Minnesota Press eBooks · doi:10.1037/11281-000 · Cited by 2,227
Intelligible Models for HealthCare: Predicting Pneumonia Risk and Hospital 30-day Readmission
Caruana, R., Lou, Y., Gehrke, J., Koch, P., Sturm, M., & Elhadad, N. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2788613 · Cited by 1,685
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2018) · Management Science · doi:10.1287/mnsc.2016.2643 · Cited by 1,230 · cited 2×
“Meanwhile, studies focused on the causes of algorithm aversion have found that repeatedly seeing the algorithm make the same mistake leads to decreased reliance of the agent on the system [13], while giving some control over the algorithm can counter this phenomenon [14].”
BackgroundAutomation bias: a systematic review of frequency, effect mediators, and mitigators
Goddard, K., Roudsari, A., & Wyatt, J. C. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000089 · Cited by 1,162 · cited 1×
“Studies analyzing factors contributing to automation bias have found that complex tasks and time pressure may increase over-reliance on decision support [41, 17].”
BackgroundÆgisdóttir, S., White, M. J., Spengler, P. M., Maugherman, A. S., Anderson, L. A., Cook, R. S., Nichols, C. N., Lampropoulos, G. K., Walker, B. S., Cohen, G., et al. (2006) · The Counseling Psychologist · doi:10.1177/0011000005285875 · Cited by 737
'It's Reducing a Human Being to a Percentage': Perceptions of Justice in Algorithmic Decisions
Binns, R., Van Kleek, M., Veale, M., Lyngs, U., Zhao, J., & Shadbolt, N. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173951 · Cited by 691
How Much Information?: Effects of Transparency on Trust in an Algorithmic Interface
Kizilcec, R. F. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858402 · Cited by 615
Human Decisions and Machine Predictions
Kleinberg, J., Lakkaraju, H., Leskovec, J., Ludwig, J., & Mullainathan, S. (2017) · doi:10.3386/w23180 · Cited by 545
Understanding the Effect of Accuracy on Trust in Machine Learning Models
Yin, M., Wortman Vaughan, J., & Wallach, H. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300509 · Cited by 527 · cited 2×
“Users’ reliance on the system is known to vary with the observed [51, 52] and stated accuracy [50] of the system.”
Background
Research works printed but not linked: 13
- Alexandra Chouldechova, Diana Benavides-Prado, Oleksandr Fialko, and Rhema Vaithianathan. 2018. A case study of algorithm-assisted decision making in child maltreatment hotline screening decisions. In Conference on Fairness, Accountability and Transparency. 134--148.
- Robyn M Dawes, David Faust, and Paul E Meehl. 1989. Clinical versus actuarial judgment. Science 243, 4899 (1989), 1668--1674.
- Matthew DeMichele, Peter Baumgartner, Kelle Barrick, Megan Comfort, Samuel Scaggs, and Shilpi Misra. 2018. What do criminal justice professionals think about risk assessment at pretrial? Available at SSRN 3168490 (2018).
- Virginia Eubanks. 2018. Automating inequality: How high-tech tools profile, police, and punish the poor. St. Martin's Press.
- William M Grove, David H Zald, Boyd S Lebow, Beth E Snitz, and Chad Nelson. 2000. Clinical versus mechanical prediction: a meta-analysis. Psychological assessment 12, 1 (2000), 19.
- Sophie Hilgard, Nir Rosenfeld, Mahzarin R Banaji, Jack Cao, and David C Parkes. 2019. Learning Representations by Humans, for Humans. arXiv preprint arXiv:1905.12686 (2019). · arXiv
- John D Lee and Katrina A See. 2004. Trust in automation: Designing for appropriate reliance. Human factors 46, 1 (2004), 50--80.
- David Madras Toni Pitassi and Richard Zemel. 2018. Predict responsibly: improving fairness and accuracy by learning to defer. In Advances in Neural Information Processing Systems. 6147--6157.
- Katharina Marten, Tobias Seyfarth, Florian Auer, Edzard Wiener, Andreas Grillhösl, Silvia Obenauer, Ernst J Rummeny, and Christoph Engelke. 2004. Computer-assisted detection of pulmonary nodules: performance evaluation of an expert knowledge-based detection system in consensus reading with experienced and inexperienced chest radiologists. European radiology 14, 10 (2004), 1930--1938.
- Nadine B. Sarter and Beth Schroeder. 2001. Supporting decision making and action selection under time pressure and uncertainty: The case of in-flight icing. Human factors 43, 4 (2001), 573--583.
- Jennifer L. Skeem, Nicholas Scurich, and John Monahan. 2019. Impact of Risk Assessment on Judges. Fairness in Sentencing Relatively Poor Defendants. Virginia Public Law and Legal Theory Research Paper 2019-02 (2019).
- Linda J. Skitka, Kathleen L. Mosier, Mark Burdick, and Bonnie Rosenblatt. 2000. Automation bias and errors: are crews better than individuals? The International journal of aviation psychology 10, 1 (2000), 85--97.
- Michael Yeomans, Anuj Shah, Sendhil Mullainathan, and Jon Kleinberg. 2017. Making sense of recommendations. Journal of Behavioral Decision Making (2017).
Cited by
Sorted by citations
Inherent Tradeoffs in the Fair Determination of Risk Scores
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603197 · Cited by 350
Algorithmic bias: Senses, sources, solutions
Fazelpour, S., & Danks, D. J. (2021) · Philosophy Compass · doi:10.1111/phc3.12760 · Cited by 338
The flaws of policies requiring human oversight of government algorithms
Green, B. (2022) · Computer Law & Security Review · doi:10.1016/j.clsr.2022.105681 · Cited by 263
How transparency modulates trust in artificial intelligence
Zerilli, J., Bhatt, U., & Weller, A. (2022) · Patterns · doi:10.1016/j.patter.2022.100455 · Cited by 257
Lai, V., Chen, C., Smith-Renner, A., Liao, Q. V., & Tan, C. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3594087 · Cited by 204
Applications, Challenges, and Future Directions of Human-in-the-Loop Learning
Kumar, S., Datta, S., Singh, V., Datta, D., Singh, S. K., & Sharma, R. (2024) · IEEE Access · doi:10.1109/access.2024.3401547 · Cited by 204
Designing for human–AI complementarity in K‐12 education
Holstein, K., & Aleven, V. (2022) · AI Magazine · doi:10.1002/aaai.12058 · Cited by 156
Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with Explanations
Chen, V., Liao, Q. V., Wortman Vaughan, J., & Bansal, G. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3610219 · Cited by 220
“Human-AI decision-making, also referred to as AI-assisted decision-making, broadly encompasses set-ups where an ML model is used to help users to make a final judgment or decision [22, 34, 47]—a form of collaboration between human and AI system.”
MethodBayesian modeling of human–AI complementarity
Mark Steyvers, B., Tejeda, H., Kerrigan, G., & Smyth, P. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2111547119 · Cited by 164
Saxena, D., Badillo-Urquiola, K., Wisniewski, P. J., & Guha, S. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3476089 · Cited by 134
“Prior research has also established that an irreducible degree of uncertainty exists with respect to the outcomes in the public sector [21, 34, 57] with both humans and algorithms likely to make mistakes.”
BackgroundInkpen, K., Chappidi, S., Mallari, K., Nushi, B., Ramesh, D., Michelucci, P., Mandava, V., Vepřek, L. H., & Quinn, G. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3534561 · Cited by 132
Algorithms and Decision-Making in the Public Sector
Levy, K. E. C., Chasalow, K. E., & Riley, S. (2021) · Annual Review of Law and Social Science · doi:10.1146/annurev-lawsocsci-041221-023808 · Cited by 165
Explainable AI improves task performance in human–AI collaboration
Senoner, J., Schallmoser, S., Kratzwald, B., Feuerriegel, S., & Netland, T. H. (2024) · Scientific Reports · doi:10.1038/s41598-024-82501-9 · Cited by 157
Who Goes First? Influences of Human-AI Workflow on Decision Making in Clinical Imaging
Fogliato, R., Chappidi, S., Lungren, M. P., Fisher, P., Wilson, D., Fitzke, M., Parkinson, M., Horvitz, E., Inkpen, K. M., & Nushi, B. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533193 · Cited by 131
Self-citationHow does HCI Understand Human Agency and Autonomy?
Bennett, D., Metatla, O., Roudaut, A., & Mekler, E. D. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580651 · Cited by 111
Measuring algorithmically infused societies
Wagner, C., Strohmaier, M., Olteanu, A., Kıcıman, E., Contractor, N., & Eliassi-Rad, T. (2021) · Nature · doi:10.1038/s41586-021-03666-1 · Cited by 144
Exploring How Machine Learning Practitioners (Try To) Use Fairness Toolkits
Deng, W. H., Nagireddy, M., Lee, M. S. A., Singh, J., Wu, Z. S., Holstein, K., & Zhu, H. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533113 · Cited by 99
On the Quest for Effectiveness in Human Oversight: Interdisciplinary Perspectives
Sterz, S., Baum, K., Biewer, S., Hermanns, H., Lauber-Rönsberg, A., Meinel, P., & Langer, M. (2024) · The 2024 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3630106.3659051 · Cited by 91
“Discussing them is beyond the scope of this paper; however, prima facie , there appears to be no inherent conflict between our proposal and these objectives.”
BackgroundInfluentialHow Child Welfare Workers Reduce Racial Disparities in Algorithmic Decisions
Cheng, H.-F., Stapleton, L., Kawakami, A., Sivaraman, V., Cheng, Y., Qing, D., Perer, A., Holstein, K., Wu, Z. S., & Zhu, H. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501831 · Cited by 107
Improving Human-AI Collaboration With Descriptions of AI Behavior
Cabrera, Á. A., Perer, A., & Hong, J. I. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579612 · Cited by 87
“Human-AI collaboration is finding real-world use in tasks ranging from diagnosing prostate cancer [12] to screening calls to child welfare hotlines [19, 27].”
BackgroundStapleton, L., Lee, M. H., Qing, D., Wright, M., Chouldechova, A., Holstein, K., Wu, Z. S., & Zhu, H. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533177 · Cited by 96
Self-citationZhang, A., Walker, O., Nguyen, K., Dai, J., Chen, A., & Lee, M. K. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579601 · Cited by 95
Green, B., & Chen, Y. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479562 · Cited by 69
How Beginning Programmers and Code LLMs (Mis)read Each Other
Nguyen, S., Babe, H. M., Zi, Y., Guha, A., Anderson, C. J., & Feldman, M. Q. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642706 · Cited by 120
Schoeffer, J., Kuehl, N., & Machowski, Y. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533218 · Cited by 67
Mitigating Bias in Algorithmic Hiring: Evaluating Claims and Practices
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603203 · Cited by 67
Soliciting Stakeholders’ Fairness Notions in Child Maltreatment Predictive Systems
Cheng, H.-F., Stapleton, L., Wang, R., Bullock, P., Chouldechova, A., Wu, Z. S. S., & Zhu, H. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445308 · Cited by 71
Self-citationGroh, M., Harris, C., Daneshjou, R., Badri, O., & Koochek, A. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555634 · Cited by 82
Human–artificial intelligence collaboration in prediction: a field experiment in the retail industry
Revilla, E., Saenz, M. J., Seifert, M., & Ma, Y. (2023) · Journal of Management Information Systems · doi:10.1080/07421222.2023.2267317 · Cited by 63
Herrera, F. (2025) · Information Fusion · doi:10.1016/j.inffus.2025.103133 · Cited by 68
“Part Man, Part Machine, All Cop”: Automation in Policing
Adensamer, A., & Klausner, L. D. (2021) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2021.655486 · Cited by 64
You’d Better Stop! Understanding Human Reliance on Machine Learning Models under Covariate Shift
Chiang, C.-W., & Yin, M. (2021) · 13th ACM Web Science Conference 2021 · doi:10.1145/3447535.3462487 · Cited by 53
The extent of algorithm aversion in decision-making situations with varying gravity
Filiz, I., Judek, J. R., Lorenz, M., & Spiwoks, M. (2023) · PLoS ONE · doi:10.1371/journal.pone.0278751 · Cited by 63
Mitigating knowledge imbalance in AI-advised decision-making through collaborative user involvement
Gómez, C., Unberath, M., & Huang, C. (2022) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2022.102977 · Cited by 57
Cabitza, F., Campagner, A., Angius, R., Natali, C., & Reverberi, C. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581095 · Cited by 51
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603207 · Cited by 49
Towards Unbiased and Accurate Deferral to Multiple Experts
Keswani, V., Lease, M., & Kenthapadi, K. (2021) · Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3461702.3462516 · Cited by 45
“Empirical studies in this direction [28, 78, 19, 40, 12, 40] often inherently use multiple experts since the results are based on crowdsourced data, but do not aim to propose a learning model for the pipeline.”
BackgroundKawakami, A., Sivaraman, V., Stapleton, L., Cheng, H.-F., Perer, A., Wu, Z. S., Zhu, H., & Holstein, K. (2022) · Designing Interactive Systems Conference · doi:10.1145/3532106.3533556 · Cited by 46
Simkute, A., Luger, E. A., Jones, B., Evans, M., & Jones, R. (2021) · Journal of Responsible Technology · doi:10.1016/j.jrt.2021.100017 · Cited by 46
Salimzadeh, S., He, G., & Gadiraju, U. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641905 · Cited by 41
“With the presence of uncertainty in a task, individuals may lack sufficient capability to verify the correctness of AI advice and therefore rely more heavily on the AI systems [29], leading to reduced appropriate reliance on AI systems.”
BackgroundInfluentialHolstein, K., De‐Arteaga, M., Tumati, L., & Cheng, Y. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579628 · Cited by 45
Self-citationEvaluating the impact of human explanation strategies on human-AI visual decision-making
Morrison, K., Shin, D., Holstein, K., & Perer, A. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579481 · Cited by 37
Wang, X., & Yin, M. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581366 · Cited by 38
Arcila, B. B. (2024) · Computer law & security review · doi:10.1016/j.clsr.2024.106012 · Cited by 38
The rise of people analytics and the future of organizational research
Polzer, J. T. (2022) · Research in Organizational Behavior · doi:10.1016/j.riob.2023.100181 · Cited by 52
The Devil is in the Details: Interrogating Values Embedded in the Allegheny Family Screening Tool
Gerchick, M. K., Jegede, T., Shah, T., Gutiérrez, A. B., Beiers, S., Shemtov, N., Xu, K., Samant, A., & Horowitz, A. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594081 · Cited by 41
Designing equitable algorithms
Chohlas-Wood, A., Coots, M., Goel, S., & Nyarko, J. (2023) · Nature Computational Science · doi:10.1038/s43588-023-00485-4 · Cited by 42
Erlei, A., Das, R., Meub, L., Anand, A., & Gadiraju, U. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517734 · Cited by 38
Role of Human-AI Interaction in Selective Prediction
Bondi, E., Koster, R., Sheahan, H., Chadwick, M. J., Bachrach, Y., Cemgil, A. T., Paquet, U., & Dvijotham, K. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i5.20465 · Cited by 2
Karusala, N., Upadhyay, S., Veeraraghavan, R., & Gajos, K. Z. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641898 · Cited by 43
Saxena, D., Moon, E. S.-Y., Shehata, D., & Guha, S. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517742 · Cited by 38
Human-Algorithm Collaboration: Achieving Complementarity and Avoiding Unfairness
Donahue, K., Chouldechova, A., & Kenthapadi, K. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533221 · Cited by 33
Self-citationBridging the gap: Towards an expanded toolkit for AI-driven decision-making in the public sector
Fischer-Abaigar, U., Kern, C. A., Barda, N., & Kreuter, F. (2024) · Government Information Quarterly · doi:10.1016/j.giq.2024.101976 · Cited by 64
User Characteristics in Explainable AI: The Rabbit Hole of Personalization?
Nimmo, R., Constantinides, M., Zhou, K., Quercia, D., & Stumpf, S. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642352 · Cited by 39
When Algorithms Err : Differential Impact of Early vs. Late Errors on Users’ Reliance on Algorithms
Kim, A., Yang, M., & Zhang, J. (2020) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3557889 · Cited by 42
Regulating Government AI and the Challenge of Sociotechnical Design
Engstrom, D. F., & Haim, A. (2023) · Annual Review of Law and Social Science · doi:10.1146/annurev-lawsocsci-120522-091626 · Cited by 41
Ghosting the Machine: Judicial Resistance to a Recidivism Risk Assessment Instrument
Pruss, D. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3593999 · Cited by 31
Holstein, K., & Doroudi, S. (2021) · arXiv · doi:10.48550/arxiv.2104.12920 · Cited by 29
Leveraging Expert Consistency to Improve Algorithmic Decision Support
De‐Arteaga, M., Jeanselme, V., Dubrawski, A. W., & Chouldechova, A. (2025) · Management Science · doi:10.1287/mnsc.2022.01576 · Cited by 53
Self-citationArakawa, R., & Yakura, H. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445339 · Cited by 28
Self-fulfilling prophecies and machine learning in resuscitation science
De-Arteaga, M., & Elmer, J. (2023) · Resuscitation · doi:10.1016/j.resuscitation.2022.10.014 · Cited by 28
Self-citationCapturing Humans’ Mental Models of AI: An Item Response Theory Approach
Kelly, M., Kumar, A., Smyth, P., & Mark Steyvers, B. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594111 · Cited by 42
“Computer says no”: Algorithmic decision support and organisational responsibility
Adensamer, A., Gsenger, R., & Klausner, L. D. (2021) · Journal of Responsible Technology · doi:10.1016/j.jrt.2021.100014 · Cited by 32
Dorsch, J., & Deroy, O. D. (2024) · Philosophy & Technology · doi:10.1007/s13347-024-00752-w · Cited by 30
Understanding Choice Independence and Error Types in Human-AI Collaboration
Erlei, A., Sharma, A., & Gadiraju, U. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641946 · Cited by 34
Fogliato, R., Chouldechova, A., & Lipton, Z. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479572 · Cited by 23
Self-citationKortemeyer, G., & Nöhl, J. (2025) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.21.010136 · Cited by 48
Human-AI Collaboration with Bandit Feedback
Gao, R., Saar‐Tsechansky, M., De‐Arteaga, M., Han, L., Lee, M. K., & Lease, M. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/237 · Cited by 23
Self-citationSaxena, D., Repaci, C., Sage, M., & Guha, S. (2022) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3491101.3519771 · Cited by 23
Dignity and use of algorithm in performance evaluation
Zhang, L., & Amos, C. (2023) · Behaviour and Information Technology · doi:10.1080/0144929x.2022.2164214 · Cited by 27
Overcoming Algorithm Aversion: A Comparison between Process and Outcome Control
Cheng, L., & Chouldechova, A. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581253 · Cited by 24
Self-citationHeterogeneity in Algorithm-Assisted Decision-Making: A Case Study in Child Abuse Hotline Screening
Cheng, L., & Chouldechova, A. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555101 · Cited by 23
Self-citationHeterogeneity in Algorithm-Assisted Decision-Making: A Case Study in Child Abuse Hotline Screening
Cheng, L., & Chouldechova, A. (2022) · arXiv · doi:10.48550/arxiv.2204.05478 · Cited by 20
Self-citationInvisible clinical labor driving the successful integration of AI in healthcare
Ulloa, M., Rothrock, B., Ahmad, F. S., & Jacobs, M. L. (2022) · Frontiers in Computer Science · doi:10.3389/fcomp.2022.1045704 · Cited by 24
The Externalities of Exploration and How Data Diversity Helps Exploitation
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603208 · Cited by 20
Black, E., Naidu, R. C. A., Ghani, R., Rodolfa, K. T., Ho, D. E., & Heidari, H. (2023) · ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO) · doi:10.1145/3617694.3623259 · Cited by 19
The Fall of an Algorithm: Characterizing the Dynamics Toward Abandonment
Johnson, N., Moharana, S., Harrington, C., Andalibi, N., Heidari, H., & Eslami, M. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658910 · Cited by 23
Learning to Be Fair: A Consequentialist Approach to Equitable Decision Making
Chohlas-Wood, A., Coots, M., Zhu, H., Brunskill, E., & Goel, S. (2024) · Management Science · doi:10.1287/mnsc.2022.00345 · Cited by 34
Selection Problems in the Presence of Implicit Bias
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603209 · Cited by 21
The perceived value of human-AI collaboration in early shape exploration: An exploratory assessment
Arias–Rosales, A. (2022) · PLoS ONE · doi:10.1371/journal.pone.0274496 · Cited by 22
XAI for learning: Narrowing down the digital divide between “new” and “old” experts
Simkute, A., Surana, A., Luger, E. A., Evans, M., & Jones, R. (2022) · Nordic Conference on Human-Computer Interaction · doi:10.1145/3547522.3547678 · Cited by 19
Lee, M. H., Siewiorek, D. P., Smailagic, A., Bernardino, A., & Bermúdez i Badia, S. (2022) · 27th International Conference on Intelligent User Interfaces · doi:10.1145/3490099.3511112 · Cited by 19
“Following prior research that describes the potential of ML algorithms to outperform human experts on prediction tasks [17, 20, 34, 39], researchers have investigated the feasibility of deploying these ML-based decision support systems to improve decision makings.”
BackgroundMethodCan Computers Outperform Humans in Detecting User Zone-Outs? Implications for Intelligent Interfaces
Bosch, N., & D’Mello, S. K. (2022) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3481889 · Cited by 17
Kellogg, K. C., Lifshitz‐Assaf, H., Randazzo, S., Mollick, E., Dell’Acqua, F., McFowland, E., Candelon, F., & Lakhani, K. R. (2025) · Information and Organization · doi:10.1016/j.infoandorg.2025.100559 · Cited by 21
Fortifying the algorithmic management provisions in the proposed Platform Work Directive
Veale, M., Silberman, M. ‘., & Binns, R. (2023) · European Labour Law Journal · doi:10.1177/20319525231167983 · Cited by 15
A Taxonomy of Human and ML Strengths in Decision-Making to Investigate Human-ML Complementarity
Rastogi, C., Leqi, L., Holstein, K., & Heidari, H. (2023) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v11i1.27554 · Cited by 46
Emotion AI Use in U.S. Mental Healthcare: Potentially Unjust and Techno-Solutionist
Roemmich, K., Corvite, S., Pyle, C., Karizat, N., & Andalibi, N. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637324 · Cited by 15
Bias, fairness, and assurance in AI: overview and synthesis
Al-Khulaidy, A., & Kavak, H. (2023) · Elsevier eBooks · doi:10.1016/b978-0-32-391919-7.00016-0 · Cited by 15
Pampouktsi, P., Avdimiotis, S., Μaragoudakis, M., Avlonitis, M., Samantha, N., Hoogar, P., Ruhago, G. M., & Rono, W. (2022) · Journal of Information System Exploration and Research · doi:10.52465/joiser.v1i1.91 · Cited by 14
Debiased-CAM to mitigate image perturbations with faithful visual explanations of machine learning
Zhang, W., Dimiccoli, M., & Lim, B. Y. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517522 · Cited by 21
Singh, A. P., & Szajnfarber, Z. (2025) · Systems Engineering · doi:10.1002/sys.70024 · Cited by 20
AI Mismatches: Identifying Potential Algorithmic Harms Before AI Development
Saxena, D., Jung, J.-Y., Forlizzi, J., Holstein, K., & Zimmerman, J. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714098 · Cited by 25
Zhang, Y., Guo, J., Wang, Y., Li, S., Yang, Q., Zhang, J., & Lu, Z. (2025) · Systems · doi:10.3390/systems13100855 · Cited by 16
A comparative user study of human predictions in algorithm-supported recidivism risk assessment
Portela, M., Castillo, C., Tolan, S., Karimi-Haghighi, M., & Pueyo, A. A. (2024) · Artificial Intelligence and Law · doi:10.1007/s10506-024-09393-y · Cited by 18
Fair Machine Guidance to Enhance Fair Decision Making in Biased People
Yang, M., Arai, H., Yamashita, N., & Baba, Y. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642627 · Cited by 16
Salimzadeh, S., & Gadiraju, U. (2024) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3627043.3659567 · Cited by 14
Sadeghi, M., Pöttgen, D., Ebel, P., & Vogelsang, A. (2024) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3627043.3659573 · Cited by 16
Workshop on Trust and Reliance in AI-Human Teams (TRAIT)
Bansal, G., Smith, A., Buçinca, Z., Wu, T., Holstein, K., Hullman, J. R., & Stumpf, S. (2022) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3491101.3503704 · Cited by 12
Johnson, R., & Zhang, S. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533223 · Cited by 20
A benchmarking framework and dataset for learning to defer in human-AI decision-making
Alves, J. V., Leitão, D., Jesus, S., Sampaio, M. O. P., Liébana, J., Saleiro, P., Figueiredo, M. A. T., & Bizarro, P. (2025) · Scientific Data · doi:10.1038/s41597-025-04664-y · Cited by 10
“However, in real-world settings, due to limitations in human work capacity and legal restrictions, it is common to use an ML model to screen instances, raising alerts that are then reviewed by human experts 1,28 .”
Influential
Metadata
- Authors
- De-Arteaga, M., Fogliato, R., & Chouldechova, A.
- Affiliations
- Carnegie Mellon University (US)
- Venue
- Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2020-04-21
- Pages
- 1-12
- OpenAlex
- W3007910004
- Cited by
- 221
- References
- 33
- Citations by year
- 2026: 24 · 2025: 35 · 2024: 34 · 2023: 59 · 2022: 40 · 2021: 24 · 2020: 3
- FWCI
- 32.68
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Hillman Foundation
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Keywords
- human-in-the-loop, algorithmic decision support, child maltreatment screening, child protection services, human-machine decision-making, risk prediction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
