Automation bias and verification complexity: a systematic review
Open accessThe DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Abstract
Introduction: While potentially reducing decision errors, decision support systems can introduce new types of errors. Automation bias (AB) happens when users become overreliant on decision support, which reduces vigilance in information seeking and processing. Most research originates from the human factors literature, where the prevailing view is that AB occurs only in multitasking environments. Objectives: This review seeks to compare the human factors and health care literature, focusing on the apparent association of AB with multitasking and task complexity. Data sources: EMBASE, Medline, Compendex, Inspec, IEEE Xplore, Scopus, Web of Science, PsycINFO, and Business Source Premiere from 1983 to 2015. Study selection: Evaluation studies where task execution was assisted by automation and resulted in errors were included. Participants needed to be able to verify automation correctness and perform the task manually. Methods: Tasks were identified and grouped. Task and automation type and presence of multitasking were noted. Each task was rated for its verification complexity. Results: Of 890 papers identified, 40 met the inclusion criteria; 6 were in health care. Contrary to the prevailing human factors view, AB was found in single tasks, typically involving diagnosis rather than monitoring, and with high verification complexity. Limitations: The literature is fragmented, with large discrepancies in how AB is reported. Few studies reported the statistical significance of AB compared to a control condition. Conclusion: AB appears to be associated with the degree of cognitive load experienced in decision tasks, and appears to not be uniquely associated with multitasking. Strategies to minimize AB might focus on cognitive load reduction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“To the best of our knowledge, existing reviews have focused on AB in relation to traditional computer-based aids rather than AI-driven systems (see Goddard etal. 2012; Lyell and Coiera 2017).”
From Exploring automation bias in human–AI collaboration: a review and implications for explainable AI (2026) · cites this paper as Lyell and Coiera 2017
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Therefore, cognitive overload and trust remain the most crucial factors since, paradoxically, higher automation accuracy can further reinforce user trust, leading to an increased likelihood of AB.”
From Exploring automation bias in human–AI collaboration: a review and implications for explainable AI (2026) · cites this paper as Lyell and Coiera 2017
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“the harder the verification complexity, that is the complexity of verifying that the automation is performing correctly, the greater the likelihood of undue trust in the system (Lyell and Coiera 2017).”
From Exploring automation bias in human–AI collaboration: a review and implications for explainable AI (2026) · cites this paper as Lyell and Coiera 2017
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Cognitive overload is considered the most significant factor inhibiting users from adequately verifying automation accuracy, thereby increasing AB:”
From Exploring automation bias in human–AI collaboration: a review and implications for explainable AI (2026) · cites this paper as Lyell and Coiera 2017
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This finding aligns with Lyell and Coiera's (2017) consideration that accountability alone is an ineffective intervention.”
From Exploring automation bias in human–AI collaboration: a review and implications for explainable AI (2026) · cites this paper as Lyell and Coiera's (2017)
Experimental — accuracy not yet measured
11 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
The Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817
Dermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
Sweller, J., Ayres, P., & Kalyuga, S. (2011) · doi:10.1007/978-1-4419-8126-4 · Cited by 5,531
Sweller, J. (2011) · Psychology of Learning and Motivation · doi:10.1016/b978-0-12-387691-1.00002-8 · Cited by 4,856
Sweller, J. (2012) · Encyclopedia of the Sciences of Learning · doi:10.1007/978-1-4419-1428-6_446 · Cited by 4,405
Garg, A. X., Adhikari, N. K. J., McDonald, H., Rosas-Arellano, M. P., Devereaux, P. J., Beyene, J., Sam, J., & Haynes, R. B. (2005) · JAMA · doi:10.1001/jama.293.10.1223 · Cited by 2,936
Complacency and Bias in Human Use of Automation: An Attentional Integration
Parasuraman, R., & Manzey, D. H. (2010) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720810376055 · Cited by 1,710
Research works printed but not linked: 7
- Mosier, 1996, Human decision makers and automated decision aids: made for each other, 201
- Parasuraman, Performance consequences of automation-induced “complacency.” Int J Aviation Psychol, 1993, 3, 1
- Prinzel, 2005, Individual differences in complacency and monitoring for automation failures, Individual Differences Res, 3, 27
- Singh, 2009, Effects of automation reliability and training on automation-induced complacency and perceived mental workload, J Indian Acad Appl Psychol, 35, 9
- Bagheri, 2004, Considering Subjective Trust and Monitoring Behavior in Assessing Automation-induced “Complacency.”
- Singh, 2010, Performance feedback, mental workload and monitoring efficiency, J Indian Acad Appl Psychol, 36, 151
- Singh, 2001, Effects of manual training and automation reliability on automation induced complacency in flight simulation task, Psychol Stud, 46, 21
Cited by
Items 101–200 of 448
Reduced Verification of Medication Alerts Increases Prescribing Errors
Lyell, D., Magrabi, F., & Coiera, E. W. (2019) · Applied Clinical Informatics · doi:10.1055/s-0038-1677009 · Cited by 21
Self-citationTeng, D., Tan, L., Cao, Q., Xia, Y., Zhang, N., Li, J., & Zhao, D. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02547-z · Cited by 18
Mori, Y., Kopylov, U., Sinonquel, P., Ebigbo, A., Dekker, E., de Groof, A. J., Ahmad, O. F., Kader, R., Săftoiu, A., Schoon, E. J., et al. (2025) · Endoscopy · doi:10.1055/a-2742-4342 · Cited by 26
Cabitza, F., Campagner, A., Famiglini, L., Gallazzi, E., & Maida, G. A. L. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-14463-9_3 · Cited by 23
Monteith, S., Glenn, T., Geddes, J. R., Achtyes, E. D., Whybrow, P. C., & Bauer, M. (2023) · Pharmacopsychiatry · doi:10.1055/a-2142-9325 · Cited by 23
“The risk for automation bias increases when it is hard to verify if automation is performing correctly, as found in clinical medicine [54].”
BackgroundSideris, K., Weir, C. R., Schmalfuss, C. M., Hanson, H., Pipke, M., Tseng, P.-H., Lewis, N. P., Sallam, K., Bozkurt, B., Hanff, T. C., et al. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae017 · Cited by 23
How Artificial Intelligence Will Impact Colonoscopy and Colorectal Screening
Shung, D. L., & Byrne, M. F. (2020) · Gastrointestinal Endoscopy Clinics of North America · doi:10.1016/j.giec.2020.02.010 · Cited by 21
Akamine, Y., Ueda, Y., Ueno, Y. R., Sofue, K., Murakami, T., Yoneyama, M., Obara, M., & CAUTEREN, M. V. (2020) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2020.09.011 · Cited by 20
Aakre, C. A., Kitson, J. E., Li, M., & Herasevich, V. (2017) · JMIR Human Factors · doi:10.2196/humanfactors.7567 · Cited by 17
“Items 3-5 reflect the concerns several stakeholders expressed about the potential for automation bias with this tool [31].”
BackgroundThe increased role of advanced technology and automation in audit: A delphi study
Lombardi, D. R., Kim, M., Sipior, J. C., & Vasarhelyi, M. A. (2025) · International Journal of Accounting Information Systems · doi:10.1016/j.accinf.2025.100733 · Cited by 49
Ohde, J. W., Thompson, A., Liu, Z., Rost, L. M., Overgaard, J. D., Tan, J. Y. E., Overgaard, S. M., Sarmiento, R. F., Ke, Y., Liew, J. C. K., et al. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02554-0 · Cited by 23
“Don’t let me be misunderstood”: Critical AI literacy for the constructive use of AI technology
Strauß, S. (2021) · TATuP - Zeitschrift für Technikfolgenabschätzung in Theorie und Praxis · doi:10.14512/tatup.30.3.44 · Cited by 44
From academics to Aidemics: Unpacking the human–AI symbiosis in higher education
Yurdunkulu, A., Bulut, M. A., & Göçen, A. (2025) · Acta Psychologica · doi:10.1016/j.actpsy.2025.105796 · Cited by 27
Singh, S. P., Anirvan, P., & Meher, D. (2021) · Euroasian Journal of Hepato-Gastroenterology · doi:10.5005/jp-journals-10018-1322 · Cited by 17
Mitigating Automation Bias in Generative AI Through Nudges: A Cognitive Reflection Test Study
Wingerter, T. L., Straub, T., & Schweitzer, S. (2025) · Procedia Computer Science · doi:10.1016/j.procs.2025.09.331 · Cited by 27
Should AI-Enabled Medical Devices be Explainable?
Matulionytė, R., Nolan, P., Magrabi, F., & Beheshti, A. (2022) · International Journal of Law and Information Technology · doi:10.1093/ijlit/eaac015 · Cited by 23
Settouti, N., & Saidi, M. (2023) · Evolutionary Intelligence · doi:10.1007/s12065-023-00833-3 · Cited by 17
“Moreover, unquestionably following AI recommendations can lead to automation bias [14, 27].”
InfluentialGrindley, B., Parnell, K. J., Cherrett, T., Scanlan, J., & Plant, K. L. (2024) · Transportation Planning and Technology · doi:10.1080/03081060.2024.2375645 · Cited by 20
“Similarly, in a review of automated medical tasks with high verification complexity, a high propensity for automation bias was found, or the reliance on the automation and an inability to recover when it is unavailable or detect faults (Lyell and Coiera 2017).”
Wang, G., Zhang, Z., Xie, S., & Guo, Y. (2025) · Public Administration Review · doi:10.1111/puar.13928 · Cited by 20
“Some studies have shown evidence of automation bias or algorithm appreciation (e.g., Araujo et al. 2020; Logg, Minson, and Moore 2019; Lyell and Coiera 2017), while others have revealed the phenomenon of algorithm aversion (e.g., Acikgoz et al. 2020; Burton, Stein, and Jensen 2020; Dietvorst and…”
Reimagining psychiatric care with agentic AI: promise, challenges, and a roadmap forward
Sharma, D., Meshkat, S., Perivolaris, A., Kamaleddin, M. A., Teferra, B. G., Rueda, A., Samavi, R., Jetly, R., Mago, V., Wu, Y., et al. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02453-4 · Cited by 20
Huegli, D., Merks, S., & Schwaninger, A. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2107775 · Cited by 16
“…the probability matching strategy (Bartlett & McCarley, 2017, 2019; Bliss et al., 1995; Manzey et al., 2014) or the much-discussed automation bias (Lyell & Coiera, 2017; Mosier & Manzey, 2020), both of which have been found to cause insufficient human – machine system performance (Bartlett &…”
BackgroundHong, J. C., Eclov, N. C. W., Stephens, S. J., Mowery, Y. M., & Palta, M. (2022) · BMC Bioinformatics · doi:10.1186/s12859-022-04940-3 · Cited by 17
“Routine clinical deployment or longer-term prospective studies require more prolonged implementation periods, which introduce the risk of other confounders, such as automation bias or distributional shift, requiring regular quality assurance [18].”
BackgroundMartiniussen, M. A., Larsen, M., Larsen, A. S. F., Hovda, T., Koch, H. W., Bjørnerud, A., & Hofvind, S. S. H. (2023) · European Journal of Radiology · doi:10.1016/j.ejrad.2023.111061 · Cited by 16
Comprehensive Management of Intracranial Aneurysms Using Artificial Intelligence: An Overview
Xue, J., Zheng, H., Lai, R., Zhou, Z., Zhou, J., Chen, L., & Wang, M. (2024) · World Neurosurgery · doi:10.1016/j.wneu.2024.10.108 · Cited by 15
Bias and Oversight in Clinical AI: A Review of Decision Support Tools and Equity Frameworks
Adegunle, F., Chhatwal, K., Arab, S., Alabdaljabar, M. S., Raslan, M. A., Sayed, O., & Goldsweig, A. M. (2026) · Journal of General Internal Medicine · doi:10.1007/s11606-026-10229-5 · Cited by 16
“Automation bias occurs when professionals defer to model outputs, even against their better judgement 69,70 .”
Managing Algorithms for Public Value
Selten, F., & Meijer, A. J. (2021) · International Journal of Public Administration in the Digital Age · doi:10.4018/ijpada.20210101.oa9 · Cited by 29
“Automation bias refers to the mechanism that decision makers have the tendency to display an overreliance in the validity and rationality of automated predictions (Lyell & Coiera, 2017).”
BackgroundArtificial Intelligence Methods
Liu, S., Russo, C., Molina, E. S., & Ieva, A. D. (2024) · Advances in experimental medicine and biology · doi:10.1007/978-3-031-64892-2_3 · Cited by 20
Kirpalani, A., Grimmer, J., & Wang, P. Z. T. (2025) · Medical Science Educator · doi:10.1007/s40670-025-02289-9 · Cited by 14
“These phenomena suggest that individuals often ascribe high reliability to automated systems, which can lead to “automation bias,” where users tend to follow algorithmic approaches sometimes at the expense of their own critical judgment or peer input [4, 5].”
Cabitza, F., Famiglini, L., Fregosi, C., Pe, S., Parimbelli, E., La Maida, G. A., & Gallazzi, E. (2025) · Proceedings of the 30th International Conference on Intelligent User Interfaces · doi:10.1145/3708359.3712157 · Cited by 11
Kulikowski, C. A. (2022) · Yearbook of Medical Informatics · doi:10.1055/s-0042-1742491 · Cited by 11
“…for AI/ ML results is being increasingly recognized and reported [44-46], adding to the more general concerns about the ethical, automation bias, and safety issues surrounding computers and informatics for clinical decision-making which have been increasingly addressed over the past years [47-49].”
BackgroundCrossing the Trust Gap in Medical AI: Building an Abductive Bridge for xAI
Gouveia, S. S., & Malík, J. (2024) · Philosophy & Technology · doi:10.1007/s13347-024-00790-4 · Cited by 18
“…through their own confirmation bias (Ghassemi et al., 2021 ), where they think that what matters to them is also salient for the AI, or they let these systems decide for them, succumbing to the automation bias (Goddard et al., 2021; Lyell & Coiera, 2017 ) and trusting these systems unquestioningly.”
Gerke, S., Simon, D. A., & Roman, B. R. (2025) · JCO Oncology Practice · doi:10.1200/op-24-01060 · Cited by 16
Li, X., Zeng, L., Lu, X., Chen, K., Yu, M., Wang, B., & Zhao, M. (2023) · Brain Sciences · doi:10.3390/brainsci13071056 · Cited by 12
“The degree of cognitive load experienced during decision-making processes is related to automation bias [43].”
BackgroundAttention Allocation Aid for Visual Search
Deza, A., Peters, J. R., Taylor, G. S., Surana, A., & Eckstein, M. P. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025834 · Cited by 15
“In some cases, the presence of a computer aid is known to guide search with the risk of leading to over-shortened searches and missed targets that are not flagged by the computer aid [30].”
BackgroundImplementation and design of artificial intelligence in abdominal imaging
Choi, H. H., Chang, S. D., & Kohli, M. D. (2020) · Abdominal Radiology · doi:10.1007/s00261-020-02471-0 · Cited by 14
Allen, J. W., Levy, N. L., & Wilkinson, D. J. C. (2025) · Bioethics · doi:10.1111/bioe.70030 · Cited by 14
“This “ automation bias ”— the tendency to give undue weight to computer ‐ generated recommendations — has been well documented in other healthcare contexts and could potentially un-dermine patient autonomy in LLM ‐ mediated consent processes [44].”
Trust, Automation Bias and Aversion: Algorithmic Decision-Making in the Context of Credit Scoring
Gsenger, R., & Strle, T. (2021) · Interdisciplinary Description of Complex Systems · doi:10.7906/indecs.19.4.7 · Cited by 25
“…different contexts, such as to determine loans [16, 22] and insurance premiums [23], to investigate tax evasion [24], to calculate credit scores [25-27], to predict the likelihood of criminal activity [16, 28-30], in policing [31-33], healthcare [34, 35] and within social media platforms [36, 37].”
BackgroundTrust dampening and trust promoting: A dual-pathway of trust calibration in human-robot interaction
HUANG, X., & Li, Y. (2024) · Advances in Psychological Science · doi:10.3724/sp.j.1042.2024.00527 · Cited by 16
Weingram, A., Cui, C., Lin, S., Munoz, S., Jacob, T., Viers, J. H., & Lu, X. (2025) · Frontiers in High Performance Computing · doi:10.3389/fhpcp.2025.1536501 · Cited by 15
Lim, B. Y., Cahaly, J. P., Sng, C. Y. F., & Chew, A. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714058 · Cited by 27
“Automation bias [88]: If the user trusts the model due to its human-like reasoning-aligned, ante-hoc interpretable design, the user may neglect to in-spect future decisions.”
Kong, S. H. (2025) · Endocrinology and Metabolism · doi:10.3803/enm.2025.2518 · Cited by 12
“This phenomenon describes the tendency of human users—especially under time constraints or cognitive load—to over-rely on automated systems, accepting AI-Table generated outputs without adequate critical evaluation [43,44].”
xinlin, J., Wenting, L., Shah, K. A. M., Na, M., & Alam, S. S. (2025) · Journal of Quality Assurance in Hospitality & Tourism · doi:10.1080/1528008x.2025.2528044 · Cited by 17
Trust in Clinical AI: Expanding the Unit of Analysis
Browne, J., Bakker, S., Yu, B., Lloyd, P. A., & Allouch, S. B. (2022) · Frontiers in artificial intelligence and applications · doi:10.3233/faia220192 · Cited by 16
The Evidence for Using Artificial Intelligence to Enhance Prostate Cancer MR Imaging
Canellas, R., Kohli, M. D., & Westphalen, A. C. (2023) · Current Oncology Reports · doi:10.1007/s11912-023-01371-y · Cited by 12
“Two types of errors that typically arise from this phenomenon are (a) over-diagnosis due to the acceptance of false-positive results generated by the automated system, and (b) under-diagnosis due to false-negatives results [62].”
Chhina, A., Trehan, K., Saini, M., Thakur, S., Kaur, M., Shahtaghi, N. R., Shivgotra, R., Soni, B., Modi, A., Bakrey, H., et al. (2023) · Current Pharmaceutical Design · doi:10.2174/1381612829666230807161421 · Cited by 13
Automate, Illuminate, Predict: A Universal Framework for Integrating Wearable Sensors in Healthcare
O’Brien, M. K., Hohl, K., Lieber, R. L., & Jayaraman, A. (2024) · Digital Biomarkers · doi:10.1159/000540492 · Cited by 13
“Developers and users must also consider the potential for automation bias, which occurs when a user becomes overly reliant on decision support [37].”
BackgroundDiagnostic decisions of specialist optometrists exposed to ambiguous deep-learning outputs
Carmichael, J., Costanza, E., BLANDFORD, A. E., Struyven, R., Keane, P. A., & Balaskas, K. (2024) · Scientific Reports · doi:10.1038/s41598-024-55410-0 · Cited by 11
The Amplifying Effect of Explainability in AI-assisted Decision-making in Groups
Duarte, R. D. B., Abreu, M. C., Campos, J., & Paiva, A. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713534 · Cited by 19
“One possible explanation for this effect is the amplification of cognitive biases such as the anchoring bias [7, 43, 61] and automation bias [35] in group dynamics.”
Brigato, P., Vadalà, G., Salvatore, S. D., Oggiano, L., Papalia, G. F., Russo, F., Papalia, R., Costici, P. F., & Denaro, V. (2025) · Brain and Spine · doi:10.1016/j.bas.2025.104273 · Cited by 11
“Indeed, its integration presents challenges such as automation bias, ethical concerns regarding data privacy, algorithm transparency, and biases, which require careful attention (Lyell and Coiera, 2017; Aldosari and Alanazi, 2024).”
Spreadsheet debugging: The perils of tool over-reliance
Mukhtar, A., Hofer, B., Jannach, D., & Wotawa, F. (2021) · Journal of Systems and Software · doi:10.1016/j.jss.2021.111119 · Cited by 15
Improving diagnostic decision support through deliberate reflection: a proposal
Schmidt, H. G., & Mamede, S. (2022) · Diagnosis · doi:10.1515/dx-2022-0062 · Cited by 14
Mathes, S., Seurig, S., Bluhme, F., Beyer, K., Heizmann, F., Wagner, M., Neugärtner, I., Biedermann, T., & Darsow, U. (2025) · The Journal of Allergy and Clinical Immunology In Practice · doi:10.1016/j.jaip.2025.03.030 · Cited by 13
Scott, I. A., Shaw, T. J., Slade, C., Wan, T. T., Barmanray, R., Coorey, C. P., Johnson, S. L., Bell, L. M., Herd, M., & Sullivan, C. M. (2025) · Internal Medicine Journal · doi:10.1111/imj.70112 · Cited by 8
Jackson, N. J., Brown, K. E., Rn, M., Murrow, M., Cauley, M. R., Collins, B. X., Novak, L. L., Benda, N. C., & Ancker, J. S. (2026) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocag002 · Cited by 19
“Because this research area does not use consistent terminology, 15,16,19,20 we developed our search query by manually identifying 20 relevant articles that met our inclusion criteria and then adjusted our query until it identified all 20.”
The effect of medical explanations from large language models on diagnostic accuracy in radiology
Spitzer, P., Hendriks, D., Rudolph, J., Schlaeger, S., Ricke, J., Kühl, N., Hoppe, B. F., & Feuerriegel, S. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02619-0 · Cited by 21
Why health information technology safety problems remain invisible
Jabin, M. S. R. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1785141 · Cited by 16
Right to Contest AI Diagnostics
Ploug, T., & Holm, S. (2022) · Springer eBooks · doi:10.1007/978-3-030-64573-1_267 · Cited by 12
Müller, R., Reindel, D. F., & Stadtfeld, Y. D. (2024) · Human Factors and Ergonomics in Manufacturing & Service Industries · doi:10.1002/hfm.21032 · Cited by 12
“It also is in line with research suggesting that a higher task load, either due to verification complexity, time pressure, or multitasking requirements, reduces cross ‐ checking behavior (Lyell & Coiera, 2017; Manzey et al., 2014; Rieger & Manzey, 2024).”
Machine Learning in Risk Prediction
Sundström, J., & Schön, T. B. (2020) · Hypertension · doi:10.1161/hypertensionaha.120.13516 · Cited by 8
“Fears of black-box solutions and risks of automation bias 10 can perhaps be mitigated by highlighting variable importance 11,12 to increase transparency and by providing CIs around predictions.”
BackgroundUnderstanding with Toy Surrogate Models in Machine Learning
Páez, A. (2024) · Minds and Machines · doi:10.1007/s11023-024-09700-1 · Cited by 16
“Finally, automation bias (Lyell & Coiera, 2017) can lead to an overestimation of the ML system’s performance.”
Ersoy, C. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-0122-8.ch012 · Cited by 7
Zipperling, D., Deck, L., Lanzl, J., & Kühl, N. (2025) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3715275.3732084 · Cited by 14
Kadura, S., Eisner, L., Lopa, S., Poulakis, A., Mesmer, H., Willnow, N., & Pigeon, W. R. (2024) · Applied Clinical Informatics · doi:10.1055/a-2404-2344 · Cited by 7
Cohen, M. C., Kim, N., Ba, Y., Pan, A., Bhatti, S. A., Salehi, P., Sung, J., Blasch, E., Mancenido, M. V., & Chiou, E. K. (2025) · AI Magazine · doi:10.1002/aaai.70000 · Cited by 11
“For example, people tend to trust a DSS’s recommendations despite the presence of external indicators of an error (Lyell & Coiera, 2017; Cummings, 2015).”
Making large language models into reliable physician assistants
Mamede, S., & Schmidt, H. G. (2025) · Nature Medicine · doi:10.1038/s41591-025-03606-w · Cited by 8
Cognitive biases that influence Lean implementation and practices in a multicultural environment
Purushothaman, M. B., Seadon, J., & Moore, D. (2023) · International Journal of Lean Six Sigma · doi:10.1108/ijlss-10-2022-0218 · Cited by 6
Bias in Adjudication and the Promise of AI: Challenges to Procedural Fairness
Lopes, G. (2025) · Law Technology and Humans · doi:10.5204/lthj.3812 · Cited by 21
Artificial intelligence dependency among educators: a scale development and validation study
Uyar, A., Karafil, B., & KARAKUYU, A. (2026) · Education and Information Technologies · doi:10.1007/s10639-025-13862-5 · Cited by 12
“Prior research shows that users interacting with automated sys - tems may reduce their own critical judgment and overlook potential errors, thereby exhibiting automation bias (Lyell & Coiera, 2017).”
Coco, A. (2023) · Journal of International Criminal Justice · doi:10.1093/jicj/mqad034 · Cited by 15
Assessing the impact of medical AI: a survey of physicians’ perceptions
Cabitza, F., Campagner, A., & Cavosi, V. (2021) · International Conference on Medical and Health Informatics (ICMHI) · doi:10.1145/3472813.3473195 · Cited by 9
Cooman, J. D. (2023) · Journal of European Competition Law & Practice · doi:10.1093/jeclap/lpad017 · Cited by 10
Closing the Gap Between Machine Learning and Clinical Cancer Care—First Steps Into a Larger World
Kang, J., Morin, O., & Hong, J. C. (2020) · JAMA Oncology · doi:10.1001/jamaoncol.2020.4314 · Cited by 6
Cabitza, F., Campagner, A., Zotti, F. D., & Sternini, A. R. A. F. (2020) · IADIS International Conference on e-Health (EH) · doi:10.33965/eh2020_202009l020 · Cited by 16
“…et al., 2012), that is over-relying on the machine’s advice believing that it will never (or very seldom) be wrong, “automation complacency” (Lyell and Coiera, 2016), that is when one overestimate their capability to understand when the machine is wrong or it should raise an alarm, and the…”
BackgroundPolicy-makers’ Processing of AI Algorithmic Advice: ‘Automation Bias’ versus Selective Adherence
Alon Barkat, S., & Busuioc, M. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3794660 · Cited by 6
Machine Learning: A Potential Therapeutic Tool to Facilitate Neonatal Therapeutic Decision Making
Tang, B., Li, Q., Liu, H., Zheng, Y., Wu, Y., van den Anker, J. N., Hao, G., & Zhao, W. (2024) · Pediatric Drugs · doi:10.1007/s40272-024-00638-6 · Cited by 7
“Physicians are still the primary decision makers, and over-reliance on ML/ AI in clinical practice may lead to reduced physician skills and less alertness to errors [57–59].”
Bogdanffy, R., Mundzic, A., Nymberg, P., Sundemo, D. S., Moberg, A. B., Wikberg, C., Gunnarsson, R. K., Widén, J., Sundvall, P., & Entezarjou, A. (2026) · JMIR AI · doi:10.2196/72210 · Cited by 8
“Previous research suggests concerns among clinicians regarding the use of AI in health care, such as demographic biases, insufficient regulation, lack of trust in AI systems [18], and automation bias [19].”
Explainability in context: calibrating appropriate trust and reliance in artificial intelligence
Davis, S. E., & Salwei, M. E. (2026) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocag082 · Cited by 10
AI and the ethics of techno-solutionism in pain management
Buchman, D. Z. (2024) · Pain · doi:10.1097/j.pain.0000000000003389 · Cited by 5
Mishra, A., Savulescu, J., & Giubilini, A. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198857815.013.25 · Cited by 6
Considerations in the assessment of machine learning algorithm performance for medical imaging
Gossmann, A., Sahiner, B., Samala, R. K., Wen, S., Cha, K. H., & Petrick, N. (2024) · Elsevier eBooks · doi:10.1016/b978-0-32-385124-4.00029-5 · Cited by 5
Safety in the Digital Age: Sociotechnical Perspectives on Algorithms and Machine Learning
Coze, J.-C. L., & Antonsen, S. (2023) · SpringerBriefs in applied sciences and technology · doi:10.1007/978-3-031-32633-2 · Cited by 9
Næsborg-Andersen, A., Hammerslev, O., & Ullits, J. (2023) · Politica · doi:10.7146/politica.v55i3.140267 · Cited by 11
Enhancing Self-Regulated Learning With Artificial Intelligence-Powered Learning Analytics
Yildirim‐Erbasli, S. N., Gorgun, G., & Bulut, O. (2023) · Advances in early childhood and K-12 education · doi:10.4018/979-8-3693-0066-4.ch004 · Cited by 8
Human Performance in Automated and Autonomous Systems: Current Theory and Methods
(2019) · CRC Press eBooks · doi:10.1201/9780429458330 · Cited by 9
The effect of medical explanations from large language models on diagnostic decisions in radiologyPreprint
Spitzer, P., Hendriks, D., Rudolph, J., Schlaeger, S., Ricke, J., Kühl, N., Hoppe, B. F., & Feuerriegel, S. (2025) · medRxiv · doi:10.1101/2025.03.04.25323357 · Cited by 10
Frei, A. L., Khan, A., Oberson, R., Reinhard, S., Banz, Y., Meeuwsen, F. C., Janowczyk, A. R., Grobholz, R., Dawson, H., Lugli, A., et al. (2025) · Archiv für Pathologische Anatomie und Physiologie und für Klinische Medicin · doi:10.1007/s00428-025-04163-w · Cited by 9
Caffery, L. J., Taylor, M. L., Abbott, L. M., Janda, M., Guitera, P., Mar, V., Arnold, C., Shumack, S. P., Caccetta, T. P., Miller, R. E., et al. (2025) · Australasian Journal of Dermatology · doi:10.1111/ajd.14566 · Cited by 5
“As LLMs and AI Scribes become more entrenched in clinical practice, there is a greater risk of automation bias, which occurs when clinicians become over-reliant on their use and validate the accuracy of the output less often [18].”
Lei, I. I., Gaya, D. R., Robertson, A., Schelde‐Olesen, B., Mapiye, A., Bhandare, A. P., Lui, B. B., Shekhar, C., Valentiner, U., Gilabert, P., et al. (2025) · Cancers · doi:10.3390/cancers17172840 · Cited by 4
Unbiased Artificial Intelligence: Addressing Bias in Computational Pathology
Montezuma, D., Porz, R. C., Ameisen, D., L’Imperio, V., Şerbănescu, M.-S., Temprana‐Salvador, J., Zerbe, N., Khalili, N., & Zlobec, I. (2025) · Mayo Clinic Proceedings Digital Health · doi:10.1016/j.mcpdig.2025.100302 · Cited by 5
“9 In essence, bias in CPath arises from various sources, and understanding these biases is essential for fair and reliable CPath.”
Mondrus, O. V., & SimanTov‐Nachlieli, I. (2025) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2025.100857 · Cited by 6
The future is now: How AI is reshaping spine care
Muehlbauer, E. J., Alvi, M. A., Kennedy, D. J. “. J. ”., & Fehlings, M. G. (2025) · North American Spine Society Journal (NASSJ) · doi:10.1016/j.xnsj.2025.100825 · Cited by 4
Large language models in neuropsychology: Emerging applications and ethical considerations
Kronenberger, O. R., Gottlieb, M. C., & Cullum, C. M. (2025) · The Clinical Neuropsychologist · doi:10.1080/13854046.2025.2604094 · Cited by 5
“Problematically, the tendency to over-rely on automation and agree with machine decisions without critical evaluation, termed automation bias , has been demonstrated in various healthcare tasks (Goddard et al., 2012; Lyell & Coiera, 2017).”
Brundage, D. (2026) · Frontiers in Veterinary Science · doi:10.3389/fvets.2026.1761038 · Cited by 6
“As a result, Human-in-the-Loop review is likely less effective than often assumed, consistent with evidence on automation bias, verification burden and emerging evaluations of ambient scribe failure modes (19, 31, 32).”
Dickinson, H. A., Feifel, J., Muylle, K. M., Ochi, T., & Vallejo‐Yagüe, E. (2024) · Expert Opinion on Drug Safety · doi:10.1080/14740338.2024.2338252 · Cited by 4
“This is a key concern for ‘automation bias’ – whereby the pre-scriber wrongly assumes that the system is aware of every update in the medication regulatory guidance and recommendations, and blindly follows the recommendation [16,17].”
BackgroundAnalysis of noise and bias errors in intelligence information systems
Labib, A., Chakhar, S., Hope, L., Shimell, J., & Malinowski, M. (2022) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24707 · Cited by 9
“Furthermore, a growing research suggest that AI and algorithms should be used in caution as this may lead to algorithmic/automation bias (e.g., Ferguson, 2017; Lyell & Coiera, 2016; Parasuraman & Manzey, 2010; Rai et al., 2019; Sen et al., 2020).”
BackgroundUsing Clinical Simulation to Evaluate AI-Enabled Decision Support
Lyell, D., Lustig, A., Denyer, K., Vedantam, S., & Magrabi, F. (2024) · Studies in health technology and informatics · doi:10.3233/shti230975 · Cited by 5
Self-citationArora, A. (2020) · Future Healthcare Journal · doi:10.7861/fhj.let-7-2-4 · Cited by 4
Furniss, D. J., Habli, I., Sujan, M. A., & Hawkins, R. (2020) · Safety-Critical Systems Symposium (SSS) · doi:10.65391/r1186 · Cited by 13
“…bias have also been found in healthcare, for example in mammography reading, where the introduction of a computer algorithm can decrease the performance of radiologists for certain difficult cases, where the algorithm provided incorrect classification (Alberdi et al., 2004, Lyell and Coiera, 2016).”
MethodWilson, M. P. (2020) · Queensland University of Technology · doi:10.5204/thesis.eprints.199696 · Cited by 17
Artificial intelligence algorithm improves radiologists’ bone age assessment accuracy
Chang, T.-Y., Chou, T. Y., Jen, I.-A., & Yuh, Y. (2025) · Journal of the Chinese Medical Association · doi:10.1097/jcma.0000000000001248 · Cited by 3
“27 To monitor the effect of automation bias in our study, we allowed the radiologists to reject the AI interpretation.”
Metadata
- Authors
- Lyell, D., & Coiera, E.
- Affiliations
- Macquarie University (AU)
- Corresponding author
- Lyell, David
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2016-08-11
- Volume
- 24
- Issue
- 2
- Pages
- 423-431
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC7651899
- OpenAlex
- W2512902140
- Cited by
- 451
- References
- 56
- Citations by year
- 2026: 193 · 2025: 60 · 2024: 55 · 2023: 41 · 2022: 29 · 2021: 27 · 2020: 21 · 2019: 13 · 2018: 7 · 2017: 5
- FWCI
- 1.34
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Journal of the American Medical Informatics Association (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- HCF Research Foundation
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Keywords
- automation bias, decision support system, verification complexity, multitasking, cognitive load, task complexity, over-reliance on automation, sustained attention, diagnostic errors, healthcare decision-making, human factors
- MeSH terms
- Attitude to Computers, Automation, Humans, Bias, Decision Support Systems, Clinical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.