Automation bias and verification complexity: a systematic review
Open accessThe DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Abstract
Introduction: While potentially reducing decision errors, decision support systems can introduce new types of errors. Automation bias (AB) happens when users become overreliant on decision support, which reduces vigilance in information seeking and processing. Most research originates from the human factors literature, where the prevailing view is that AB occurs only in multitasking environments. Objectives: This review seeks to compare the human factors and health care literature, focusing on the apparent association of AB with multitasking and task complexity. Data sources: EMBASE, Medline, Compendex, Inspec, IEEE Xplore, Scopus, Web of Science, PsycINFO, and Business Source Premiere from 1983 to 2015. Study selection: Evaluation studies where task execution was assisted by automation and resulted in errors were included. Participants needed to be able to verify automation correctness and perform the task manually. Methods: Tasks were identified and grouped. Task and automation type and presence of multitasking were noted. Each task was rated for its verification complexity. Results: Of 890 papers identified, 40 met the inclusion criteria; 6 were in health care. Contrary to the prevailing human factors view, AB was found in single tasks, typically involving diagnosis rather than monitoring, and with high verification complexity. Limitations: The literature is fragmented, with large discrepancies in how AB is reported. Few studies reported the statistical significance of AB compared to a control condition. Conclusion: AB appears to be associated with the degree of cognitive load experienced in decision tasks, and appears to not be uniquely associated with multitasking. Strategies to minimize AB might focus on cognitive load reduction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“To the best of our knowledge, existing reviews have focused on AB in relation to traditional computer-based aids rather than AI-driven systems (see Goddard etal. 2012; Lyell and Coiera 2017).”
From Exploring automation bias in human–AI collaboration: a review and implications for explainable AI (2026) · cites this paper as Lyell and Coiera 2017
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Therefore, cognitive overload and trust remain the most crucial factors since, paradoxically, higher automation accuracy can further reinforce user trust, leading to an increased likelihood of AB.”
From Exploring automation bias in human–AI collaboration: a review and implications for explainable AI (2026) · cites this paper as Lyell and Coiera 2017
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“the harder the verification complexity, that is the complexity of verifying that the automation is performing correctly, the greater the likelihood of undue trust in the system (Lyell and Coiera 2017).”
From Exploring automation bias in human–AI collaboration: a review and implications for explainable AI (2026) · cites this paper as Lyell and Coiera 2017
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Cognitive overload is considered the most significant factor inhibiting users from adequately verifying automation accuracy, thereby increasing AB:”
From Exploring automation bias in human–AI collaboration: a review and implications for explainable AI (2026) · cites this paper as Lyell and Coiera 2017
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This finding aligns with Lyell and Coiera's (2017) consideration that accountability alone is an ineffective intervention.”
From Exploring automation bias in human–AI collaboration: a review and implications for explainable AI (2026) · cites this paper as Lyell and Coiera's (2017)
Experimental — accuracy not yet measured
11 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
The Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817
Dermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
Sweller, J., Ayres, P., & Kalyuga, S. (2011) · doi:10.1007/978-1-4419-8126-4 · Cited by 5,531
Sweller, J. (2011) · Psychology of Learning and Motivation · doi:10.1016/b978-0-12-387691-1.00002-8 · Cited by 4,856
Sweller, J. (2012) · Encyclopedia of the Sciences of Learning · doi:10.1007/978-1-4419-1428-6_446 · Cited by 4,405
Garg, A. X., Adhikari, N. K. J., McDonald, H., Rosas-Arellano, M. P., Devereaux, P. J., Beyene, J., Sam, J., & Haynes, R. B. (2005) · JAMA · doi:10.1001/jama.293.10.1223 · Cited by 2,936
Complacency and Bias in Human Use of Automation: An Attentional Integration
Parasuraman, R., & Manzey, D. H. (2010) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720810376055 · Cited by 1,710
Research works printed but not linked: 7
- Mosier, 1996, Human decision makers and automated decision aids: made for each other, 201
- Parasuraman, Performance consequences of automation-induced “complacency.” Int J Aviation Psychol, 1993, 3, 1
- Prinzel, 2005, Individual differences in complacency and monitoring for automation failures, Individual Differences Res, 3, 27
- Singh, 2009, Effects of automation reliability and training on automation-induced complacency and perceived mental workload, J Indian Acad Appl Psychol, 35, 9
- Bagheri, 2004, Considering Subjective Trust and Monitoring Behavior in Assessing Automation-induced “Complacency.”
- Singh, 2010, Performance feedback, mental workload and monitoring efficiency, J Indian Acad Appl Psychol, 36, 151
- Singh, 2001, Effects of manual training and automation reliability on automation induced complacency in flight simulation task, Psychol Stud, 46, 21
Cited by
Items 201–300 of 448
The coalescent architecture of agency: normative directionality as the key to human–AI integration
Torres–Martínez, S. (2026) · AI & Society · doi:10.1007/s00146-026-02979-x · Cited by 4
“Recent systematic reviews confirm that automation bias manifests in two distinct error types: errors of commission (following incorrect automated advice) and errors of omission (failing to notice problems when automated systems do not flag them) (Goddard et al. 2012; Lyell and Coiera 2017).”
Elsayed, N. (2026) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2026.106419 · Cited by 5
Yu, X., He, L., Qin, J., & Liu, T. (2026) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2026.103942 · Cited by 3
What is Wrong With Automation Bias?
Jovchevski, P., Buijsman, S., & Neerincx, M. A. (2026) · Philosophy & Technology · doi:10.1007/s13347-026-01090-9 · Cited by 10
Zhang, H., & Jiang, R. (2026) · Education and Information Technologies · doi:10.1007/s10639-026-14026-9 · Cited by 6
“Either situation may lead to higher ECL and more limited GCL (Lyell & Coiera, 2017; Sweller et al., 2019 ).”
Liu, Y., & Liu, Y. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1859317 · Cited by 9
“…checking and more direct acceptance of outputs; this pattern has been discussed in studies of automation bias, complacency, AI trust, and security automation (Gerlich, 2024; Lyell and Coiera, 2017; Merritt et al., 2019; Parasuraman et al., 1993; Skitka et al., 1999; Tilbury and Flowerday, 2024).”
Iong, M. T. (2026) · Bioethics · doi:10.1111/bioe.70137 · Cited by 4
“Over time, routine reliance on AI may lead to a process of de‐skilling of physicians' practice, as they may lose the practice of some skills in diagnosis or decision‐ making [21, 22].”
The future of medicine or a threat? Artificial intelligence representation in Chicago Med
Nádasi, E., & Héder, M. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-03810-y · Cited by 4
“Lyell and Coiera (2017, 423) de fi ne automation bias (AB) as “ users become overreliant on decision-support, which reduces vigilance in information seeking and processing.”
Lyell, D., Dinh, M. M. Q., Gillett, M., Abraham, N., Symes, E. R., Susanto, A. P., Chakar, B., Seimon, R. V., Coiera, E. W., & Magrabi, F. (2025) · Emergency Medicine Journal · doi:10.1136/emermed-2024-214781 · Cited by 6
“The risk of incorrect decision support biasing doctors and potentially leading to misdiagnoses, a phenomenon known as automation bias, has long been of concern 24 25 and has been observed in computer-aided interpretation of electrocardiograms 26 and screening mammograms.”
Self-citationTrying times: domestication of healthcare technologies amidst challenging dynamic contexts
Fox, S. (2019) · Social Theory & Health · doi:10.1057/s41285-019-00107-y · Cited by 4
Meyer, J., Dembinsky, O., & Raviv, T. (2020) · Computers & Security · doi:10.1016/j.cose.2020.101944 · Cited by 7
Sloss, E. A., & Jones, T. (2021) · CIN Computers Informatics Nursing · doi:10.1097/cin.0000000000000724 · Cited by 5
“More recently, the concept of automation bias has been discussed in the clinical informatics literature.(36) Automation”
BackgroundArtificial Intelligence and Sentencing from a Human Rights Perspective
Kaspar, J., Harrendorf, S., Butz, F., Höffler, K., Sommerer, L. M., & Christoph, S. (2023) · Critical criminological perspectives · doi:10.1007/978-3-031-19149-7_1 · Cited by 9
Kara, M. A. (2024) · Medicine Health Care and Philosophy · doi:10.1007/s11019-024-10241-8 · Cited by 5
Trusted Partners: Human-Machine Teaming and the Future of Military AI
Konaev, M., Huang, T. C., & Chahal, H. (2021) · doi:10.51593/20200024 · Cited by 8
The Challenge Dataset – simple evaluation for safe, transparent healthcare AI deploymentPreprint
Sanayei, J. K., Abdalla, M., Ahluwalia, M., Seyyed-Kalantari, L., Minotti, S. C., & Fine, B. (2022) · medRxiv · doi:10.1101/2022.12.15.22280619 · Cited by 4
“[37 ,38] For instance, radiologists reading mammography with the assistance of an error-prone computerized detection system were more likely to miss concerning findings than radiologists using no detection system.”
MethodWho Is Really Deciding? AI and Clinical Judgement in Dentistry
Farooqi, O. A. (2026) · International Dental Journal · doi:10.1016/j.identj.2026.109476 · Cited by 3
Human-Centered AI (Also) for Humanistic Management
Facchini, A., & Mangili, F. (2024) · Humanism in business series · doi:10.1007/978-3-031-67155-5_11 · Cited by 5
AI-Based Automation for Medication Reconciliation: Scoping Review
Bortesi, J. P. T., Becerra, M. P., Ranisau, J., Wen, B., Nadesan, P., Devereaux, P. J., McGillion, M. H., & Petch, J. (2026) · Journal of Medical Internet Research · doi:10.2196/86760 · Cited by 3
An Empirical Examination of the Evaluative AI Framework
Kornowicz, J. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2581260 · Cited by 3
“This suggests cognitive offloading (Risko and Gilbert, 2016) may have occurred, along with a potential automation bias (Lyell and Coiera, 2017).”
Bureaucratic accountability: enabler or barrier for algorithm use?
Weerheijm, B., Galdames, M., & Giest, S. N. (2025) · Policy Design and Practice · doi:10.1080/25741292.2025.2578064 · Cited by 7
Generative AI Use and Its Impact on Nurses' Decision-Making: A Systematic Review
Kwon, M., & Kim, S. G. (2026) · Journal of Korean Academy of Nursing Administration · doi:10.11111/jkana.2025.0078 · Cited by 6
Brain fry: Navigating the cognitive burden of artificial intelligence implementation in healthcare
Hopkins, A. M., Menz, B. D., Bacchi, S., & Rowland, A. (2026) · The American Journal of Medicine · doi:10.1016/j.amjmed.2026.04.038 · Cited by 3
Clinical agents fail silently on patient identity
Klang, E., Glicksberg, B. S., Gorenshtein, A., Gavin, N., Freeman, R., Stump, L. S., Charney, A. W., Ting, D. S. W., Omar, M., & Nadkarni, G. N. (2026) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2026.106514 · Cited by 10
Gibson, B. N., Chodapuneedi, S., Koh, H. Y., Gupta, S., Gašević, D., Wang, A. Y., Marzolini, C., Khoo, S., Romero, L., Dalli, L. L., et al. (2026) · British Journal of Pharmacology · doi:10.1111/bph.70515 · Cited by 3
Du, P., Tingting, L., & Xian, X. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1889402 · Cited by 3
Divergent impacts of explainable AI for dermatological diagnosis on clinicians versus lay people
Xu, X., Hu, H., Zhang, H., Wang, W. K., Wang, R., Soenksen, L. R., Badri, O., Jafry, S., Burger, E., Nwandu, L., et al. (2026) · Nature Medicine · doi:10.1038/s41591-026-04553-w · Cited by 10
“Our work extends previous research on nonexpert overreliance and automation bias on AI 40–42 and finds greater risk of LLM-based explanations, which has been supported in recent human−LLM trust work outside healthcare 43 .”
Cho, A.-Y., Eo, S., Jeon, M., Kim, J., Ihm, J., & Seo, D. (2026) · JMIR Medical Education · doi:10.2196/91809 · Cited by 2
“This perspective aligns with automation-bias literature emphasizing verification and guardrails [47] and with the findings by Hattie and Timperley [48] that high-quality feedback is an important influence on achievement, suggesting that multimodal LLMs may be most beneficial when integrated into…”
Artificial Intelligence in Nephrology
da Silva, A. Q. B., Almeida, J., & Kirsztajn, G. M. (2022) · Springer eBooks · doi:10.1007/978-3-031-11570-7_15 · Cited by 2
Clinical Neuroinnovation: Ethical Frameworks and Emerging Issues
Kasun, M., Dunn, L. B., Palmer, B. W., Kim, J. P., & Roberts, L. W. (2023) · Springer eBooks · doi:10.1007/978-3-031-14339-7_3 · Cited by 2
Walking the line: Mindfulness with IT in hospital medication routines
Lichtner, V., Karanasios, S., & Iannacci, F. (2023) · Information and Organization · doi:10.1016/j.infoandorg.2023.100475 · Cited by 4
Looking at the Safety of AI from a Systems Perspective: Two Healthcare Examples
Sujan, M. A. (2023) · SpringerBriefs in applied sciences and technology · doi:10.1007/978-3-031-32633-2_8 · Cited by 6
Shukla, S., & Shukla, S. K. (2023) · Financial Markets Institutions and Risks · doi:10.61093/fmir.7(3).1-11.2023 · Cited by 8
Transforming Otoscopy Using Artificial Intelligence
Salmasian, H., & Biggs, L. L. (2024) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/jamapediatrics.2024.0021 · Cited by 2
Algorithmic Exploitation of Consumers
Mik, E. (2024) · Cambridge University Press eBooks · doi:10.1017/9781009483599.019 · Cited by 2
Governing Technology: A MacIntyrean Approach to the Ethics of Artificial Intelligence
Ruiz, P. G. (2024) · Ethical economy · doi:10.1007/978-3-031-78888-8_9 · Cited by 2
CJEM debate: clinical decision rules–thinking beyond the algorithm
Morgenstern, J., Radecki, R. P., Westafer, L. M., Niforatos, J. D., & Atkinson, P. (2025) · Canadian Journal of Emergency Medicine · doi:10.1007/s43678-025-00870-0 · Cited by 2
Human Judgment and Responsibility after Artificial Intelligence Recommendations
Zhao, Y., Chen, L., Fauzi, A., & Hayati, N. (2024) · Journal of Applied Organizational Systems and Behavior · doi:10.51847/5ubpujo0hh · Cited by 2
Machine Learning and Artificial Intelligence in Evidence Generation and Evidence Synthesis
Malik, V. S., & Singh, M. (2024) · Journal of Medical Evidence · doi:10.4103/jme.jme_95_23 · Cited by 4
A Warning about Warning Signals for Interpreting Mammograms
Hofvind, S. S. H., & Lee, C. I. (2021) · Radiology · doi:10.1148/radiol.2021212092 · Cited by 2
Prével, A., Salatino, A., & Bue, S. L. (2023) · Preprints.org · doi:10.20944/preprints202203.0070.v2 · Cited by 1
Clinical Agents Don’t CarePreprint
Klang, E., Glicksberg, B. S., Gorenshtein, A., Gavin, N. P., Freeman, R., Stump, L. S., Charney, A. W., Ting, D. S. W., Omar, M., & Nadkarni, G. N. (2025) · medRxiv · doi:10.1101/2025.10.17.25338226 · Cited by 2
“This indicates that the central risk is not overt miscoding but silent acceptance of inconsistent records, where agents continue writing codes despite mismatched identity fields. users may over-trust confident outputs even when identity fields conflict (18,19).”
Prediction model for the selection of patients with glioma to proton therapy
Kallehauge, J. F., Grondahl, S., Byskov, C. S., Høyer, M., & Lukacova, S. (2025) · Acta Oncologica · doi:10.2340/1651-226x.2025.43883 · Cited by 1
“However, implementing prediction models in healthcare requires both understanding of the limitations and awareness of i.a. automation bias [17, 18].”
Lindell, O. P., Henriksson, M., Karlsson, L., Nilsson, S., Charitakis, E., & Janzon, M. (2025) · European Heart Journal - Digital Health · doi:10.1093/ehjdh/ztaf087 · Cited by 2
“These risks include disruption of workflow, alert fatigue, and so-called automation bias, where physicians become over dependent on the CDS. 16,19 Evidence regarding health economic aspects of CDS systems in general is limited, although some studies have concluded that CDS interventions are…”
Rizal, P. (2025) · Annals of Innovation in Medicine · doi:10.59652/hrnhkr35 · Cited by 1
“(13) • Dataset shift and performance decay.”
Developing Critical Judgment of Artificial Intelligence in Medical Education: Applied Insights
Heslin, S. M. (2026) · MedEdPublish · doi:10.12688/mep.21479.1 · Cited by 2
Mathais, Q., Cungi, P., Lamblin, A., Dubourg, O., Bordes, J., & Boussen, S. (2026) · The Journal of Trauma: Injury, Infection, and Critical Care · doi:10.1097/ta.0000000000004973 · Cited by 3
“58 This risk is particularly salient for junior or isolated medics operating under hierarchical or time pressure, where algorithmic outputs may be perceived as author-itative rather than advisory.”
Knauer, R., Kalmring, M., & Rodner, E. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1789412 · Cited by 1
Engineering framework for curiosity-driven and humble AI in clinical decision support
Arslan, J., Benke, K. K., Cajas, S. A., Castro, R., Celi, L. A., Cruz-Suarez, G. A., Reyes, R. D., Engelmann, J., Ercole, A., Hilel, A., et al. (2026) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2025-101877 · Cited by 2
Could ChatGPT and co. replace forensic experts? A comparative study on medical liability expertise
Bérar, A., Allain, J., & Bouvet, R. (2026) · International Journal of Legal Medicine · doi:10.1007/s00414-026-03777-2 · Cited by 1
Li, Y., Yuan, M., Yang, Y., Fu, J., Yi, X., Duan, C. J., & Wang, J. (2026) · Scientific Reports · doi:10.1038/s41598-026-46652-1 · Cited by 2
Aqtam, I. F., Shouli, M. M., & Alkorom, S. M. M. (2026) · Journal of Nursing Management · doi:10.1155/jonm/2678581 · Cited by 1
Avramović, N., Markovic, A. P., Comic, T., Čavoški, S., Zornić, N., & Vujović, V. (2026) · Applied Sciences · doi:10.3390/app16104825 · Cited by 1
Lee, H., Seo, S., Park, S., Tam, L., Kim, S., & Jang, Y. (2026) · Public Relations Review · doi:10.1016/j.pubrev.2026.102709 · Cited by 1
When is AI democratic? Artificial intelligence and democratic empowerment
Nasi, F. (2026) · AI & Society · doi:10.1007/s00146-026-03097-4 · Cited by 2
“Consider automation bias, the presumed objectivity and efficiency of automated systems, which leads to humans’ over-reliance on their outputs (Lyell and Coiera 2017).”
Jeong, M.-A., & Kim, S.-D. (2026) · Applied Sciences · doi:10.3390/app16105146 · Cited by 5
Karaçay, P., Yaşar, Ö., Göktaş, P., & Küçükkaya, A. (2026) · BMC Nursing · doi:10.1186/s12912-026-04832-4 · Cited by 1
“Relatedly, these findings may also be understood through the lens of automation bias, namely the tendency to over-rely on automated outputs and to question or cross-check them insufficiently [63].”
Yang, Y., Liu, J., & Liu, S. (2026) · Journal of Medical Internet Research · doi:10.2196/96152 · Cited by 3
“As AI outputs become more numerous, complex, and time-sensitive, however, the conditions for meaningful oversight may erode, as earlier work on alert fatigue in clinical decision support suggests [13,14,38].”
Xu, S. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1849190 · Cited by 1
More than Automation: AI as a Shaper of Employee Mindsets and Capabilities
Rana, R., & Bhambri, P. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-5816-1.ch008 · Cited by 1
Desolda, G., Deufemia, V., Spano, L. D., Buono, P., Cau, F. M., Cimino, G., Mocci, M., & Tucci, C. (2026) · Behaviour and Information Technology · doi:10.1080/0144929x.2026.2714170 · Cited by 1
“…as the tendency to treat automated cues or recommendations as substitutes for vigilant information seeking, verification, and independent judgment (Lyell and Coiera 2017; Mosier et al. 1996; All computational metrics are reported as normalised percentages because the generated emails varied in…”
Fosset, M., Pensier, J., Jung, B., Siddiqi, A., Mamdani, M. M., & Celi, L. A. (2026) · PLOS Digital Health · doi:10.1371/journal.pdig.0001621 · Cited by 2
AI scribe functions in psychiatric practice: clinical oversight, consent, and regulation
Roth, A. S., & Ayers, N. B. (2026) · The Lancet Psychiatry · doi:10.1016/s2215-0366(26)00201-4 · Cited by 1
Liu, B. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1896492 · Cited by 1
“…or institutionally rigid closure makes later alternatives costly: premature diagnostic closure contributes to diagnostic error, and automation bias and verification complexity reduce vigilance (27–30); the same pressure appears in validation claims, workflow defaults, and planned update pathways.”
Wang, Y., Yang, X., Wang, T., Wang, T., Wang, Y., & Zhu, X. (2026) · Journal of Robotic Surgery · doi:10.1007/s11701-026-04095-w · Cited by 1
“…requirements are not obstacles to innovation; they are the mechanisms by which a sys - tem earns and retains trust, alongside explicit attention to explainability [ 111 ], automation bias and verification [112 ], and the normative and epistemic criteria that justified trust must satisfy [ 113 ].”
Gadala, M., Strigini, L., & Ayton, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.13544 · Cited by 2
“We hope this work will encourage other researchers in the area of automation bias to recognize adjustable thresholds as a potential solution to some automated-mediated errors, especially since reviews in this area (even recent ones) (Goddard et al., 2011; Lyell & Coiera, 2016) do not mention it.”
BackgroundRight to Contest AI Diagnostics
Ploug, T., & Holm, S. (2021) · Springer eBooks · doi:10.1007/978-3-030-58080-3_267-1 · Cited by 5
Heinrich, D. G. I., McAndrew, I. R., & Pretty, J. (2021) · International Journal of Managing Information Technology · doi:10.5121/ijmit.2021.13303 · Cited by 1
“Lyell and Coiera [38]found that task complexity and difficulty play a significant role in automation bias due to the level of difficulty present when monitoring and interpreting automated aids in the healthcare field.”
BackgroundFunke, G. J., Tolston, M. T., Miller, B. T., Bowers, M. A., & Capiola, A. (2021) · Communications in computer and information science · doi:10.1007/978-3-030-90176-9_34 · Cited by 1
Risque médicojuridique et sinistralité en radiologie : actualités
Blum, A., & Douis, N. (2023) · Journal d imagerie diagnostique et interventionnelle · doi:10.1016/j.jidi.2023.06.002 · Cited by 2
DiMatteo, L. A., Poncibò, C., & Howells, G. G. (2024) · Cambridge University Press eBooks · doi:10.1017/9781009483599.017 · Cited by 1
Prével, A., & Bue, S. L. (2022) · Preprints.org · doi:10.20944/preprints202203.0070.v1
Liu, G. N.-Y., Triantis, K. P., Madsen, P. M., & Roets, B. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4672957 · Cited by 1
Explainable AI as a Double-Edged Sword in Dermatology: The Impact on Clinicians versus The PublicPreprint
Xu, X., Hu, H., Zhang, H., Wang, W. K., Wang, R., Soenksen, L. R., Badri, O., Jafry, S., Burger, E., Nwandu, L., et al. (2025) · medRxiv · doi:10.64898/2025.12.19.25342205 · Cited by 1
Naye, F., Ouellet, S., Yousefi, F., Cachinho, C., Bergeron, F., Bhattacharyya, O. K., Stamenova, V., & Sasseville, M. (2026) · doi:10.2196/preprints.96882 · Cited by 1
Machine learning models in anaesthesiology: bridging the gap from model training to implementation
King, C. R., & Fritz, B. A. (2026) · British Journal of Anaesthesia · doi:10.1016/j.bja.2026.03.022 · Cited by 1
Tajima, H. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6632719 · Cited by 1
Widmer, J. F., Silva, L. C., Grahofer, A., Zanolari, P., Unger, L., Lutz, B., Schüpbach, G., & Nathues, H. (2026) · doi:10.2196/preprints.102422 · Cited by 1
Taylor, E. (2026) · Ethics & Human Research · doi:10.1002/eahr.70024
Pe, S., Bergomi, L., Nicora, G., Simonelli, C. A., Kour, P., Diaz, E., Alendal, G., Hernáiz Ferrer, A. I., Corso, V., Bortolotto, C., et al. (2026) · Machine Learning and Knowledge Extraction · doi:10.3390/make8070216
“Although algorithmic aversion is commonly regarded as one of the primary barriers to the effective adoption of AI technologies, often framed as a major source of negative technology impact [17], an equally important yet frequently overlooked challenge is automation bias [18].”
Limits of Interventions in AI-Assisted Decision Making
Shrestha, S., Ahn, E., & Vorobeychik, Y. (2026) · Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1609/aies.v9i4.43309
Deep learning and the sociology of human-level artificial intelligence
Baum, S. D. (2020) · Metascience · doi:10.1007/s11016-020-00510-6
Gurley, A. L., Tanch, J., Portelli, D. C., Priebe, C. J., Berube, J. A., Dieffenbach, A., Harris, R., Jalal, M., Sayles, S., Smulling, A. J., et al. (2020) · IEEE International IOT, Electronics and Mechatronics Conference (IEMTRONICS) · doi:10.1109/iemtronics51293.2020.9216436
“This widespread adoption of HIT and CIS has demonstrably introduced new complexities into patient care at the bedside [3-17].”
BackgroundSonenberg, L. (2023) · Logic Journal of IGPL · doi:10.1093/jigpal/jzad006
The Use of Artificial Intelligence in the Management of Intracranial Aneurysms
Marín-Castañeda, L. A., de Leon-Mendoza, F., & Ruvalcaba, H. V. (2023) · IntechOpen eBooks · doi:10.5772/intechopen.110772
ПРОГРАМУВАННЯ ЗА ДОПОМОГОЮ СИСТЕМ ГЕНЕРАТИВНОГО ШТУЧНОГО ІНТЕЛЕКТУ: РИЗИКИ ТА ВИКЛИКИ
БОЙКО, В., Василенко, М. Д., & Слатвінська, В. М. (2023) · INFORMATION TECHNOLOGY AND SOCIETY · doi:10.32689/maup.it.2023.2.2 · Cited by 2
Rubeis, G. (2024) · The International library of ethics, law and technology · doi:10.1007/978-3-031-55744-6_5
Cabitza, F., & Campagner, A. (2024) · Wiley eBooks · doi:10.1002/9781119846567.ch14
Uluslararası Güvenlikte Devlet Dışı Dalga: Sivil Toplum ve Otonom Silah Sistemleri
Bayram, Y. (2024) · Bilgi Sosyal Bilimler Dergisi · doi:10.54838/bilgisosyal.1417715
Lima, D. D. S. (2024) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/t.47.2024.tde-13062024-113449 · Cited by 1
How Ensembling AI and Public Managers Improves Decision-MakingPreprint
Keppeler, F., Borchert, J., Pedersen, M. J., & Nielsen, V. L. (2024) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/2yf6r · Cited by 1
Comprehensive Review of the Current State-of-the-Art in AI-Driven Colorectal Cancer Screening
Zoghbi, M. E., & Gross, S. A. (2024) · AI in Precision Oncology · doi:10.1089/aipo.2024.0019
“72 The increased reliance on AI decision support can also lead to the risk of de-skilling physicians.”
Guth, S. (2024) · The American Journal of Bioethics · doi:10.1080/15265161.2024.2377141
“One review cited by Salloch & Eriksen found that automation bias, the tendency for clinicians to substitute their own judgments with the recommendations from AI systems, was related to verification complexity (Lyell and Coiera 2016).”
Künstliche Intelligenz in der Nephrologie
da Silva, A. Q. B., Almeida, J., & Kirsztajn, G. M. (2024) · Springer eBooks · doi:10.1007/978-3-031-65236-3_15
Designing Human-Automation Redundancy: Overreliance, Automation Shirking, and the Operator’s Dilemma
Cohen, D., Roth, Y., Rieskamp, J., & Schöbel, M. (2025) · doi:10.2139/ssrn.5098488
Krause, T. A. (2025) · dms – der moderne staat – Zeitschrift für Public Policy Recht und Management · doi:10.3224/dms.vxix.403989
Herter, W. E., Khuc, J., Bonten, T. N., Verheij, R. A., Numans, M. E., & Chavannes, N. H. (2025) · doi:10.2196/preprints.80527
Factors Influencing the Effectiveness of AI-Assisted Decision-Making in Medicine: A Scoping ReviewPreprint
Jackson, N. J., Brown, K. E., Miller, R., Murrow, M., Cauley, M. R., Collins, B. X., Novak, L. L., Benda, N. C., & Ancker, J. S. (2025) · medRxiv · doi:10.1101/2025.09.02.25334863
“Because this research area does not use consistent terminology 15,16,23,24 , we developed our search query by manually identifying 20 relevant articles that met our inclusion criteria and then adjusted our query until it identified all 20.”
Metadata
- Authors
- Lyell, D., & Coiera, E.
- Affiliations
- Macquarie University (AU)
- Corresponding author
- Lyell, David
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2016-08-11
- Volume
- 24
- Issue
- 2
- Pages
- 423-431
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC7651899
- OpenAlex
- W2512902140
- Cited by
- 451
- References
- 56
- Citations by year
- 2026: 193 · 2025: 60 · 2024: 55 · 2023: 41 · 2022: 29 · 2021: 27 · 2020: 21 · 2019: 13 · 2018: 7 · 2017: 5
- FWCI
- 1.34
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Journal of the American Medical Informatics Association (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- HCF Research Foundation
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Keywords
- automation bias, decision support system, verification complexity, multitasking, cognitive load, task complexity, over-reliance on automation, sustained attention, diagnostic errors, healthcare decision-making, human factors
- MeSH terms
- Attitude to Computers, Automation, Humans, Bias, Decision Support Systems, Clinical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.