Automation bias and verification complexity: a systematic review
Open accessThe DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Abstract
Introduction: While potentially reducing decision errors, decision support systems can introduce new types of errors. Automation bias (AB) happens when users become overreliant on decision support, which reduces vigilance in information seeking and processing. Most research originates from the human factors literature, where the prevailing view is that AB occurs only in multitasking environments. Objectives: This review seeks to compare the human factors and health care literature, focusing on the apparent association of AB with multitasking and task complexity. Data sources: EMBASE, Medline, Compendex, Inspec, IEEE Xplore, Scopus, Web of Science, PsycINFO, and Business Source Premiere from 1983 to 2015. Study selection: Evaluation studies where task execution was assisted by automation and resulted in errors were included. Participants needed to be able to verify automation correctness and perform the task manually. Methods: Tasks were identified and grouped. Task and automation type and presence of multitasking were noted. Each task was rated for its verification complexity. Results: Of 890 papers identified, 40 met the inclusion criteria; 6 were in health care. Contrary to the prevailing human factors view, AB was found in single tasks, typically involving diagnosis rather than monitoring, and with high verification complexity. Limitations: The literature is fragmented, with large discrepancies in how AB is reported. Few studies reported the statistical significance of AB compared to a control condition. Conclusion: AB appears to be associated with the degree of cognitive load experienced in decision tasks, and appears to not be uniquely associated with multitasking. Strategies to minimize AB might focus on cognitive load reduction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“To the best of our knowledge, existing reviews have focused on AB in relation to traditional computer-based aids rather than AI-driven systems (see Goddard etal. 2012; Lyell and Coiera 2017).”
From Exploring automation bias in human–AI collaboration: a review and implications for explainable AI (2026) · cites this paper as Lyell and Coiera 2017
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Therefore, cognitive overload and trust remain the most crucial factors since, paradoxically, higher automation accuracy can further reinforce user trust, leading to an increased likelihood of AB.”
From Exploring automation bias in human–AI collaboration: a review and implications for explainable AI (2026) · cites this paper as Lyell and Coiera 2017
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“the harder the verification complexity, that is the complexity of verifying that the automation is performing correctly, the greater the likelihood of undue trust in the system (Lyell and Coiera 2017).”
From Exploring automation bias in human–AI collaboration: a review and implications for explainable AI (2026) · cites this paper as Lyell and Coiera 2017
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Cognitive overload is considered the most significant factor inhibiting users from adequately verifying automation accuracy, thereby increasing AB:”
From Exploring automation bias in human–AI collaboration: a review and implications for explainable AI (2026) · cites this paper as Lyell and Coiera 2017
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This finding aligns with Lyell and Coiera's (2017) consideration that accountability alone is an ineffective intervention.”
From Exploring automation bias in human–AI collaboration: a review and implications for explainable AI (2026) · cites this paper as Lyell and Coiera's (2017)
Experimental — accuracy not yet measured
11 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
The Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817
Dermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
Sweller, J., Ayres, P., & Kalyuga, S. (2011) · doi:10.1007/978-1-4419-8126-4 · Cited by 5,531
Sweller, J. (2011) · Psychology of Learning and Motivation · doi:10.1016/b978-0-12-387691-1.00002-8 · Cited by 4,856
Sweller, J. (2012) · Encyclopedia of the Sciences of Learning · doi:10.1007/978-1-4419-1428-6_446 · Cited by 4,405
Garg, A. X., Adhikari, N. K. J., McDonald, H., Rosas-Arellano, M. P., Devereaux, P. J., Beyene, J., Sam, J., & Haynes, R. B. (2005) · JAMA · doi:10.1001/jama.293.10.1223 · Cited by 2,936
Complacency and Bias in Human Use of Automation: An Attentional Integration
Parasuraman, R., & Manzey, D. H. (2010) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720810376055 · Cited by 1,710
Research works printed but not linked: 7
- Mosier, 1996, Human decision makers and automated decision aids: made for each other, 201
- Parasuraman, Performance consequences of automation-induced “complacency.” Int J Aviation Psychol, 1993, 3, 1
- Prinzel, 2005, Individual differences in complacency and monitoring for automation failures, Individual Differences Res, 3, 27
- Singh, 2009, Effects of automation reliability and training on automation-induced complacency and perceived mental workload, J Indian Acad Appl Psychol, 35, 9
- Bagheri, 2004, Considering Subjective Trust and Monitoring Behavior in Assessing Automation-induced “Complacency.”
- Singh, 2010, Performance feedback, mental workload and monitoring efficiency, J Indian Acad Appl Psychol, 36, 151
- Singh, 2001, Effects of manual training and automation reliability on automation induced complacency in flight simulation task, Psychol Stud, 46, 21
Cited by
Items 401–448 of 448
Liu, Y., Han, L., Che, L., Dong, W., Zhang, T., & Guo, H. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1867722 · Cited by 2
“Furthermore, automation bias positively correlates with verification complexity; as the difficulty of independently corroborating an AI output increases, users are more likely to defer to the algorithm (19).”
Diniz, E. M. (2026) · Revista Estima · doi:10.30886/estima.v24.1908_es
Diniz, E. M. (2026) · Revista Estima · doi:10.30886/estima.v24.1908_pt
Diniz, E. M. (2026) · Revista Estima · doi:10.30886/estima.v24.1908_in
Rethinking AI in clinical decision support: a framework for reciprocal human-AI interaction
Greengrass, C. J. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1887161 · Cited by 2
Kearns, A., Moorhead, A., Mulvenna, M. D., & Bond, R. (2026) · European Conference on Cognitive Ergonomics · doi:10.1145/3822301.3822333
Wilson, E., Jong, F. D., & Peters, L. (2026) · Annals of Pharmacy Practice and Pharmacotherapy · doi:10.51847/xt3dqdt8kp
Dóczi, Z., & Kristoffersson, M. (2026) · Computer law & security review · doi:10.1016/j.clsr.2026.106407
Tan, M., Aziz, F., & de Vries, J. (2024) · Annals of Pharmacy Practice and Pharmacotherapy · doi:10.51847/jqaforib1a
Network-based characterization of latent co-testing patterns in antimicrobial susceptibility testing
Hattab, G., Anžel, A., Anyabolu, C., Willrich, N., & Hattab, G. (2026) · iScience · doi:10.1016/j.isci.2026.117421
“25 This is particularly true where lab governance is limited.”
Rethinking Objectivity in Clinical AI: A Qualitative Study of Concussion Evaluators
Zaidi, A. M., Saw, J. J.-W., Fu, L., Arneson, K., Kim, I., Cross, A., & Karahalios, K. G. (2026) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3816992
“Furthermore, this objectivity-focused epistemology can result in systems that appear robust in sanitized experimental contexts, but fail in the real world due to a lack of contextual consideration [77, 89].”
Frey, N., Agha-Mir-Salim, L., Renner, L., Haufe, S., Voge, L., & Balzer, F. (2026) · Research Square · doi:10.21203/rs.3.rs-10892043/v1 · Cited by 2
Digital Skills and Professional Judgment in AI-Driven Financial Decision-Making
Amdouni, A. (2026) · IGI Global eBooks · doi:10.4018/979-8-3373-8536-5.ch006
When patients bring AI into the consultation: implications for clinical leadership
Mohsin, M. (2026) · BMJ Leader · doi:10.1136/leader-2026-001687
Artificial Intelligence in Emergency Medical Call-Taking and Dispatch Operations: A Scoping Review
Lee, D. H., Kim, M. J., & Chang, H. (2026) · Healthcare · doi:10.3390/healthcare14193176
“Adequate dispatcher training and safeguards against automation bias are therefore needed to support safe use without promoting excessive reliance on AI recommendations [44,45].”
Badawy, W., & Shaban, M. (2026) · Applied Nursing Research · doi:10.1016/j.apnr.2026.152147
Lysdahlgaard, S., Jensen, J., Pedersen, M. R. V., & Kusk, M. W. (2026) · Radiography · doi:10.1016/j.radi.2026.103577
Zhu, Z., & Li, Y. (2026) · Telematics and Informatics · doi:10.1016/j.tele.2026.102464 · Cited by 1
Klepacz, J., Swędrak, R., & Dobrakowska, Z. (2026) · International Journal of Innovative Technologies in Social Science · doi:10.31435/ijitss.3(51).2026.6625
Cognitive Effects of Using LLMs for Process Modeling: An EEG Study
Wessling, N., Corea, C., L’Orange, E., Yamani, M. H., & Delfmann, P. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37777-7_46
Evenstad, S. B. N. (2026) · IFIP advances in information and communication technology · doi:10.1007/978-3-032-38610-6_9
Clinical Trust in Dermatology AI Requires More Than Benchmark Accuracy
Ding, D. D. (2026) · Dermatology Practical & Conceptual · doi:10.5826/dpc.160s1a7586
Sethi, S., & Singh, S. (2026) · ACM Transactions on Social Computing · doi:10.1145/3849483
“Educators stand at the nexus of this tension. and clinical decision support [31].”
Munz, L. P. M., Müller, A., Kania, C. J., Fellerhoff, T., & Richert, A. (2026) · Companion Publication of the International Conference on Multimodal Interaction (ICMI Companion) · doi:10.1145/3776591.3836731 · Cited by 1
“Patient-facing concerns include un-derstandable health information [8], support for self-management skills [36], safety and quality of care [25], responsible AI governance [59], and mitigation of automation bias [18, 38].”
Myinga, G. G., & Kajirunga, A. (2026) · International Journal Of Engineering And Computer Science · doi:10.18535/ijecs.v15i10.5737
Lee, J., Kim, S., Lee, H., & Hwang, J. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2740422
Atiku, S. O. (2026) · PLOS Digital Health · doi:10.1371/journal.pdig.0001776 · Cited by 1
“Lyell and Coiera show that automation bias can reduce vigilance in clinical decision support, and Coiera argues that automation often shifts cognitive work rather than removing it [42,43].”
Jeon, J., Sivakumar, K., Athaide, G. A., & Raj, S. P. (2026) · Technovation · doi:10.1016/j.technovation.2026.103735
Shen, S., Cui, X., Yuan, Z., Li, L., Xiaotong, S., Wang, Y., He, G., Zheng, X., & Gou, X. (2026) · Journal of Medical Internet Research · doi:10.2196/97475
Choudhury, A., Shahsavar, Y., & Gürses, A. P. (2026) · JMIR Human Factors · doi:10.2196/97649 · Cited by 1
“This distinction is especially important in clinical decision support, where automation bias can occur when clinicians overrely on CDSS recommendations and reduce independent information seeking or verification [25].”
Cognitive Ergonomics in Robotics
Rosen, P. H., Heinold, E., Barresi, G., & Wischniewski, S. (2026) · Springer tracts in advanced robotics · doi:10.1007/978-3-032-19374-2_3
Human Oversight Is Not Enough: Rethinking Accountability in AI-Assisted Clinical Decision-Making
Ren, Y. (2026) · Health Nexus Digital Health and Medical AI · doi:10.63802/hndh.v1.i1.362
Wang, H., Xu, Z., Huang, Z., Pan, H., & Zheng, G. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1931423
“…trajectories, and quantifiable outcomes may reinforce local search and path dependence, thereby reducing employees’ engagement with unknown disease mechanisms, unconventional knowledge combinations, and entirely new research directions (Levinthal and March, 1993; Lyell and Coiera, 2017).”
Zipperling, D., Deck, L., Lanzl, J., & Kühl, N. (2026) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3858913
Thornton, J., & Henderson, J. (2026) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocag152
Omigbodun, F. T. (2026) · Journal of Medicine Surgery and Public Health · doi:10.1016/j.glmedi.2026.100258
Altan, S. (2026) · Özgür Yayınları eBooks · doi:10.58830/ozgur.pub1539.c6225
Liu, X., Gu, Z., & Lulu, S. (2026) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2026.1934192
Antonio, F., Ridwan, M. M., & Odelia, J. (2026) · doi:10.2196/preprints.114668
Disagreement between AI and Radiologists: Quantifying Direction and FragilityPreprint
Kaddouri, B. E., Gevenois, P. A., & Bankier, A. A. (2026) · medRxiv · doi:10.64898/2026.10.19.26364791
Angioni, D., Tirotta, D., Bello, F. D., & Montagnani, A. (2026) · Italian Journal of Medicine · doi:10.4081/itjm.2026.2648
From clinician review to measurable human oversight of AI-drafted paediatric discharge documentsPreprint
Morquin, D., Bochu, G., Robert, L., Loi, Z., Buhnila, I., Ferreira, R., Jeziorski, É., Messaoui, L., Piarroux, R., & Yauy, K. (2026) · medRxiv · doi:10.64898/2026.10.20.26365977
Djanggih, H. (2026) · Research Square · doi:10.21203/rs.3.rs-11460998/v1
Lins, L., & Canabarro, A. (2026) · Aquila · doi:10.61565/revista-aquila.i35.1066
Runde, A. P., Fahey, J. L., Pelit, W. S., Ortiz, C. E., Koo, S. M., Jordan, S., Chrulski, K. E., Kleberg, J. A., Buckner, H. D., Brown, N. M., et al. (2026) · Life · doi:10.3390/life16111785
Atiku, S. O., Olakotan, O. O., Agbaje, K., Owolanke, K., & Pillay, T. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1986499
Fluent and wrong: seven failure patterns in extended AI use
Ramos, H. (2026) · AI and Ethics · doi:10.1007/s43681-026-01478-5
“People judge fluent material as more likely to be true [ 19], and people check a tool’s output less once they establish trust [ 7, 8].”
Harerimana, A., & Mchunu, G. G. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1969777
Metadata
- Authors
- Lyell, D., & Coiera, E.
- Affiliations
- Macquarie University (AU)
- Corresponding author
- Lyell, David
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2016-08-11
- Volume
- 24
- Issue
- 2
- Pages
- 423-431
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC7651899
- OpenAlex
- W2512902140
- Cited by
- 451
- References
- 56
- Citations by year
- 2026: 193 · 2025: 60 · 2024: 55 · 2023: 41 · 2022: 29 · 2021: 27 · 2020: 21 · 2019: 13 · 2018: 7 · 2017: 5
- FWCI
- 1.34
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Journal of the American Medical Informatics Association (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- HCF Research Foundation
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Keywords
- automation bias, decision support system, verification complexity, multitasking, cognitive load, task complexity, over-reliance on automation, sustained attention, diagnostic errors, healthcare decision-making, human factors
- MeSH terms
- Attitude to Computers, Automation, Humans, Bias, Decision Support Systems, Clinical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.