The DOI matches its Crossref record; 55 of the 56 references it cites were found in a registry or an index.
Automation bias and verification complexity: a systematic review
Open accessAbstract
Introduction: While potentially reducing decision errors, decision support systems can introduce new types of errors. Automation bias (AB) happens when users become overreliant on decision support, which reduces vigilance in information seeking and processing. Most research originates from the human factors literature, where the prevailing view is that AB occurs only in multitasking environments. Objectives: This review seeks to compare the human factors and health care literature, focusing on the apparent association of AB with multitasking and task complexity. Data sources: EMBASE, Medline, Compendex, Inspec, IEEE Xplore, Scopus, Web of Science, PsycINFO, and Business Source Premiere from 1983 to 2015. Study selection: Evaluation studies where task execution was assisted by automation and resulted in errors were included. Participants needed to be able to verify automation correctness and perform the task manually. Methods: Tasks were identified and grouped. Task and automation type and presence of multitasking were noted. Each task was rated for its verification complexity. Results: Of 890 papers identified, 40 met the inclusion criteria; 6 were in health care. Contrary to the prevailing human factors view, AB was found in single tasks, typically involving diagnosis rather than monitoring, and with high verification complexity. Limitations: The literature is fragmented, with large discrepancies in how AB is reported. Few studies reported the statistical significance of AB compared to a control condition. Conclusion: AB appears to be associated with the degree of cognitive load experienced in decision tasks, and appears to not be uniquely associated with multitasking. Strategies to minimize AB might focus on cognitive load reduction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“To the best of our knowledge, existing reviews have focused on AB in relation to traditional computer-based aids rather than AI-driven systems (see Goddard etal. 2012; Lyell and Coiera 2017).”
From Exploring automation bias in human–AI collaboration: a review and implications for explainable AI (2026) · cites this paper as Lyell and Coiera 2017
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Therefore, cognitive overload and trust remain the most crucial factors since, paradoxically, higher automation accuracy can further reinforce user trust, leading to an increased likelihood of AB.”
From Exploring automation bias in human–AI collaboration: a review and implications for explainable AI (2026) · cites this paper as Lyell and Coiera 2017
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“the harder the verification complexity, that is the complexity of verifying that the automation is performing correctly, the greater the likelihood of undue trust in the system (Lyell and Coiera 2017).”
From Exploring automation bias in human–AI collaboration: a review and implications for explainable AI (2026) · cites this paper as Lyell and Coiera 2017
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Cognitive overload is considered the most significant factor inhibiting users from adequately verifying automation accuracy, thereby increasing AB:”
From Exploring automation bias in human–AI collaboration: a review and implications for explainable AI (2026) · cites this paper as Lyell and Coiera 2017
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This finding aligns with Lyell and Coiera's (2017) consideration that accountability alone is an ineffective intervention.”
From Exploring automation bias in human–AI collaboration: a review and implications for explainable AI (2026) · cites this paper as Lyell and Coiera's (2017)
Experimental — accuracy not yet measured
11 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
The Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817
Dermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
Sweller, J., Ayres, P., & Kalyuga, S. (2011) · doi:10.1007/978-1-4419-8126-4 · Cited by 5,531
Sweller, J. (2012) · Encyclopedia of the Sciences of Learning · doi:10.1007/978-1-4419-1428-6_446 · Cited by 4,405
Garg, A. X., Adhikari, N. K. J., McDonald, H., Rosas-Arellano, M. P., Devereaux, P. J., Beyene, J., Sam, J., & Haynes, R. B. (2005) · JAMA · doi:10.1001/jama.293.10.1223 · Cited by 2,936
Complacency and Bias in Human Use of Automation: An Attentional Integration
Parasuraman, R., & Manzey, D. H. (2010) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720810376055 · Cited by 1,710
Automation bias: a systematic review of frequency, effect mediators, and mitigators
Goddard, K., Roudsari, A., & Wyatt, J. C. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000089 · Cited by 1,162
Research works printed but not linked: 7
- Mosier, 1996, Human decision makers and automated decision aids: made for each other, 201
- Parasuraman, Performance consequences of automation-induced “complacency.” Int J Aviation Psychol, 1993, 3, 1
- Prinzel, 2005, Individual differences in complacency and monitoring for automation failures, Individual Differences Res, 3, 27
- Singh, 2009, Effects of automation reliability and training on automation-induced complacency and perceived mental workload, J Indian Acad Appl Psychol, 35, 9
- Bagheri, 2004, Considering Subjective Trust and Monitoring Behavior in Assessing Automation-induced “Complacency.”
- Singh, 2010, Performance feedback, mental workload and monitoring efficiency, J Indian Acad Appl Psychol, 36, 151
- Singh, 2001, Effects of manual training and automation reliability on automation induced complacency in flight simulation task, Psychol Stud, 46, 21
Cited by
Rajkomar, A., Dean, J., & Kohane, I. (2019) · New England Journal of Medicine · doi:10.1056/nejmra1814259 · Cited by 4,579
The false hope of current approaches to explainable artificial intelligence in health care
Ghassemi, M., Oakden-Rayner, L., & Beam, A. L. (2021) · The Lancet Digital Health · doi:10.1016/s2589-7500(21)00208-9 · Cited by 1,724
Ensuring fairness in machine learning to advance health equity.
Rajkomar, A., Hardt, M., Howell, M. D., Corrado, G., & Chin, M. H. (2018) · Annals of Internal Medicine · doi:10.7326/m18-1990 · Cited by 1,341
“African American patients might be harmed if clinical teams started relying on alerts to identify at-risk patients without realizing that the prediction system underdetects patients in that group (automation bias) (16).”
BackgroundEvaluation and mitigation of the limitations of large language models in clinical decision-making
Hager, P., Jungmann, F., Holland, R., Bhagat, K., Hubrecht, I., Knauer, M., Vielhauer, J., Makowski, M., Braren, R., Kaissis, G., et al. (2024) · Nature Medicine · doi:10.1038/s41591-024-03097-1 · Cited by 798
“Importantly, studies as to the impact of automation bias 53,54 and human– AI interaction biases could also be explored in such a context 55–57 .”
Accountable Artificial Intelligence: Holding Algorithms to Account
Busuioc, M. (2021) · Public Administration Review · doi:10.1111/puar.13293 · Cited by 652
“…algorithmic outputs could conceivably lead to unjustified deference of the decision-maker to algorithm predictions: “Automation bias” (Cummings 2006; Lyell and Coiera 2017; Skitka, Mosier, and Burdick 1999) is a well-documented phenomenon reported in psychological studies manifest in human…”
BackgroundEthical Considerations of Using ChatGPT in Health Care
Wang, C., Liu, S., Yang, H., Guo, J., Wu, Y., & Liu, J. (2023) · Journal of Medical Internet Research · doi:10.2196/48009 · Cited by 541
“Physicians, on the other hand, need to recognize and mitigate the potential “automation bias” that can result from overreliance on algorithms [60,61].”
Alon-Barkat, S., & Busuioc, M. (2023) · Journal of Public Administration Research and Theory · doi:10.1093/jopart/muac007 · Cited by 469
“…words, the potential of digital tools to “influence or replace human judgment” in public service provision (Busch and Hendriksen 2018, 4) and to alter the very nature of public managers’ work (Kim, Andersen, and Lee 2021) and bureaucratic structures and routines (Meijer, Lorenz, and Wessels 2021).”
BackgroundArtificial intelligence and the implementation challenge
Shaw, J., Rudzicz, F., Jamieson, T., & Goldfarb, A. (2019) · Journal of Medical Internet Research · doi:10.2196/13659 · Cited by 389
“The implementation of decision support systems in health care that do not include applications of ML have been well studied and the difficulties include perceived challenges to autonomy, lack of time, and dissatisfaction with user interfaces [27,28].”
BackgroundLiu, X., Glocker, B., McCradden, M. M., Ghassemi, M., Denniston, A. K., & Oakden-Rayner, L. (2022) · The Lancet Digital Health · doi:10.1016/s2589-7500(22)00003-6 · Cited by 266
Ross, S. I., Martinez, F., Houde, S., Muller, M., & Weisz, J. D. (2023) · Proceedings of the 28th International Conference on Intelligent User Interfaces · doi:10.1145/3581641.3584037 · Cited by 258
Exploring automation bias in human–AI collaboration: a review and implications for explainable AI
Romeo, G., & Conti, D. (2026) · AI & SOCIETY · doi:10.1007/s00146-025-02422-7 · Cited by 209
“Lyell and Coiera (2017) further emphasized that task complexity and verification demands contribute to cognitive overload, increasing susceptibility to AB.”
InfluentialCurrent challenges in health information technology–related patient safety
Sittig, D. F., Wright, A., Coiera, E., Magrabi, F., Ratwani, R., Bates, D. W., & Singh, H. (2020) · Health Informatics Journal · doi:10.1177/1460458218814893 · Cited by 171
“44 How does the computer know when it is appropriate to interrupt a human?”
BackgroundSelf-citationZheng, W. Y., Richardson, L. C., Li, L., Day, R. O., Westbrook, J. I., & Baysari, M. T. (2018) · European Journal of Clinical Pharmacology · doi:10.1007/s00228-017-2357-5 · Cited by 171
Greenes, R. A., Bates, D. W., Kawamoto, K., Middleton, B., Osheroff, J., & Shahar, Y. (2018) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.12.005 · Cited by 167
Wysocki, O., Davies, J. K., Vigo, M., Armstrong, A. C., Landers, D., Lee, R., & Freitas, A. (2023) · Artificial Intelligence · doi:10.1016/j.artint.2022.103839 · Cited by 161
Selten, F., Robeer, M., & Grimmelikhuijsen, S. (2023) · Public Administration Review · doi:10.1111/puar.13602 · Cited by 153
The four dimensions of contestable AI diagnostics - A patient-centric approach to explainable AI
Ploug, T., & Holm, S. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2020.101901 · Cited by 205
Human Factors Challenges for the Safe Use of Artificial Intelligence in Patient Care
Sujan, M., Furniss, D., Grundy, K., Grundy, H., Nelson, D., Elliott, M., White, S., Habli, I., & Reynolds, N. (2019) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2019-100081 · Cited by 144
Clinician checklist for assessing suitability of machine learning applications in healthcare
Scott, I. A., Carter, S. M., & Coiera, E. W. (2021) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2020-100251 · Cited by 155
“58 Automation bias may see clinicians become deskilled over time by over-reliance on algorithms, 59 leading to misdiagnoses and inappropriate therapeutics.”
BackgroundSelf-citationAbdelwanis, M., Alarafati, H. K., Tammam, M. M. S., & Simsekler, M. C. E. (2024) · Journal of Safety Science and Resilience · doi:10.1016/j.jnlssr.2024.06.001 · Cited by 177
Flores, A. M., Demsas, F., Leeper, N. J., & Ross, E. (2021) · Circulation Research · doi:10.1161/circresaha.121.318224 · Cited by 149
AI in structural health monitoring for infrastructure maintenance and safety
Plevris, V., & Papazafeiropoulos, G. (2024) · Infrastructures · doi:10.3390/infrastructures9120225 · Cited by 132
Artificial intelligence sepsis prediction algorithm learns to say “I don’t know”
Shashikumar, S. P., Wardi, G., Malhotra, A., & Nemati, S. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00504-6 · Cited by 147
The Rise of Artificial Intelligence in Educational Measurement: Opportunities and Ethical Challenges
Bulut, O., & Beiting-Parrish, M. (2024) · Chinese/English Journal of Educational Measurement and Evaluation · doi:10.59863/miql7785 · Cited by 291
“However, this adoption of automation introduces its own possible errors (Lyell & Coiera, 2017; Jones-Jang & Park, 2023).”
Atasever, S., Azgınoğlu, N., Terzi, D. S., & Terzi, R. (2022) · Clinical Imaging · doi:10.1016/j.clinimag.2022.11.003 · Cited by 147
Coiera, E., Kocaballi, B., Halamka, J., & Laranjo, L. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0066-9 · Cited by 132
Self-citationRams, hounds and white boxes: investigating human–AI collaboration protocols in medical diagnosis
Cabitza, F., Campagner, A., Ronzio, L., Cameli, M., Mandoli, G. E., Pastore, M. C., Sconfienza, L. M., Folgado, D., Barandas, M., & Gamboa, H. (2023) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2023.102506 · Cited by 117
Research Trends in Artificial Intelligence Applications in Human Factors Health Care: Mapping Review
Asan, O., & Choudhury, A. (2021) · JMIR Human Factors · doi:10.2196/28236 · Cited by 114
“A review of automation bias focusing on the health care literature noted that the complexity of any assignment and the workload increased the likelihood of excessive reliance on automation [106], which can be detrimental to patient safety.”
BackgroundBridging the “last mile” gap between AI implementation and operation: “data awareness” that matters
Cabitza, F., Campagner, A., & Balsano, C. (2020) · Annals of Translational Medicine · doi:10.21037/atm.2020.03.63 · Cited by 113
“This can be because the interface is inadequate, because the good advice comes late or among several—often too many—false alarms (5), or because the decision-maker cannot take advantage of the technological support due to the emergence of either automation bias (6) or automation complacency (7).”
BackgroundAutomation bias in electronic prescribing
Lyell, D., Magrabi, F., Raban, M. Z., Pont, L. G., Baysari, M. T., Day, R. O., & Coiera, E. (2017) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-017-0425-5 · Cited by 103
“However AB has been reported in some, but not all, tasks in a single task environment [14].”
BackgroundSelf-citationKim, T., & Song, H. (2021) · Telematics and Informatics · doi:10.1016/j.tele.2021.101595 · Cited by 101
The fate of medicine in the time of AI
Coiera, E. W. (2018) · The Lancet · doi:10.1016/s0140-6736(18)31925-1 · Cited by 99
Self-citationLyell, D., Coiera, E., Chen, J., Shah, P., & Magrabi, F. (2021) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2020-100301 · Cited by 95
Self-citationOakden‐Rayner, L., Gale, W., Bonham, T. A., Lungren, M. P., Carneiro, G., Bradley, A. P., & Palmer, L. J. (2022) · The Lancet Digital Health · doi:10.1016/s2589-7500(22)00004-8 · Cited by 101
Automated detection of pulmonary embolism from CT-angiograms using deep learning
Huhtanen, H., Nyman, M. J., Mohsen, T., Virkki, A., Karlsson, A., & Hirvonen, J. (2022) · BMC Medical Imaging · doi:10.1186/s12880-022-00763-z · Cited by 88
“FPs can cause frustration to radiologists, but they can also increase the risk for false diagnoses due to automation bias—the tendency for humans to favor machine-made decision [18, 19].”
BackgroundBarriers and pitfalls for artificial intelligence in gastroenterology: Ethical and regulatory issues
Ahmad, O. F., Stoyanov, D., & Lovat, L. B. (2020) · Techniques and Innovations in Gastrointestinal Endoscopy · doi:10.1016/j.tgie.2019.150636 · Cited by 78
“Furthermore, algorithmic errors could be compounded by the phenomenon of automation bias, where clinicians may favour AI decisions even if they are incorrect [10].”
BackgroundExploratory hypothesis tests can be more compelling than confirmatory hypothesis tests
Rubin, M., & Donkin, C. (2022) · Philosophical Psychology · doi:10.1080/09515089.2022.2113771 · Cited by 99
“In particular, an automation bias (Lyell & Coiera, 2017) and plan continuation bias (Winter et al., 2020) may lead researchers to make decision-making errors because they stick to their preregistered plan when a different approach is more appropriate.”
Saboury, B., Bradshaw, T., Boellaard, R., Buvat, I., Dutta, J., Hatt, M., Jha, A. K., Li, Q., Liu, C., McMeekin, H., et al. (2022) · Journal of Nuclear Medicine · doi:10.2967/jnumed.121.263703 · Cited by 82
“There must be checks to avoid automation bias, which is the propensity of humans to value and overly rely on observations and analyses from computers over those of human beings ( 71 ).”
BackgroundPedro, A. R., Dias, M. B., Laranjo, L., Cunha, A. S., & Cordeiro, J. V. (2023) · PLOS ONE · doi:10.1371/journal.pone.0290613 · Cited by 74
Not all biases are bad: equitable and inequitable biases in machine learning and radiology
Pot, M., Kieusseyan, N., & Prainsack, B. (2021) · Insights into Imaging · doi:10.1186/s13244-020-00955-7 · Cited by 94
Choudhury, A., Asan, O., & Medow, J. E. (2022) · Applied Ergonomics · doi:10.1016/j.apergo.2022.103708 · Cited by 86
Deep Automation Bias: How to Tackle a Wicked Problem of AI?
Strauß, S. (2021) · Big Data and Cognitive Computing · doi:10.3390/bdcc5020018 · Cited by 94
Promises of Big Data and Artificial Intelligence in Nephrology and Transplantation
Thongprayoon, C., Kaewput, W., Kovvuru, K. R., Hansrivijit, P., Kanduri, S. R., Bathini, T. J., Chewcharat, A., Leeaphorn, N., Suarez, M. L. G., & Cheungpasitporn, W. (2020) · Journal of Clinical Medicine · doi:10.3390/jcm9041107 · Cited by 72
“Despite having numerous imperfections, big data, as well as artificial intelligence have been applied in the field of medication from numerous parts [115,116].”
BackgroundThe effects of explanations on automation bias
Vered, M., Livni, T., Howe, P. D. L., Miller, T., & Sonenberg, L. (2023) · Artificial Intelligence · doi:10.1016/j.artint.2023.103952 · Cited by 111
The impact of AI errors in a human-in-the-loop process
Agudo, U., Liberal, K. G., Arrese, M., & Matute, H. (2024) · Cognitive Research: Principles and Implications · doi:10.1186/s41235-023-00529-3 · Cited by 66
Patient Consent and The Right to Notice and Explanation of AI Systems Used in Health Care
Hurley, M. E., Lang, B. H., Kostick, K. M., Smith, J. N., & Blumenthal‐Barby, J. (2024) · The American Journal of Bioethics · doi:10.1080/15265161.2024.2399828 · Cited by 83
“On the opposite side of this spectrum of trust, there is also evidence pointing to explanations increasing people’s confidence in an algorithmic decision to an unreason-able extent, exacerbating automation bias and over-trust of AI systems (Eiband et al. 2019; Lyell and Coiera 2017).”
Horowitz, M. C., & Kahn, L. (2024) · International Studies Quarterly · doi:10.1093/isq/sqae020 · Cited by 68
A Systematic Review of Interaction in Search-Based Software Engineering
Ramírez, A., Romero, J. R., & Simons, C. L. (2018) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2803055 · Cited by 73
“According to Lyell and Coiera [15], “automation bias (AB) happens when users become overreliant on decision support, which reduces vigilance in information seeking and processing”.”
BackgroundAutomation bias in public administration – an interdisciplinary perspective from law and psychology
Ruschemeier, H., & Hondrich, L. J. (2024) · Government Information Quarterly · doi:10.1016/j.giq.2024.101953 · Cited by 59
Felmingham, C. M., Adler, N. R., Ge, Z., Morton, R. L., Janda, M., & Mar, V. J. (2021) · American Journal of Clinical Dermatology · doi:10.1007/s40257-020-00574-4 · Cited by 57
The effect of cognitive load and task complexity on automation bias in electronic prescribing
Lyell, D., Magrabi, F., & Coiera, E. (2018) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720818781224 · Cited by 67
Self-citationHow cognitive psychology changed the face of medical education research
Schmidt, H. G., & Mamede, S. (2020) · Advances in Health Sciences Education · doi:10.1007/s10459-020-10011-0 · Cited by 71
Challenges of AI Adoption in the UAE Healthcare
Badi, F. K. A., Hosani, K. A. A., Jabeen, F., Stachowicz-Stanusch, A., Shehzad, N., & Amann, W. (2021) · Vision The Journal of Business Perspective · doi:10.1177/0972262920988398 · Cited by 66
“Also, automation bias happens when people blindly rely on machines and consider them faultless (Lyell & Coiera, 2017).”
BackgroundBashkirova, A., & Krpan, D. (2024) · Computers in Human Behavior: Artificial Humans · doi:10.1016/j.chbah.2024.100066 · Cited by 55
Facial recognition systems in policing and racial disparities in arrests
Johnson, T. L., Johnson, N. N., McCurdy, D., & Olajide, M. S. (2022) · Government Information Quarterly · doi:10.1016/j.giq.2022.101753 · Cited by 76
Large language models for science and medicine
Telenti, A., Auli, M., Hie, B., Maher, C., Saria, S., & Ioannidis, J. P. A. (2024) · European Journal of Clinical Investigation · doi:10.1111/eci.14183 · Cited by 72
“Even if LLMs eventually do not prove powerful (e.g. have poor performance or applicability), they can still lead to overconfidence (human automation bias) 64 in policy circles that may over-trust them, ushering in a new generation of spurious ‘science-based’ expertise.”
BackgroundWang, D.-Y., Ding, J., Sun, A.-L., Liu, S.-G., Jiang, D., Li, N., & Yu, J.-K. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad118 · Cited by 54
Rezazade Mehrizi, M. H., Mol, F., Peter, M., Ranschaert, E., Dos Santos, D. P., Shahidi, R., Fatehi, M., & Dratsch, T. (2023) · Scientific Reports · doi:10.1038/s41598-023-36435-3 · Cited by 54
“Where over-reliance and under-reliance pose antithetical examples of inappropriate reliance 23 , the paradox of their occurrence has been one of the still unsolved dilemmas 24 .”
BackgroundAI-augmented multidisciplinary teams: hype or hope?
Di Ieva, A. (2019) · The Lancet · doi:10.1016/s0140-6736(19)32626-1 · Cited by 52
Tragic Choices and the Virtue of Techno-Responsibility Gaps
Danaher, J. (2022) · Philosophy & Technology · doi:10.1007/s13347-022-00519-1 · Cited by 74
“…from industrial psychology and human–machine interactions that suggest that people tend towards ‘automation bias’, i.e. deference to the ‘choices’ and recommendations of machines in order to save themselves the cognitive effort (Goddard et al. 2012; Lyell and Coiera 2016; Mosier et al. 1998).”
BackgroundSalloch, S., & Eriksen, A. (2024) · The American Journal of Bioethics · doi:10.1080/15265161.2024.2353800 · Cited by 69
“But such issues are receiving more attention, for example with suggestions that interfaces should support independent verification by providing relevant data side-by-side with decision support (Lyell & Coiera, 2017, p. 430).”
Cabitza, F., Campagner, A., Angius, R., Natali, C., & Reverberi, C. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581095 · Cited by 51
“included complacency” in [63], or, more specifcally, as “the propen-”
BackgroundMethodInfluentialCoiera, E. W., & Liu, S. (2022) · Cell Reports Medicine · doi:10.1016/j.xcrm.2022.100860 · Cited by 63
“High among these risks is automation bias, when clinicians unquestioningly accept machine advice, instead of maintaining vigilance or validating that advice.(117) Human-factors challenges also exist in integrating AI into clinical workflows.”
BackgroundSelf-citationAn extension of the theory of technology dominance: Capturing the underlying causal complexity
Sutton, S. G., Arnold, V., & Holt, M. (2023) · International Journal of Accounting Information Systems · doi:10.1016/j.accinf.2023.100626 · Cited by 59
Kim, T., & Song, H. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2049134 · Cited by 58
“On the other hand, people tend to overtrust AI when the task is too complicated or opaque, such as in the healthcare context (Lyell & Coiera, 2017).”
BackgroundArtificial Intelligence in Emergency Medicine: Benefits, Risks, and Recommendations
Vearrier, L., Derse, A. R., Basford, J. B., Larkin, G. L., & Moskop, J. C. (2022) · The Journal of Emergency Medicine · doi:10.1016/j.jemermed.2022.01.001 · Cited by 49
“The phenomenon of erroneous acceptance of an incorrect automatic interpretation is known as automation bias, which occurs when an overreliance on streamlined clinical processes leads to complacency and reduced vig-ilance in information seeking and processing ( 42 ).”
BackgroundArtificial intelligence and labour market matching
Broecke, S. (2023) · OECD social employment and migration working papers · doi:10.1787/2b440821-en · Cited by 95
Automation to optimise physician treatment of individual patients: examples in psychiatry
Bauer, M., Monteith, S., Geddes, J., Gitlin, M. J., Grof, P., Whybrow, P. C., & Glenn, T. (2019) · The Lancet Psychiatry · doi:10.1016/s2215-0366(19)30041-0 · Cited by 44
Xie, G., Chen, T., Li, Y., Chen, T., Li, X., & Liu, Z. (2019) · Kidney Diseases · doi:10.1159/000504600 · Cited by 47
“Even though machine-learning and deep-learning models always achieve high performance in retrospective studies, these models do not guarantee wide applicability in different scenarios and may be subject to automation bias [27].”
BackgroundCabitza, F., Campagner, A., & Sconfienza, L. M. (2021) · Health Information Science and Systems · doi:10.1007/s13755-021-00138-8 · Cited by 61
Autopilots in the Operating Room: Safe Use of Automated Medical Technology
Ruskin, K. J., Corvin, C., Rice, S. C., & Winter, S. R. (2020) · Anesthesiology · doi:10.1097/aln.0000000000003385 · Cited by 38
“Device manufacturers and personnel responsible for designing electronic health record user interfaces can decrease the risk by presenting verification information with the clinical recommendation.(86)”
BackgroundO’Brien, M. K., Botonis, O. K., Larkin, E., Carpenter, J., Martin-Harris, B., Maronati, R., Lee, K., Cherney, L. R., Hutchison, B., Xu, S., et al. (2021) · Digital Biomarkers · doi:10.1159/000517144 · Cited by 37
“There may be concerns about overreliance on imperfect automated tools, especially for tasks requiring a high cognitive load [33], or failed uptake stemming from a fundamental mistrust of any imperfections.”
BackgroundThe Price of Artificial Intelligence
Coiera, E. W. (2019) · Yearbook of Medical Informatics · doi:10.1055/s-0039-1677892 · Cited by 44
“The Price of Artificial Intelligence [5].”
Self-citationCary, M. P., Bessias, S., McCall, J., Pencina, M. J., Grady, S. D., Lytle, K. S., & Economou-Zavlanos, N. (2024) · Journal of Nursing Scholarship · doi:10.1111/jnu.13007 · Cited by 50
“Overreliance on AI presents limitations (Lyell & Coiera, 2017 ) that nurses are often the first to witness.”
Pan, D., Nilsson, E., & Rahman Jabin, M. S. (2024) · Health Informatics Journal · doi:10.1177/14604582241270742 · Cited by 32
Automation bias in AI-assisted detection of cerebral aneurysms on time-of-flight MR angiography
Kim, S. H., Schramm, S., Riedel, E. O., Schmitzer, L., Rosenkranz, E., Kertels, O., Bodden, J. H., Paprottka, K. J., Sepp, D., Renz, M., et al. (2025) · La radiologia medica · doi:10.1007/s11547-025-01964-6 · Cited by 44
“In contrast, moderately experienced readers showed a smaller decline in unremarkable ratings (conventional: 60.0% [18/30], AI: 46.7% [14/30]), and no change was seen in very experienced readers (conventional: 63.3% [19/30], AI: 63.3% [19/30]).”
InfluentialConsidering the Safety and Quality of Artificial Intelligence in Health Care
Ross, P. A., & Spates, K. (2020) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/j.jcjq.2020.08.002 · Cited by 45
Alwalid, O., Long, X., Xie, M., & Han, P. (2021) · Academic Radiology · doi:10.1016/j.acra.2021.06.013 · Cited by 34
Role of Artificial Intelligence in Global Surgery: A Review of Opportunities and Challenges
Malhotra, K., Wong, B. N. X., Lee, S. O., Franco, H., Singh, C. M., Silva, L. A. C., Iraqi, H. A., Sinha, A., Burger, S., Breedt, D. S., et al. (2023) · Cureus · doi:10.7759/cureus.43192 · Cited by 39
“In addition, metrics do not always represent applicability [54].”
BackgroundFraile Navarro, D., Kocaballi, A. B., Dras, M., & Berkovsky, S. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3569893 · Cited by 28
“Previous work has described this type of error as automation bias [75].”
BackgroundEthics of artificial intelligence in embryo assessment: mapping the terrain
Koplin, J. J., Johnston, M., Webb, A. N. S., Whittaker, A. M., & Mills, C. (2024) · Human Reproduction · doi:10.1093/humrep/deae264 · Cited by 32
Postoperative ward monitoring – Why and what now?
Khanna, A. K., Ahuja, S., Weller, R. S., & Harwood, T. N. (2019) · Best practice & research. Clinical anaesthesiology · doi:10.1016/j.bpa.2019.06.005 · Cited by 34
Li, J., Zhou, L., Zhan, Y., Xu, H., Zhang, C., Shan, F., & Liu, L. (2022) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocac179 · Cited by 29
Human-artificial intelligence interaction in gastrointestinal endoscopy
Campion, J. R., O’Connor, D. B., & Lahiff, C. J. (2024) · World Journal of Gastrointestinal Endoscopy · doi:10.4253/wjge.v16.i3.126 · Cited by 35
Shaping Our Algorithms Before They Shape Us
Rowe, M. (2019) · Perspectives on rethinking and reforming education · doi:10.1007/978-981-13-8161-4_9 · Cited by 27
The effects of generative AI’s human-like competencies on clinical decision-making
Spatscheck, N., Schaschek, M., & Winkelmann, A. (2024) · Journal of Decision System · doi:10.1080/12460125.2024.2430731 · Cited by 35
Savardi, M., Signoroni, A., Benini, S., Vaccher, F., Alberti, M., Ciolli, P., Di Meo, N., Falcone, T., Ramanzin, M., Romano, B., et al. (2025) · Insights into Imaging · doi:10.1186/s13244-024-01893-4 · Cited by 30
“Computer says no”: Algorithmic decision support and organisational responsibility
Adensamer, A., Gsenger, R., & Klausner, L. D. (2021) · Journal of Responsible Technology · doi:10.1016/j.jrt.2021.100014 · Cited by 41
Automation in Contemporary Clinical Information Systems: a Survey of AI in Healthcare Settings
Magrabi, F., Lyell, D., & Coiera, E. W. (2023) · Yearbook of Medical Informatics · doi:10.1055/s-0043-1768733 · Cited by 30
“Immediate effects on users include the workload placed on clinicians to review and confirm AI output including the potential for errors [80, 81].”
BackgroundSelf-citationArtificial intelligence in clinical workflow processes in vascular surgery and beyond
Dossabhoy, S. S., Ho, V. T., Ross, E., Rodríguez, F., & Arya, S. (2023) · Seminars in Vascular Surgery · doi:10.1053/j.semvascsurg.2023.07.002 · Cited by 25
Evaluation and Regulation of Artificial Intelligence Medical Devices for Clinical Decision Support
Weissman, G. E. (2025) · Annual Review of Biomedical Data Science · doi:10.1146/annurev-biodatasci-103123-095824 · Cited by 37
Reflections on Automation Complacency
Liu, P. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2265240 · Cited by 29
“Review studies (Goddard et al., 2012; Lyell & Coiera, 2017) have concluded that these interventions have mixed or little impact in lab settings.”
Dickinson, H. A., Teltsch, D. Y., Feifel, J., Hunt, P., Vallejo‐Yagüe, E., Virkud, A., Muylle, K. M., Ochi, T., Donneyong, M. M., Zabinski, J. W., et al. (2023) · Drug Safety · doi:10.1007/s40264-023-01376-3 · Cited by 24
“This interaction between a recommendation tool and prescriber behaviour is the subject of ongoing research [24] and is also explicitly mentioned as a concern in the FDA’s guidance around CDSS [20].”
Human-Controllable AI: Meaningful Human Control
Liu, C., & Xu, W. (2025) · Springer eBooks · doi:10.1007/978-981-97-8440-0_58-1 · Cited by 26
Arnold, M. G. (2018) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2018.01.070 · Cited by 27
Pütten, A. M. R.-V. D., & Sach, A. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1416504 · Cited by 35
Tang, J. S. N., Lai, J. K. C., Bui, J., Wang, W., Simkin, P. M., Gai, D., Chan, J., Pascoe, D. M., Heinze, S., Gaillard, F., et al. (2023) · Radiology Artificial Intelligence · doi:10.1148/ryai.220079 · Cited by 21
Human–machine collaboration for enhanced decision-making in governance
Rooy, D. V. (2024) · Data & Policy · doi:10.1017/dap.2024.72 · Cited by 23
“Post-decision analysis and critical questioning prompts can be employed to encourage reflective thinking (Goddard et al., 2012; Lyell and Coiera, 2017).”
van Voorst, R. (2024) · Mayo Clinic Proceedings Digital Health · doi:10.1016/j.mcpdig.2024.08.004 · Cited by 25
Li, Y., Yi, X., Fu, J., Yang, Y., Duan, C., & Wang, J. (2025) · Frontiers in Medicine · doi:10.3389/fmed.2025.1594450 · Cited by 36
“Third, human-AI interaction issues, such as automation complacency or overreliance, (15).”
Metadata
- Authors
- Lyell, D., & Coiera, E.
- Affiliations
- Macquarie University (AU)
- Corresponding author
- Lyell, David
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2016-08-11
- Volume
- 24
- Issue
- 2
- Pages
- 423-431
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC7651899
- OpenAlex
- W2512902140
- Cited by
- 451
- References
- 56
- Citations by year
- 2026: 193 · 2025: 60 · 2024: 55 · 2023: 41 · 2022: 29 · 2021: 27 · 2020: 21 · 2019: 13 · 2018: 7 · 2017: 5
- FWCI
- 1.34
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Journal of the American Medical Informatics Association (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- HCF Research Foundation
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Keywords
- automation bias, decision support system, verification complexity, multitasking, cognitive load, task complexity, over-reliance on automation, sustained attention, diagnostic errors, healthcare decision-making, human factors
- MeSH terms
- Attitude to Computers, Automation, Humans, Bias, Decision Support Systems, Clinical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.