Trust in automation: Part I. Theoretical issues in the study of trust and human intervention in automated systems
Abstract
Today many systems are highly automated. The human operator's role in these systems is to supervise the automation and intervene to take manual control when necessary. The operator's choice of automatic or manual control has important consequences for system performance, and therefore it is important to understand and optimize this decision process. One important determinant of operators' choice of manual or automatic control may be their degree of trust in the automation. However, there have been no experimental tests of this hypothesis until recently, nor is there a model of human trust in machines to form a theoretical foundation for empirical studies. In this paper a model of human trust in machines is developed, taking models of trust between people as a starting point, and extending them to the human-machine relationship. The resulting model defines human trust in machines and specifies how trust changes with experience on a system, providing a framework for experimental research on trust and human intervention in automated systems.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Most existing studies on trust calibration have investigated how to maintain appropriate trust calibration by continuously presenting system information to prevent over-trust or under-trust.
“Most of the studies investigated how to maintain appropriate trust calibration by continuously presenting system information to prevent over-trust or under-trust.”
From Adaptive trust calibration for human-AI collaboration (2020) · cites this paper as [2]
Successful collaborations between users and agents require users to appropriately adjust their level of trust with the actual reliability of the agents.
“Successful collaborations between users and agents would require the users to appropriately adjust their level of trust with the actual reliability of the agents.”
From Adaptive trust calibration for human-AI collaboration (2020) · cites this paper as [2]
Cites
Judgment under Uncertainty: Heuristics and Biases
Tversky, A., & Kahneman, D. (1975) · Utility, Probability, and Human Decision Making · doi:10.1007/978-94-010-1834-0_8 · Cited by 22,650 · see citing works
Judgment under Uncertainty: Heuristics and Biases
(1982) · doi:10.1017/cbo9780511809477 · Cited by 8,240 · see citing works
On the psychology of prediction.
Kahneman, D., & Tversky, A. (1973) · Psychological Review · doi:10.1037/h0034747 · Cited by 6,202 · see citing works
Johnson-Laird, P. N. (1983) · Cited by 4,777 · see citing works
Judgment under uncertainty: List of contributors
Kahneman, D. J., Slovic, P., & Tversky, A. (1982) · Cited by 4,630 · see citing works
Judgment under uncertainty: Causality and attribution
Kahneman, D. J., Slovic, P., & Tversky, A. (1982) · Cited by 4,630 · see citing works
Toffler, A. (1980) · Medical Entomology and Zoology · Cited by 4,357 · see citing works
Handbook of perception and human performance
Boff, K. R., Kaufman, L., & Thomas, J. P. (1986) · Wiley eBooks · Cited by 4,033 · see citing works
Judgment under uncertainty: Heuristics and biases
Tversky, A., & Kahneman, D. J. (1982) · Cambridge University Press eBooks · doi:10.1017/cbo9780511809477.002 · Cited by 3,678 · see citing works
Rasmussen, J. (1983) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1983.6313160 · Cited by 3,434 · see citing works
Rempel, J. K., Holmes, J. G., & Zanna, M. P. (1985) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.49.1.95 · Cited by 3,146 · see citing works
(1979) · Medical Entomology and Zoology · Cited by 3,065 · see citing works
Calibration of probabilities: the state of the art to 1980
Lichtenstein, S., Fischhoff, B., & Phillips, L. D. (1982) · Judgment under Uncertainty · doi:10.1017/cbo9780511809477.023 · Cited by 1,967 · see citing works
Barber, B. (1983) · DigitalGeorgetown (Georgetown University Library) · Cited by 1,801 · see citing works
Interpersonal trust, trustworthiness, and gullibility.
Rotter, J. B. (1980) · American Psychologist · doi:10.1037/0003-066x.35.1.1 · Cited by 1,694 · see citing works
Trust, control strategies and allocation of function in human-machine systems
LEE, J., & MORAY, N. (1992) · Ergonomics · doi:10.1080/00140139208967392 · Cited by 1,459 · see citing works
The resolution of conflict;: Constructive and destructive processes
Deutsch, M. (1973) · Virtual Defense Library (Ministerio de Defensa) · Cited by 1,441 · see citing works
Proceedings of IEEE International Conference on Systems, Man and Cybernetics
(1994) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.1994.399796 · Cited by 1,342 · see citing works
Dedre Gentner, C. (1983) · Cited by 1,329 · see citing works
Overconfidence in case-study judgments.
Oskamp, S. (1965) · Journal of Consulting Psychology · doi:10.1037/h0022125 · Cited by 1,060 · see citing works
Trust between humans and machines, and the design of decision aids
Muir, B. M. (1987) · International Journal of Man-Machine Studies · doi:10.1016/s0020-7373(87)80013-5 · Cited by 767 · see citing works
Self-citationThe Resolution of Conflict: Constructive and Destructive Processes.
Kochan, T. A., & Deutsch, M. (1974) · Administrative Science Quarterly · doi:10.2307/2393904 · Cited by 725 · see citing works
Flight-deck automation: promises and problems
WIENER, E. L., & CURRY, R. E. (1980) · Ergonomics · doi:10.1080/00140138008924809 · Cited by 599 · see citing works
Salvendy, G. (1987) · Medical Entomology and Zoology · Cited by 576 · see citing works
In the age of the smart machine the future of work and power
Zuboff, S. 1. (1988) · Cited by 437 · see citing works
In the Age of the Smart Machine: The Future of Work and Power
Zuboff, S. (1989) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2073307 · Cited by 410 · see citing works
Social Exchange and Behavioral Interdependence
Scanzoni, J. H. (1979) · Elsevier eBooks · doi:10.1016/b978-0-12-143550-9.50009-4 · Cited by 307 · see citing works
The human operator in process control
Mohler, R. R. (1975) · Annals of Nuclear Energy · doi:10.1016/0306-4549(75)90121-8 · Cited by 271 · see citing works
Levels, Hierarchies, and the Locus of Control
Broadbent, D. E. (1977) · Quarterly Journal of Experimental Psychology · doi:10.1080/14640747708400596 · Cited by 259 · see citing works
Sage, A. P. (1981) · IEEE Transactions on Systems Man and Cybernetics · doi:10.1109/tsmc.1981.4308761 · Cited by 225 · see citing works
Marriage research and conflict: An integrative review.
Barry, W. A. (1970) · Psychological Bulletin · doi:10.1037/h0028474 · Cited by 182 · see citing works
Does The Expert Know? The Reliability of Predictions and Confidence Ratings of Experts
Wagenaar, W. A., & Keren, G. B. (1986) · NATO ASI series. Series F : Computer and system sciences · doi:10.1007/978-3-642-50329-0_6 · Cited by 160 · see citing works
Human-Computer Interaction in Multitask Situations
Rouse, W. B. (1977) · IEEE Transactions on Systems Man and Cybernetics · doi:10.1109/tsmc.1977.4309727 · Cited by 120 · see citing works
Maruyama, M. (1981) · Technological Forecasting and Social Change · doi:10.1016/0040-1625(81)90043-3 · Cited by 105 · see citing works
Research and Modeling of Supervisory Control Behavior. Report of a Workshop
Sheridan, T. B., & Hennessy, R. T. (1984) · doi:10.21236/ada149621 · Cited by 80 · see citing works
Adapting automation to man, culture and society
Sheridan, T. B., Vámos, T., & Aida, S. (1983) · Automatica · doi:10.1016/0005-1098(83)90024-9 · Cited by 72 · see citing works
Research Needs for Human Factors
National Research Council (1983) · National Academies Press eBooks · doi:10.17226/759 · Cited by 46 · see citing works
A Study of Real-Time Human Decision-Making Using a Plant Simulator
Bainbridge, L., Beishon, J., Hemming, J. H., & Splaine, M. (1968) · Journal of the Operational Research Society · doi:10.1057/jors.1968.12 · Cited by 40 · see citing works
Rempel, J. K., & Holmes, J. G. (1986) · PsycEXTRA Dataset · doi:10.1037/e400682009-003 · Cited by 27 · see citing works
Understanding and Enhancing User Acceptance of Computer Technology
Rouse, W. B., & Morris, N. M. (1986) · IEEE Transactions on Systems Man and Cybernetics · doi:10.1109/tsmc.1986.4309014 · Cited by 26 · see citing works
Cognitive Reliability in Manned Systems
Halpin, S. M., Johnson, E. M., & Thornberry, J. A. (1973) · IEEE Transactions on Reliability · doi:10.1109/tr.1973.5215932 · Cited by 25 · see citing works
Monitoring behaviour and supervisory control
(1975) · Applied Ergonomics · doi:10.1016/0003-6870(75)90372-5 · Cited by 20 · see citing works
Sheridan, T. B. (1974) · NASA Technical Reports Server (NASA) · Cited by 14 · see citing works
Adapting Automation to Man, Culture and Society
Sheridan, T. B., Vámos, T., & Aida, S. (1981) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)63962-4 · Cited by 6 · see citing works
Flagged first, then by citations
5 of the 49 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · see citing works
“This is particularly true when considering how trust relates to automation (Cohen, Parasuraman, & Freeman, 1999; Muir,1994).”
BackgroundThe role of trust in automation reliance
Dzindolet, M. T., Peterson, S. A., Pomranky, R. A., Pierce, L. G., & Beck, H. P. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00038-7 · Cited by 1,276 · see citing works
On-line trust: concepts, evolving themes, a model
Corritore, C. L., Kracher, B., & Wiedenbeck, S. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00041-7 · Cited by 1,200 · see citing works
“Trust is seen as an intervening variable that mediates users' behavior with computers (Muir, 1994).”
BackgroundMUIR, B. M., & MORAY, N. (1996) · Ergonomics · doi:10.1080/00140139608964474 · Cited by 993 · see citing works
Self-citationTrust In and Adoption of Online Recommendation Agents
Benbasat, I., & Wang, W. (2005) · Journal of the Association for Information Systems · doi:10.17705/1jais.00065 · Cited by 847 · see citing works
“For example, Lerch et al. (1993) and Muir (1994) have explored other machine trust related beliefs such as reliability, predictability, dependability, and faith as they relate to machines.”
BackgroundThe elements of computer credibility
Fogg, B. J., & Tseng, H. (1999) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/302979.303001 · Cited by 820 · see citing works
Schaefer, K. E., Chen, J. Y. C., Szalma, J. L., & Hancock, P. A. (2016) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720816634228 · Cited by 768 · see citing works
“If experience with a machine provides predictable outcomes, then operators start to and then continue to trust the system (Cahour & Forzy, 2009; Muir, 1994).”
Background'It's Reducing a Human Being to a Percentage': Perceptions of Justice in Algorithmic Decisions
Binns, R., Van Kleek, M., Veale, M., Lyngs, U., Zhao, J., & Shadbolt, N. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173951 · Cited by 691 · see citing works
“As users form mental models [52] of machine learning systems over time, such long-term exposure may lead to greater understanding [76] and greater trust and reliance [47].”
Background<i>Why and why not</i> explanations improve the intelligibility of context-aware intelligent systems
Lim, B. Y., Dey, A. K., & Avrahami, D. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1519023 · Cited by 552 · see citing works
Metrics for explainable AI: challenges and prospects
Hoffman, R. R., Mueller, S. T., Klein, G., & Litman, J. (2018) · arXiv · doi:10.48550/arxiv.1812.04608 · Cited by 518 · see citing works
“Based on our review of the psychological literature on explanation, including theoretical and empirical work by Muir (1987, 1994) and by Cahour and Forzy (2009), we identified several key attributes of explanations: understandability, feeling of satisfaction, sufficiency of detail, completeness,…”
BackgroundStanton, N. A., Stewart, R., Harris, D., Houghton, R. J., Baber, C., McMaster, R., Salmon, P. M., Hoyle, G., Walker, G. H., Young, M. S., et al. (2006) · Ergonomics · doi:10.1080/00140130600612762 · Cited by 508 · see citing works
“Research into trust and technology suggests that there are shared traits between interpersonal trust and technological trust (Muir, 1994; Muir & Moray, 1996).”
BackgroundSimilarities and differences between human–human and human–automation trust: an integrative review
Madhavan, P., & Wiegmann, D. A. (2007) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220500337708 · Cited by 577 · see citing works
“The concept of automation trust, in general, has been the focus of a vast body of research over the last decade (Muir 1987, 1994, Lee and Moray 1992, 1994, Blomqvist 1997, Lerch et al. 1997, Lee and See 2004).”
BackgroundAlmost human: Anthropomorphism increases trust resilience in cognitive agents.
de Visser, E. J., Monfort, S. S., McKendrick, R., Smith, M. A. B., McKnight, P. E., Krueger, F., & Parasuraman, R. (2016) · Journal of Experimental Psychology: Applied · doi:10.1037/xap0000092 · Cited by 614 · see citing works
“Although early research on trust in automation assumed that human trust was similar in character to human automation trust (Lee & Moray, 1992; Muir, 1987, 1994), this proposition has not been systematically and consistently tested by comparing humans and computers in the same study.”
BackgroundThe effects of transparency on trust in and acceptance of a content-based art recommender
Cramer, H., Evers, V., Ramlal, S., van Someren, M., Rutledge, L., Stash, N., Aroyo, L., & Wielinga, B. (2008) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-008-9051-3 · Cited by 448 · see citing works
“Users may have a level of trust in a device, but also have a level of trust in the success of cooperation with the device (see also Muir 1994; Muir and Moray 1996).”
BackgroundMerritt, S. M., & Ilgen, D. R. (2008) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872008x288574 · Cited by 527 · see citing works
“The relationship of trust and automation use was examined in a series of studies using variations of the PASTEURIZER task (Lee & Moray, 1992, 1994; Muir, 1989; Muir & Moray, 1996).”
BackgroundMethodHybrid-augmented intelligence: collaboration and cognition
Zheng, N., Liu, Z.-Y., Ren, P.-J., Ma, Y.-Q., Chen, S.-T., Yu, S.-Y., Xue, J.-R., Chen, B.-D., & Wang, F.-Y. (2017) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.1700053 · Cited by 303 · see citing works
“In common machine learning methods, the initial iteration position is usually obtained at the sacrifice of the generalization abilities of the algorithm, such as the introduction of strong assumptions (Lippmann, 1987) and increasing human intervention (Muir, 1994).”
BackgroundTowards a cognitive approach to human–machine cooperation in dynamic situations
HOC, J.-M. (2001) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.2000.0454 · Cited by 387 · see citing works
The Perceived Utility of Human and Automated Aids in a Visual Detection Task
Dzindolet, M. T., Pierce, L. G., Beck, H. P., & Dawe, L. A. (2002) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/0018720024494856 · Cited by 386 · see citing works
“Trust is one social process in the framework of automation use that has been researched in the human factors literature (Cohen et al., 1998; Lee & Moray, 1992, 1994; Moray, Inagaki, & Itoh, 2000; Mosier & Skitka, 1996; Muir, 1987, 1994; Singh, Molloy, & Parasuraman, 1993).”
BackgroundMethodAkter, S., D’Ambra, J. D., & RAY, P. K. (2010) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21442 · Cited by 386 · see citing works
“It also reflects reliability (Giddens, 1990; Hardin, 2001; Muir, 1994), consistency (Butler, 1991), or behaving as expected (Luhmann, 1979; Seligman, 1997; Sheppard & Sherman, 1998).”
BackgroundCho, J.-H., Chan, K., & Adalı, S. (2015) · ACM Computing Surveys · doi:10.1145/2815595 · Cited by 346 · see citing works
Gold, C., Körber, M., Hohenberger, C., Lechner, D., & Bengler, K. J. (2015) · Procedia Manufacturing · doi:10.1016/j.promfg.2015.07.847 · Cited by 346 · see citing works
Psychosocial factors associated with intended use of automated vehicles: A simulated driving study
Buckley, L., Kaye, S.-A., & Pradhan, A. K. (2018) · Accident Analysis & Prevention · doi:10.1016/j.aap.2018.03.021 · Cited by 346 · see citing works
“While it is acknowledged that trust is a multi-faceted concept and that multiple definitions of trust in automation exist (see: Muir, 1994; Walker et al., 2016), in the current study trust in automation was referred to as the drivers’ perception of the reliability of the conditional AV. Lee and…”
BackgroundAdaptive automation, trust, and self-confidence in fault management of time-critical tasks.
Moray, N. P., Inagaki, T., & Itoh, M. (2000) · Journal of Experimental Psychology Applied · doi:10.1037//1076-898x.6.1.44 · Cited by 345 · see citing works
Behavioural adaptation to adaptive cruise control (ACC): implications for preventive strategies
Rudin-Brown, C. M., & Parker, H. A. (2004) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2004.02.001 · Cited by 340 · see citing works
Control Task Substitution in Semiautomated Driving
Carsten, O., Lai, F. C. H., Barnard, Y. F., Jamson, A. H., & Merat, N. (2012) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720812460246 · Cited by 334 · see citing works
“As used here, the term capability can be likened to that of “technical competence” as used by Muir (1994): “The expectation of technical competence is probably closest to our intuitive understanding of what it means to trust a machine; machines are designed to perform a task, and we expect them to…”
MethodDo travelers trust intelligent service robots?
Tussyadiah, I. P., Zach, F., & Wang, J. (2020) · Annals of Tourism Research · doi:10.1016/j.annals.2020.102886 · Cited by 305 · see citing works
“Consumer trust for machines can be extended from interpersonal trust and influenced by similar factors that determine trust between people (Muir, 1994; Yagoda and Gillan, 2012).”
BackgroundBeggiato, M., & Krems, J. F. (2013) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2012.12.006 · Cited by 328 · see citing works
Explanations in Autonomous Driving: A Survey
Omeiza, D., Webb, H., Jirotka, M., & Kunze, L. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3122865 · Cited by 355 · see citing works
“, since the introduction of interpersonal trust theories into the human-machine interaction domain by [38], [39], [40], [37].”
BackgroundMeasurement of Trust in Automation: A Narrative Review and Reference Guide
Kohn, S. C., de Visser, E. J., Wiese, E., Lee, Y., & Shaw, T. H. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.604977 · Cited by 337 · see citing works
“Other surveys focus on trustworthiness as a singular construct without component factors (Lee and Moray, 1992, 1994).”
BackgroundTheoretical Considerations and Development of a Questionnaire to Measure Trust in Automation
Körber, M. (2019) · Advances in Intelligent Systems and Computing · doi:10.1007/978-3-319-96074-6_2 · Cited by 317 · see citing works
Determinants of customer satisfaction in chatbot use: evidence from a banking application in Turkey
Eren, B. A. (2021) · International Journal of Bank Marketing · doi:10.1108/ijbm-02-2020-0056 · Cited by 336 · see citing works
The role of trust in human-robot interaction
Lewis, M., Sycara, K., & Walker, P. M. (2018) · Studies in systems, decision and control · doi:10.1007/978-3-319-64816-3_8 · Cited by 298 · see citing works
How can humans understand their automated cars? HMI principles, problems and solutions
Carsten, O., & Martens, M. H. (2019) · Cognition, Technology & Work · doi:10.1007/s10111-018-0484-0 · Cited by 284 · see citing works
“Trust, once lost, is hard to regain (Muir 1994).”
Driver behaviour with adaptive cruise control
Stanton, N. A., & Young, M. S. (2005) · Ergonomics · doi:10.1080/00140130500252990 · Cited by 284 · see citing works
“A multidimensional trust scale based upon Muir (1994).”
BackgroundKraus, J., Scholz, D., Stiegemeier, D., & Baumann, M. (2020) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720819853686 · Cited by 276 · see citing works
“Relevant beliefs for trust calibration include perceived predictability, dependability, faith, competence, and reliability of the system (Muir, 1994; Muir & Moray, 1996).”
BackgroundImproving the Driver–Automation Interaction
Beller, J., Heesen, M., & Vollrath, M. (2013) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720813482327 · Cited by 283 · see citing works
“For a successful cooperation, the driver must trust the automation (Lee & See, 2004; Muir, 1994; Muir & Moray, 1996).”
BackgroundKelton, K., Fleischmann, K. R., & Wallace, W. A. (2007) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20722 · Cited by 274 · see citing works
Hoffman, R. R., Mueller, S. T., Klein, G., & Litman, J. (2023) · Frontiers in Computer Science · doi:10.3389/fcomp.2023.1096257 · Cited by 272 · see citing works
“Based on our review of the psychological literature, including theoretical and empirical work by Muir (1987, 1994) and by Cahour and Forzy (2009), we identified several key attributes of explanation 10.3389 /fcomp.”
MethodInfluentialAutomation failures on tasks easily performed by operators undermine trust in automated aids
Madhavan, P., Wiegmann, D. A., & Lacson, F. C. (2006) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872006777724408 · Cited by 268 · see citing works
“Nonetheless, the relationship between trust and operators’ reliance upon imperfectly reliable automation is often complex and multifaceted (e.g., Lee & Moray, 1992, 1994; Lerch, Prietula, & Kulik, 1997; Muir, 1987, 1994; Sheridan, 2002; Wiegmann, Rich, & Zhang, 2001).”
BackgroundVerberne, F. M. F., Ham, J. R. C., & Midden, C. J. H. (2012) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720812443825 · Cited by 264 · see citing works
“Previous studies have shown that trust is a crucial psychological factor that contributes to the acceptability of automation technology (e.g., Lee & Moray, 1992; Lee & See, 2004; Lewandowsky, Mundy, & Tan, 2000; Muir, 1994; Muir & Moray, 1996; Parasuraman & Riley, 1997; Riley, 1996).”
BackgroundAffective Processes in Human–Automation Interactions
Merritt, S. M. (2011) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720811411912 · Cited by 260 · see citing works
“…trust in an automated system is a more cognitive attitude (Parasuraman & Wickens, 2008) and is strongly associated with judgments of predictability, dependability, responsibility, and competence (Muir, 1994; Muir & Moray, 1996), liking encompasses a more affectively laden impression of the sys-tem.”
BackgroundDeb, S., Strawderman, L., Carruth, D. W., DuBien, J., Smith, B., & Garrison, T. M. (2017) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2017.08.029 · Cited by 259 · see citing works
Bellem, H., Thiel, B., Schrauf, M., & Krems, J. F. (2018) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2018.02.036 · Cited by 254 · see citing works
Assessing demand for intelligibility in context-aware applications
Lim, B. Y., & Dey, A. K. (2009) · Proceedings of the 11th international conference on Ubiquitous computing · doi:10.1145/1620545.1620576 · Cited by 246 · see citing works
“Such a lack of application intelligibility can lead users to mistrust the system, misuse it, or abandon it altogether [ 22 ].”
BackgroundLooije, R., Neerincx, M. A., & Cnossen, F. (2010) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2009.08.007 · Cited by 243 · see citing works
The dynamics of trust: Comparing humans to automation.
Lewandowsky, S., Mundy, M., & Tan, G. P. A. (2000) · Journal of Experimental Psychology Applied · doi:10.1037//1076-898x.6.2.104 · Cited by 241 · see citing works
Adaptive trust calibration for human-AI collaboration
Okamura, K., & Yamada, S. (2020) · PLOS ONE · doi:10.1371/journal.pone.0229132 · Cited by 239 · see citing works
Evolving Trust in Robots: Specification Through Sequential and Comparative Meta-Analyses
Hancock, P. A., Kessler, T. T., Kaplan, A. D., Brill, J. C., & Szalma, J. L. (2020) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720820922080 · Cited by 240 · see citing works
“As mentioned, miscalibrations of trust can lead to various forms of maladaptive interaction (Muir, 1994; Parasuraman & Riley, 1997).”
BackgroundBailey, N. R., & Scerbo, M. W. (2007) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220500535301 · Cited by 224 · see citing works
“Muir (1987, 1994) has also suggested that continued experience with highly reliable systems can further degrade monitoring performance.”
BackgroundInfluentialAutomated driving: Safety blind spots
Noy, I. Y., Shinar, D., & Horrey, W. J. (2017) · Safety Science · doi:10.1016/j.ssci.2017.07.018 · Cited by 230 · see citing works
Requirements-Aware Systems: A Research Agenda for RE for Self-adaptive Systems
Sawyer, P., Bencomo, N., Whittle, J., Letier, E., & Finkelstein, A. (2010) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re.2010.21 · Cited by 227 · see citing works
“Such a lack of intelligibility can mean that users may cease to use a selfadaptive system [35].”
Why different trust relationships matter for information systems users
Söllner, M., Hoffmann, A., & Leimeister, J. M. (2016) · European Journal of Information Systems · doi:10.1057/ejis.2015.17 · Cited by 223 · see citing works
Effects of communication style and culture on ability to accept recommendations from robots
Rau, P. L. P., Li, Y., & Li, D. (2009) · Computers in Human Behavior · doi:10.1016/j.chb.2008.12.025 · Cited by 221 · see citing works
Designing Transparency for Effective Human-AI Collaboration
Vössing, M., Kühl, N., Lind, M., & Satzger, G. (2022) · Information Systems Frontiers · doi:10.1007/s10796-022-10284-3 · Cited by 266 · see citing works
“Trust is particularly important in the context of complex technical systems, which are characterized by steadily increasing levels of automation (Söllner et al., 2016b; Muir, 1994).”
BackgroundBeggiato, M., Pereira, M. C. A., Petzoldt, T., & Krems, J. F. (2015) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2015.10.005 · Cited by 217 · see citing works
Xing, Y., Lv, C., Cao, D., & Hang, P. (2021) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2021.103199 · Cited by 215 · see citing works
Prediction of subjective states from psychophysiology: A multivariate approach
Fairclough, S. H., & Venables, L. (2005) · Biological Psychology · doi:10.1016/j.biopsycho.2005.03.007 · Cited by 199 · see citing works
Sarter, N. B., & Schroeder, B. (2001) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872001775870403 · Cited by 195 · see citing works
“…technologies, can lead to the opposite, but equally undesirable, effect: Pilots may not use the system-provided information or follow its recommendations when they should do so (Endsley, 1996; Endsley & Kiris, 1995; Lee & Moray, 1992, 1994; Muir, 1994; Parasuraman & Riley, 1997; Riley, 1996).”
BackgroundTrust in electronic environments
Chopra, K., & Wallace, W. A. (2003) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2003.1174902 · Cited by 194 · see citing works
“Moreover, researchers have found that user attitudes toward technology, and trust in particular, affect the use of that technology [6, 50].”
BackgroundInfluentialHow do visual explanations foster end users' appropriate trust in machine learning?
Yang, F., Huang, Z., Scholtz, J., & Arendt, D. L. (2020) · Proceedings of the 25th International Conference on Intelligent User Interfaces · doi:10.1145/3377325.3377480 · Cited by 200 · see citing works
“While many definitions and models of trust were proposed[81, 119] in different contexts (e.g., human-human[70, 77], human-automation[37, 62, 93], and e-commerce[32, 64]), we use the definition for human-computer trust from Madsen and Gregor[72] which was adapted from McAllister[78]: “…”
MethodThe automation of leadership functions: Would people trust decision algorithms?
Höddinghaus, M., Sondern, D., & Hertel, G. (2020) · Computers in Human Behavior · doi:10.1016/j.chb.2020.106635 · Cited by 192 · see citing works
Human resource information systems (HRIS) and technology trust
Lippert, S. K., & Swiercz, P. M. (2005) · Journal of Information Science · doi:10.1177/0165551505055399 · Cited by 180 · see citing works
Molnar, L. J., Ryan, L. H., Pradhan, A. K., Eby, D. W., St. Louis, R. M., & Zakrajsek, J. S. (2018) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2018.06.004 · Cited by 172 · see citing works
Creating Appropriate Trust in Automated Vehicle Systems: A Framework for HMI Design
Ekman, F., Johansson, M., & Sochor, J. (2018) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2017.2776209 · Cited by 150 · see citing works
“Supervisory control of automation has, for example, been considered to resemble the interaction between staff and manager [2], [4].”
BackgroundVehicle automation and driving performance
Stanton, N. A., & Young, M. S. (1998) · Ergonomics · doi:10.1080/001401398186568 · Cited by 169 · see citing works
Alarm timing, trust and driver expectation for forward collision warning systems
Abe, G., & Richardson, J. H. (2005) · Applied Ergonomics · doi:10.1016/j.apergo.2005.11.001 · Cited by 169 · see citing works
Graduate Theses and Dissertations
Davis, M., Davis, K. J., & Dunagan, M. M. (2012) · Elsevier eBooks · doi:10.1016/b978-0-12-384727-0.00006-9 · Cited by 165 · see citing works
When computers take the lead: The automation of leadership
Wesche, J. S., & Sonderegger, A. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2019.07.027 · Cited by 157 · see citing works
Being Transparent about Transparency: A Model for Human-Robot Interaction
Lyons, J. B. (2013) · National Conference on Artificial Intelligence · Cited by 152 · see citing works
JDL level 5 fusion model: user refinement issues and applications in group tracking
Blasch, E., & Plano, S. (2002) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.477612 · Cited by 152 · see citing works
Toolkit to support intelligibility in context-aware applications
Lim, B. Y., & Dey, A. K. (2010) · Proceedings of the 12th ACM international conference on Ubiquitous computing · doi:10.1145/1864349.1864353 · Cited by 143 · see citing works
“This can frustrate users [4], and cause them to lose trust in the applications [ 29 ].”
BackgroundJohnson, D. S. (2007) · Journal of Interactive Marketing · doi:10.1002/dir.20091 · Cited by 142 · see citing works
“…control a technology system that can be set to operate automatically is directly related to their level of trust in the technology and that a deterioration of trust is dependent on how transient or systematic the fault is perceived to be (Lee, 1994; Lee & Moray, 1992; Muir, 1994; Zuboff, 1988).”
BackgroundTrustworthy AI and robotics: Implications for the AEC industry
Emaminejad, N., & Akhavian, R. (2022) · Automation in Construction · doi:10.1016/j.autcon.2022.104298 · Cited by 152 · see citing works
“Adjusting human trust levels with the actual abilities of the AIR systems is a key process to ensure overtrust and undertrust are not happening (Muir 1994, Lee and See 2004).”
BackgroundHuman-machine Collaborative Decision-making: An Evolutionary Roadmap Based on Cognitive Intelligence
Ren, M., Chen, N., & Qiu, H. (2023) · International Journal of Social Robotics · doi:10.1007/s12369-023-01020-1 · Cited by 151 · see citing works
“Muir [128] studies the timing and conditions of human-computer interaction from the perspective of obtaining mutual trust.”
BackgroundCooperation between drivers and automation: implications for safety
Hoc, J., Young, M. S., & Blosseville, J. M. (2008) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220802368856 · Cited by 137 · see citing works
“At this level, trust in automation and in one’s relations with automation, together with self-confidence, can be calibrated through the use of models elaborated by experience (Muir 1994, Lee and See 2004).”
MethodTullio, J., Dey, A. K., Chalecki, J., & Fogarty, J. A. (2007) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1240624.1240630 · Cited by 137 · see citing works
“This trust comes from an ability to predict the system's behavior through observation [20].”
BackgroundMethodKhastgir, S., Birrell, S., Dhadyalla, G., & Jennings, P. (2018) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2018.07.001 · Cited by 134 · see citing works
“The authors adopt the definition of calibration of trust as “the process 214 of adjusting trust to correspond to an objective measure of trustworthiness” (Muir, 1994).”
BackgroundInfluentialHoffman, L. J., Lawson-Jenkins, K., & Blum, J. J. (2006) · Communications of the ACM · doi:10.1145/1139922.1139924 · Cited by 133 · see citing works
The impact of cognitive feedback on judgment performance and trust with decision aids
Seong, Y., & Bisantz, A. M. (2008) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2008.01.007 · Cited by 129 · see citing works
A Survey on Socially Aware Device-to-Device Communications
Ahmed, M., Li, Y., Waqas, M., Sheraz, M., Jin, D., & Han, Z. (2018) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2820069 · Cited by 126 · see citing works
Gao, J., & Lee, J. D. (2006) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/tsmca.2005.855783 · Cited by 124 · see citing works
A proposed psychological model of driving automation
Stanton, N. A., & Young, M. S. (2000) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220052399131 · Cited by 125 · see citing works
“Muir (1994) reviewed the literature on trust, and found s̀urprisingly little research’ on trust in other people.”
BackgroundMethodInfluentialWright, J. L., Chen, J. Y. C., & Lakhmani, S. G. (2020) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2019.2925717 · Cited by 102 · see citing works
“This finding suggests that in-depth knowledge of the underlying reasons for an agent’s actions and reasoning may bolster trust in the agent and mitigate the effects of unreliable automation, at least so far as specific functions are concerned [51], [52]–[54].”
BackgroundThe Influence of Task Load and Automation Trust on Deception Detection
Biros, D. P., Daly, M., & Gunsch, G. H. (2004) · Group Decision and Negotiation · doi:10.1023/b:grup.0000021840.85686.57 · Cited by 120 · see citing works
“Trust in automation is one area that continues to generate interest among researchers (Fields 2001; Jian, Bisantz, Drury, and Llins 1998; Lee and Moray 1992; Muir 1994; Muir and Moray 1996; Sheridan 1988; Tseng and Fogg 1999).”
BackgroundTowards Effective Interface Designs for Collaborative HRI in Manufacturing
Marvel, J. A., Bagchi, S., Zimmerman, M., & Antonishek, B. (2020) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3385009 · Cited by 120 · see citing works
“Another metric of trust measurement was proposed by Muir that establishes trust as a combination of predictability, dependability, faith, competence, responsibility, and reliability [Muir 1994].”
BackgroundIndividual differences in human–machine trust: A multi-study look at the perfect automation schema
Lyons, J. B., & Guznov, S. (2018) · Theoretical Issues in Ergonomics Science · doi:10.1080/1463922x.2018.1491071 · Cited by 91 · see citing works
“2018 Informa UK Limited, trading as Taylor & Francis Group performance and intervene when necessary when errors were detected (Muir 1994), yet this assumes a human who is both “motivated” and “able” to scrutinize the automation.”
BackgroundInducing Sensitivity to Deception in Order to Improve Decision Making Performance: A Field Study1
Biros, D. P., George, J. F., & Zmud, R. W. (2002) · MIS Quarterly · doi:10.2307/4132323 · Cited by 113 · see citing works
Impact of training and in-vehicle task performance on manual control recovery in an automated car
Payre, W., Cestac, J., Dang, N., Vienne, F., & Delhomme, P. (2017) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2017.02.001 · Cited by 110 · see citing works
Team Structure and Team Building Improve Human–Machine Teaming With Autonomous Agents
Walliser, J. C., de Visser, E., Wiese, E., & Shaw, T. H. (2019) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/1555343419867563 · Cited by 105 · see citing works
“…interaction has been studied under a supervisory control framework, akin to a master–slave relationship (de Visser, Shaw, Mohamed-Ameen, & Parasuraman, 2010; Dzindolet, Pierce, Beck, Dawe, & Anderson, 2001; Muir, 1994; Muir & Moray, 1996; Satterfield, Ramirez, Shaw, & Parasuraman, 2012).”
Cameron, D. S., de Saille, S., Collins, E. C., Aitken, J. M., Cheung, H., Chua, A., Loh, E. J., & Law, J. (2020) · Computers in Human Behavior · doi:10.1016/j.chb.2020.106561 · Cited by 107 · see citing works
Where Is Computing Driving Cars?
Walker, G. H., Stanton, N. A., & Young, M. S. (2001) · International Journal of Human-Computer Interaction · doi:10.1207/s15327590ijhc1302_7 · Cited by 106 · see citing works
“Trust in automation (Lee & Moray, 1992; Muir, 1994; Muir & Moray, 1996) has only recently begun to be examined in detail and is a factor that interacts with LoC.”
BackgroundModeling Trust in Human-Robot Interaction: A Survey
Khavas, Z. R., Ahmadzadeh, R., & Robinette, P. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-62056-1_44 · Cited by 105 · see citing works
“other researchers have modeled the operator’s trust in automation, considering more factors affecting trust [24,14,31]. These models were finally classified into five groups [36]: regression-based models [37,29], time series models [30], qualitative models [47], argument based probabilistic models[9], and neural net model…”
BackgroundMethodInvestigating intelligibility for uncertain context-aware applications
Lim, B. Y., & Dey, A. K. (2011) · Proceedings of the 13th international conference on Ubiquitous computing · doi:10.1145/2030112.2030168 · Cited by 101 · see citing works
Shao, Z., Zhang, L., Brown, S. A., & Zhao, T. (2022) · Decision Support Systems · doi:10.1016/j.dss.2021.113716 · Cited by 102 · see citing works
Investigation of Behavioral Adaptation to Lane Departure Warnings
Rudin-Brown, C. M., & Noy, Y. I. (2002) · Transportation Research Record Journal of the Transportation Research Board · doi:10.3141/1803-05 · Cited by 103 · see citing works
Driving automation: learning from aviation about design philosophies
Young, M. S., Stanton, N. A., & Harris, D. (2007) · International Journal of Vehicle Design · doi:10.1504/ijvd.2007.014908 · Cited by 102 · see citing works
“Indeed, models of trust in automation have been built upon models of interpersonal trust in humans (Muir, 1994), so it seems logical to apply another aspect of human-human cooperation to human-machine cooperation.”
BackgroundLanger, M., König, C. J., & Busch, V. (2020) · Journal of Business and Psychology · doi:10.1007/s10869-020-09711-6 · Cited by 103 · see citing works
“Historically, automation predominantly affected production and aviation (Endsley, 2017) or supported monitoring tasks (e.g., monitor nuclear power plants; Muir, 1994).”
BackgroundTrusting a Virtual Driver That Looks, Acts, and Thinks Like You
Verberne, F. M. F., Ham, J., & Midden, C. J. H. (2015) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720815580749 · Cited by 101 · see citing works
“…is a crucial psychological factor that determines whether or not humans are willing to hand over control to that technology (e.g., Lee & Moray, 1992; Muir, 1994; Muir & Moray, 1996), because trust is necessary in a situation that is characterized by uncertainty and vulnerability (Lee & See, 2004).”
BackgroundA Conceptual Model of Trust, Perceived Risk, and Reliance on AI Decision Aids
Solberg, E., Kaarstad, M., Eitrheim, M. H. R., Bisio, R., Reegård, K., & Bloch, M. (2022) · Group & Organization Management · doi:10.1177/10596011221081238 · Cited by 102 · see citing works
“Similarly, in the trust in technology and trust in automation literatures, it is understood that people do not simply base their trust in a technology on its technological attributes (McKnight et al., 2011; Muir, 1994).”
BackgroundInfluential
- Authors
- MUIR, B. M.
- Affiliations
- University of Toronto (CA)
- Corresponding author
- MUIR, BONNIE M.
- Venue
- Ergonomics
- Publisher
- Informa UK Limited
- Published
- 1994-11
- Volume
- 37
- Issue
- 11
- Pages
- 1905-1922
- ISSN
- 0014-0139 (ISSN-L)
- 1366-5847
- OpenAlex
- W2032426551
- Cited by
- 873
- References
- 49
- Citations by year
- 2026: 33 · 2025: 52 · 2024: 46 · 2023: 41 · 2022: 51 · 2021: 72 · 2020: 60 · 2019: 44 · 2018: 50 · 2017: 36 · 2016: 46 · 2015: 17 · 2014: 29 · 2013: 26 · 2012: 27
- FWCI
- 2.63
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Ergonomics (publishedVersion)
- Funders
- Natural Sciences and Engineering Research Council of Canada
- Topics
- Social Sciences › Psychology › Social Psychology › Human-Automation Interaction and Safety
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- trust in automation, human-machine trust, human intervention, manual control, automated systems, operator decision-making, trust model, human oversight
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
